Apparently, AI is getting worse (or at least GPT-4 is).
Pretty insane that these tools that people have come to rely on can so drastically break over a period of just a few months. Imagine if any other software just stopped working like this. And I have a feeling it’s going to get worse.
Researchers have found that we could potentially run out of human-written training data for these LLMs by 2026, and as soon as AI starts cannibalizing content that it or another LLM has written for training data, they start to break down.
Just a reminder that, while slightly useful in some situations, these LLMs leech off of the work of real people and fundamentally cannot function without it. AI certainly is not, cannot, and should never be a replacement for the work of real people.
And, as a side note, solidarity with the WGA and SAG-AFTRA.
1C2
Apparently, AI is getting worse (or at least GPT-4 is).
Pretty insane that these tools that people have come to rely on can so drastically break over a period of just a few months. Imagine if any other software just stopped working like this. And I have a feeling it’s going to get worse.
Researchers have found that we could potentially run out of human-written training data for these LLMs by 2026, and as soon as AI starts cannibalizing content that it or another LLM has written for training data, they start to break down.
Just a reminder that, while slightly useful in some situations, these LLMs leech off of the work of real people and fundamentally cannot function without it. AI certainly is not, cannot, and should never be a replacement for the work of real people.
And, as a side note, solidarity with the WGA and SAG-AFTRA.
twitter.com/matei_zaharia/status/16814679619059261…
arxiv.org/pdf/2307.09009.pdf
www.technologyreview.com/2022/11/24/1063684/we-cou…
futurism.com/ai-trained-ai-generated-data
1 year ago | [YT] | 73