https://arxiv.org/abs/2306.07899 here’s a paper that found that one of the biggest sources for LLM training data is corrupted by people using AI to complete the tasks. There are plenty of papers out there that show the effects of this, which they call “model collapse”.
That’s a way to deal with it, but in the long term, “pre-AI” becomes a longer and longer time ago, and less and less useful for any practical purposes.
While I don’t have definitive proof I’ve seen both AI fanarts that are so good it’s hard to tell if it’s AI or not and AI abominations that are so bad and artificial it want to make you puke so I guess it really depends on the model.
Funny enough adobe now offers AI generated stock photos that are closer to those abominations rather than anything good. Though if you think about it AI stock art is so pointless… There are already so many stock photos you can choose from. Why would you go out of your way to choose a photo that looks almost the same as regular stock photos but people have 4 arms in it…
I’d love for this to be true, but I’d need to see some proof. It feels like wish-fulfillment.
https://arxiv.org/abs/2306.07899 here’s a paper that found that one of the biggest sources for LLM training data is corrupted by people using AI to complete the tasks. There are plenty of papers out there that show the effects of this, which they call “model collapse”.
deleted by creator
That’s a way to deal with it, but in the long term, “pre-AI” becomes a longer and longer time ago, and less and less useful for any practical purposes.
Given how they’re one of the main culprits of showing AI spam on the first page, I don’t think they care at all
While I don’t have definitive proof I’ve seen both AI fanarts that are so good it’s hard to tell if it’s AI or not and AI abominations that are so bad and artificial it want to make you puke so I guess it really depends on the model.
Funny enough adobe now offers AI generated stock photos that are closer to those abominations rather than anything good. Though if you think about it AI stock art is so pointless… There are already so many stock photos you can choose from. Why would you go out of your way to choose a photo that looks almost the same as regular stock photos but people have 4 arms in it…
You never know what smut some people are writing. Maybe that 4 armed horror was exactly what they needed for their cover.
I’ve heard training on synthetic data is fine now. Most datasets are augmented with synthetic data.