204
‘It’s destroyed me completely’: Kenyan moderators decry toll of training of AI models
(www.theguardian.com)
this post was submitted on 03 Aug 2023
204 points (100.0% liked)
Technology
37727 readers
709 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Let me stop you right there. The current concept of "AI"--otherwise known as Large Language Models because that is really what people are referring to--is not capable of creativity. ChatGPT and things like it just regurgitate stuff they find. They can't create something new and original
It creates things. Whether it is truly “creative” in the sense that humans are “creative”, doesn’t really matter. Now, you might respond by saying that it only regurgitates, but I would argue that many if not all human creative outputs are, at least to some degree, “regurgitations” in the same sense. I am not disregarding art, just saying that art is always derivative to some degree.
It doesn't really matter though. It will take away jobs from people in creative industries that only creative people were able to do before. The end result is basically the same.
Why would AI that can't be creative take jobs from people that are capable of being creative?
Because it's not the AI that's taking away jobs, but the executives hoping to cut costs regardless of creativity, quality, or ethics.
So then blame the real problem, which is not new and has always been the main enemy: capitalism and its demand for seeking profits despite any consequences.
That has nothing to do with "AI" and still doesn't have anything to do with the original claim of whether or not the new wave of LLMs are capable of creativity.
I am. That's the thing that I'm blaming. The claim I was making was that OpenAI has engaged in violent colonialism inherent to capitalism with the goal of making Elon rich, and the rest of us poor.
Bookmarking isn't the same as boosting, but it's the best I can do. Keep screaming it from the rooftops my dude, dudette, or non binary doodling
Because businesses dont want to pay for labor. They dont care about what quality we get as consumers
For the same reason that CGI has replaced practical effects: It gives more control to the producers and makes it faster to iterate and change stuff. It doesn't even need to be cheaper or look better for that.
I know it's not. That's why it's so sad that people are offloading creative work to it
It utterly baffles me that people keep repeating this nonsense. Have you ever even bothered to try ChatGPT? At all? If you managed to make ChatGPT actually repeat existing text, congratulations, tell me how, since I never have been able to do that in months of using it. ChatGPT has no access and no way to reproduce the texts it was trained, the only thing it can successfully reproduce are shorts quotes or popular phrases ("May the force be with you") that are repeated all through pop culture. Everything beyond that it will give you as vague retelling at best. Or simply put: It literally can't "find" text, since there nothing it can search.
Same for the creativity, you can complain that the stories it writes aren't the most interesting ones or still suffer from lack of coherence when they get too long. But you can't complain that it doesn't get creative. You can throw literally any topic, item, person or whatever at it and it can weave it into a story. You can make it rhyme while doing so or turn it into haiku or talk like a pirate. And you can do so incrementally, ask it to change characters and locations in the story and it will rewrite it. And when you are out of ideas, you can ask it to come up with some.
AI discussion is starting to feel like talking to moon landing deniers, just repeating the same nonsense that has already been debunked a million times.
The difference between what a human mind does in transforming their nature and experiences through artistic expression and what the machine does by referencing values and expressing them in human language without any kind of understanding is very different. You are right that LLMs don't literally copy word for word what they find, and they certainly are sophisticated pieces of technology, but what they are expressing is more processed language or images than an act of artistic creation. Less culinary experience and more industrial sausage. They do not have intelligence and are incapable of producing art of any kind. This isn't to say they aren't a threat to commodified art in the marketplace because they very much are, but in terms of enrichment or even entertainment the machine is not capable of producing anything worthwhile unless the viewer is looking for something they don't have to look at for more than a moment or read with any serious interest of the contents. I'm interested in people using LLMs as a tool in their own artistic pursuits, but they have their own limitations as any tool does.
Give the AI a body with sense inputs, and allow those sense inputs to transform the "decider" value. That's a step in the direction of true creativity
A step closer to approximating the intelligence of a worm, perhaps. I once looked into where the line is on which anamalia were capable of operant conditioning, which I hypothesize may be the first purpose of a brain, and the line on our present taxonomic hierarchy is among worms (jellyfish do not have sufficient faculties for operant conditioning and are on the other side of the line). Sensory input being associated with decider values is still not as sophisticated as learning to be attracted to beneficial things and avoiding dangerous things because the machine does not have needs or desires to base its reactions on which would have to be trained into it by those with intelligence. I'm not saying it's impossible to artificially create a being like this, but in my estimation we are very far from it considering that we barely grasp how any brain works other than to be aware of their extreme complexity. Considering the degree of difference between a worm and a sentient human, we are much further from what we would consider a human level of intelligence.
Edit: Re-reading this it seems much more snippy than I intended and I'm not sure how to frame it to sound more neutral. I meant this as a neutral continuation of a discussion of an idea.
Yes, I use the tools every day and understand how they work. Failing to fully explain the mechanics of LLMs does not materially change the meaning of my original statement.
There's a reason that fan fiction is not regarded as true creative art that should be respected and discussed like other mediums: it;s not trying to do something new and original, the whole point is to re-combine and shuffle things around to sound and feel and look like the original work, just more, but not different in any real enough way to matter.
No true Scotsman
Neither are humans. Everything is a remix.
The only real advantage that humans have in this is that there are 7 billion of us and there is only one of ChatGPT. Everything ChatGPT produces ends up sounding very similar, since all of it is based on the same training data. With humans you get a lot more variety as each of them had their own unique slice of training data.
It is true that LLMs and DPMs do not create, they interpolate -- that's why training data and curation of that data is so critical to begin with. Nevertheless, it is correct to say they are being used for "creative activities" as cheap and (in my opinion) unsustainable substitutes for human minds.
AI is about at creative as Adobe Photoshop is, or a pencil for that matter. A human operating it (no, not txt2img prompting) is where the creativity comes from.