Tgs91

joined 1 year ago
[–] Tgs91@lemmy.world 24 points 1 year ago

I work on AI research. I've been trying to explain it to people as an improv actor that takes suggestions from the audience. It just plays along with the prompt you give it. It's not an expert, it's just an actor playing a role.

[–] Tgs91@lemmy.world 4 points 1 year ago (1 children)

Shouldn't they be able to code them out?

You can't "code them out" because AI isn't using a simple script like traditional software. They are giant nested statistical models that learn from data. It learns to read the data it was trained on. It learns to understand images that it was trained on, and how they relate to text. You can't tell it "in this situation, don't consider race" because the situation itself is not coded anywhere. It's just learned behaviors from the training data.

Shouldn't they be able to lessen them?

For this one the answer is YES. And they DO lessen them as much as they can. But they're training on data scraped from many sources. You can try to curate the data to remove racism/sexism, but there's no easy way to remove bias from data that is so open ended. There is no way to do this in an automated way besides using an AI model, and for that, you need to already have a model that understands race/gender/etc bias, which doesn't really exist. You can have humans go through the data to try to remove bias, but that introduces a ton of problems as well. Many humans would disagree on what is biased. And human labelers also have a shockingly high error rate. People are flat out bad at repetitive tasks.

And even that only covers data that actively contains bigotry. In most of these generative AI cases, the real issue is just a lack of data or imbalanced data from the internet. For this specific article, the user asked to make a photo look professional. Training data where photos were clearly a professional setting probably came from sites like LinkedIn, which had a disproportionate number of white users. These models also have a better understanding of English than other languages because there is so much more training data available in English. So asian professional sites may exist in the training data, but the model didn't understand the language as well, so it's not as confident about professional images of Asians.

So you can address this by curating the training data. But this is just ONE of THOUSANDS and THOUSANDS of biases, and it's not possible to control all of them in the data. Often if you try to correct one bias, it accidentally causes the model to perform even worse on other biases.

They do their best. But ultimately these are statistical models that reflect the existing data on the internet. As long as the internet contains bias, so will AI

[–] Tgs91@lemmy.world 1 points 1 year ago

I've been on Lemmy and off Reddit since RIF died. Hope it grows, but so far it doesn't replace the reason I used reddit. The frontpage/hot posts are similar and even better than Reddit. But I never cared about those on Reddit anyway, they were mostly junk content that I didn't care about. Reddit was great because you could find a highly active niche community for ANYTHING. Find a new show you like? There's a subreddit with deep discussions of every episode, and fan theories about hidden details. Are you a scientist with a specific field who wants to stay up to date on new research in your field? Well the subreddit for your field is filled with other scientists discussing newly published research.

If course I don't expect Lemmy to be able to do that immediately. That requires a huge userbase and years of time building these small communities. Hope Lemmy can do it, pissed that Reddit already did it and now is trying to ruin it

[–] Tgs91@lemmy.world 1 points 1 year ago (1 children)

Been seeing a lot of memes from c/ADHD on my feed and starting to think I might be undiagnosed ADHD. They all hit close to home