this post was submitted on 18 Dec 2023
247 points (98.1% liked)

Technology

34413 readers
803 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] thanks_shakey_snake@lemmy.ca 67 points 9 months ago (3 children)

This is going to get soooo much more treacherous as this becomes ubiquitous and harder to detect. Apply the same pattern, but instead of wood carvings, it's an election, or sexual misconduct trial, or war.

Our ability to make sense of things that we don't witness personally is already in bad shape, and it's about to get significantly worse. We aren't even sure how bad it is right now.

[–] otter@lemmy.ca 12 points 9 months ago (3 children)

and the flipside is also a problem

Now legitimate evidence can be dismissed as "AI generated"

[–] merc@sh.itjust.works 7 points 9 months ago (1 children)

Relevant:

Criminals will start wearing extra prosthetic fingers to make surveillance footage look like it's AI generated and thus inadmissible as evidence

https://twitter.com/bristowbailey/status/1625165718340640769?lang=en

[–] otter@lemmy.ca 7 points 9 months ago

Well that's a new one lol, hadn't thought of that. That's another level of planning

[–] thanks_shakey_snake@lemmy.ca 5 points 9 months ago (1 children)

Exactly-- They're two sides of the same coin. Being convinced by something that isn't real is one type of error, but refusing to be convinced by something that is real is just as much of an error.

Some people are going to fall for just about everything. Others are going to be so apprehensive about falling for something that they never believe anything. I'm genuinely not sure which is worse.

[–] Anticorp@lemmy.ml 3 points 9 months ago (1 children)

We already saw that with nothing more than two words. Trump started the "fake news" craze, and now 33% of Americans dismiss anything that contradicts their views as fake news, without giving it any thought or evaluation. If a catch phrase is that powerful, imagine how much more powerful video and photography will be. Even in 2019 there was a deep fake floating around of Biden with a Gene Simmons tongue, licking his lips, and I personally know several people who thought it was real.

[–] thanks_shakey_snake@lemmy.ca 2 points 9 months ago

Great example. Yeah, I've had to educate family members about deepfakes because they didn't even know that they were possible. This was on the back of some statement like "the only way to know for sure is to see video." Uh... Sorry fam, I have some bad news...

[–] DrPop@lemmy.ml 4 points 9 months ago

Analog is the way to go now

load more comments (1 replies)
[–] heygooberman@lemmy.today 20 points 9 months ago (2 children)

This doesn't surprise me, given how messy Facebook has become. What does disturb me is people not being able to recognize that they are AI-generated. Now, this could be due to the AI becoming so sophisticated that it can actually generate life-like images, or it could be due to humanity's inability to question what they're viewing and whether it is true or not. Either way, this is very concerning, and if it can happen on Facebook, I'm sure it's also happening on other social media sites as well.

Speaking of which, how can we stop something like this from happening on Lemmy and other federated sites?

[–] fruitycoder@sh.itjust.works 6 points 9 months ago

This is just the next wave to me. I wish we had better automation around helping people find the sources of an image or detect where it could from. I've showed people reverse image searching a little at least, hopefully we can see it improve to handle new forms of copies like this going forward.

[–] averyminya@beehaw.org 5 points 9 months ago

It really depends on the image. Some AI generated images of people really seem indistinguishable from a photograph. Not all, but it's definitely going to become more common. At this point it seems like every month has a new breakthrough for some aspect AI regarding consistency and realism. As people work to bring stable diffusion video to a more reliable state the images themselves are only going to get better.

There's a number of models out there right now that don't have hand issues as much. There are other methods like using a pose to force hide the hands. We're getting to the point where we just need metadata viewers on every image because the eye alone isn't reliable for this. How many artists have already been accused of being "AI art like" and they were not.

Stopping it? I don't know if you can stop Pandora's box. Personally, I'm of the opinion that flooding AI images is the only way to "stop" it, simply by making people not care about it. At a certain point, you can only make so many variations of gollum as a playing card /ninja turtle/movie star before they get boring to the public. I also have doubts that the people using this are overall the type of people who would have paid artists for commissions, or that that would even stop a sale from happening in the first place (my partner makes mushroom forest scenes with Stable Diffusion but she also buys about $300 of art from our friends and local artists through the year). Like, Stable Diffusion doesn't make oil paintings.

Little Jimmy in his room or the 60 hour week worker? They pose no harm making these images and it makes them happy, so why take that away from them? And regarding the nefarious aspect of it - that one is much harder but it's in part societal shame as well. Explicit images made by AI may make the process easier, but if it's something nefarious the people will find a way to do it regardless. Video sex scams and catfish were around long before AI. I'm not certain that these will inherently become more prevalent as the tech becomes more accessible. It's the people posting them. Which to me comes down to more of a societal issue than a technological one.

However, in terms of trying to stop it maybe there could be a hash similar to the CASM that gets used here. Maybe the image uploader can look for metadata markers that come with generated images and deny those ones? That's an easy workaround though, since metadata can be stripped.

I dunno. I think we've gotta EEE AI. Embrace AI images by flooding society with their presence, Extend AI images by getting the ability to use it into the hands of everyone, and then Extinguish the power that generated images hold over people because fake pictures don't matter in the slightest.

[–] Daft_ish@lemmy.world 13 points 9 months ago* (last edited 9 months ago)

No worries. I log on Facebook and all I see are videos catered to me based on shit I got sucked into last time I reluctantly went on Facebook.

Remember when Facebook was good? Yeah, me either

[–] Lath@kbin.social 13 points 9 months ago (3 children)

Wonder how many of the posts here are ai generated. Are we even talking to real people anymore or are we in our own ai generated bubbles engaging in simulated discourse?
Am I real or am I just an ai generated simulacrum?
Wonder.

[–] averyminya@beehaw.org 3 points 9 months ago

I think the chances for the fediverse having this are generally lower. I saw a rough estimate that puts our bubble at 1.5 million. By comparison, reddit is 500 million and YouTube is 2.5bn.

Yes, we are a bunch of nerds in that 1.5m number but we also value human input and generally seem to only use practical bots - and some people don't even like those. We also have the bot account option, which should inspire more trust, though we have to trust that people actually use it.

Compared to reddit or YouTube, which I've personally seen as testing grounds for rolling out bot accounts. Whole subs dedicated to it. It's not that it doesn't, can't, or won't happen here, I know we have a number of repost bots from various instances - I'm moreso just saying that I think being so small helps. When the dead Internet arrives, the fediverse will have been one of the last bastions of human interaction on the Internet.

Except for mastodon. I see a lot of bots there compared to lemmy/Kbin

load more comments (2 replies)
[–] FMT99@lemmy.world 12 points 9 months ago (1 children)

I mean take the average media literacy of the relatively younger folks on Reddit (atrocious) and then realize that those are incredibly tech savvy compared to FB's audience.

[–] jol@discuss.tchncs.de 5 points 9 months ago (1 children)

I would be surprised if this sort of thing isn't already happening in reddit too.

Several AI posts have made the rounds on Reddit, but now that Reddit is 90% bots reposting and upvoting content by other bots, I don't think anyone cares much.

I'm reasonably sure half the stories on subreddits like r/amitheasshole are written by ChatGPT at this point. Doesn't matter, or course; drama is drama, whether it's drama from a stranger on the other side of the world or generated by a machine.

[–] chicken@lemmy.dbzer0.com 12 points 9 months ago (3 children)

Especially egregious because the images are basically the same as the original photos, they just used controlnet to alter the details. It shouldn't be that difficult to stop this kind of thing, assuming Facebook even wanted to; looks like it is entirely possible to find the original popular post the AI posts are trying to copy to prove this is going on, and people are already doing the volunteer work of tracking it all, there would just need to be a way to report this stuff and confirm it. I doubt Facebook wants to do this though since engagement is engagement.

load more comments (3 replies)
[–] scottmeme@sh.itjust.works 11 points 9 months ago (1 children)
[–] pigup@lemmy.world 3 points 9 months ago

Real fake books are far cooler than Facebook

[–] HenchmanNumber3@lemm.ee 9 points 9 months ago (2 children)

This is less of an issue if you judge everything that isn't first hand from a known friend or family member as suspect or at least just a waste of time. Facebook used to be a place to talk to people you knew in the real world. You could ignore anything they reposted and still engage with the actual examples of their own experiences that they posted. But now it's so flooded with ads and listicles and clickbait and video clips that it's not even worth trying to keep up with the people you actually know.

load more comments (2 replies)
[–] Grimy@lemmy.world 8 points 9 months ago (39 children)

AI generated content isn't stealing. That being said, Facebook is literally only reposts, there is practically zero original content. The AI generated stuff is amongst the few things that isn't technically stolen.

[–] cygnus@lemmy.ca 20 points 9 months ago (1 children)

AI generated content isn’t stealing.

You might want to read the article.

load more comments (1 replies)
[–] 520@kbin.social 12 points 9 months ago* (last edited 9 months ago) (5 children)

I dunno dude, taking an image-to-image generation with 90% strength to just change a few details to make it look like your work sure sounds like stealing to me

load more comments (5 replies)
load more comments (37 replies)
[–] Stalinwolf@lemmy.ca 6 points 9 months ago

I have a few relatives who seem incapable of understanding that miraculously high-definition photos from the 1800s containing never-before-seen imagery of lumberjacks posing with 12ft. tall sasquatches could possibly be inauthentic. .

[–] pelespirit@sh.itjust.works 2 points 9 months ago* (last edited 9 months ago)

I'm doing a fun art project now, I'm feeling like from the conversations I've been having in this thread about AI, that I'm totally okay with selling these logos as is. I put in inspiration prompts and "in the style of" so I'm sure I'm good.

https://imgur.com/a/Rhgi0OC

load more comments
view more: next ›