I'd be very surprised if people weren't already scraping Reddit for this.
this post was submitted on 17 Feb 2024
300 points (97.8% liked)
Technology
59582 readers
2699 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
I mean, there's /r/SubSimulatorGPT2 that's been running for years... Although that one was at least hilarious to read because at that stage the AI was in the sweet spot of being simultaneously coherent while making total lapses in logic.
Didn't forget incredibly racist on multiple occasions.
The AI is what was fed into it 😂
That was the real reason for the API changes last year, apps just got caught in the crossfire.
Yeah I thought that was pretty well the established conscientious on the thing. People questioning it confuses me honestly.
it's all but guaranteed. Reminds me of this Computerphile video: https://youtu.be/WO2X3oZEJOA?t=874 TL;DW: there were "glitch tokens" in GPT (and therefore ChatGPT) which undeniably came from Reddit usernames.
Note, there's no proof that these reddit usernames were in the training data (and there's even reasons to assume that they weren't, watch the video for context) but there's no doubt that OpenAI already had scraped reddit data at some point prior to training, probably mixed in with all the rest of their text data. I see no reason to assume they completely removed all reddit text before training. The video suggest reasons and evidence that they removed certain subreddits, not all of reddit.
Can't wait for chatGPT to call me good sir and tell me I win the internet.
The best answer I can find to you question is "deleted by user."
Why is there nothing on reddit about this lol
Mustn't spook the ~~product~~ users
I'd be surprised if there wasn't, I don't think Spez and his cohorts are competent enough to completely suppress all information about it site wide.
FUCK REDDIT! FUCK U/SPEZ! The Red-exit shall endure, VIVA LA LEMMY!!
I bet the fuckers will use "deleted" data, too
Deleted? You mean made unscrapeable. It's exclusive to Reddit licensees.
Yeah, the second anyone posts anything to any service, all their house are belong to the evil corp...
I just blended two references...
what about edited?
When spez took away API access, he basically shit on the social contract that offered a fair exchange of free access for the content we fed into reddit. After the API change, there were new terms: there is no contract. There are no terms. If you use reddit now, you are giving away everything you are to be indexed and mangled by statistics. You exist as free labor to statisticians and machines.
You are more than a few cents of bad memes.
I'm going to make the request in the AM that Lemmy should add robots.txt rules to disallow AI crawlers, to at least indicate we're not interested. We need legislation that tells scrapers what they can access.
We need legislation that tells scrapers what they can access.
What do you hope that would achieve?
Because I can only see this as benefitting Reddit, Facebook, and the like, while screwing over smaller players.
Can someone more savvy explain why they couldn't also scrape what we all say here?
They can and do, but they want the training models to come from highly moderated sources otherwise every AI chatbot would be spewing the most racist parts of 4chan because people would train it that way as a joke.
If you let AI roam freely across the internet, it would only learn porn, sailor moon, dragon Ball z, and nazi germany.
Ah yes, the Microsoft Tay conundrum.
Microsoft Bing AI image generator made some really weird porn before they realized what it was being used for...
Anything can, the difference is reddit holds the exclusive rights to user comments on their site, and they've chosen to sell it.
Dick dick pussy cunt cock dick pussy ass shit cunt shit motherfucker shit motherfucker ass tits cunt cock motherfucker shit ass tits motherfucker shit c'mon. Scrape that🔥
For anyone looking for a gibberish generator to replace their Reddit content with, here's one. This shit is like poison for those large models.
For automatic edition I'm not sure on what people can use nowadays; back then just before the APIcalypse I've used power delete suite, I'm not sure if it still works and I'm not creating a Reddit account just to test it out.
Not that I’m against telling Reddit to fuck off in no uncertain terms, but won’t providing this kind of poisoning to AI training just make it more resilient to exactly this kind of thing?
I don't think so. It's really hard to sort the poison out of the data, unless you actually have enough reading comprehension to know that it's gibberish - humans do, bots don't. And even if they discard 80% of the poison, the 20% there are already screwing with the model.
They could prevent you from editing your posts/comments, but that would cause an uproar.
They say it’s $60 million on an annualized basis. I wonder who’d pay that, given that you can probably scrape it for free.
Maybe it’s the AI act in the EU. That might cause trouble in that regard. The US is seeing a lot of rent-seeker PR, too, of course. That might cause some to hedge their bets.
Maybe some people had not realized that yet, but limiting fair use does not just benefit the traditional media corporations but also the likes of Reddit, Facebook, Apple, etc. Making “robots.txt” legally binding would only benefit the tech companies.
This is the best summary I could come up with:
Reddit will let “an unnamed large AI company” have access to its user-generated content platform in a new licensing deal, according to Bloomberg yesterday.
The deal, “worth about $60 million on an annualized basis,” the outlet writes, could still change as the company’s plans to go public are still in the works.
The news also follows an October story that Reddit had threatened to cut off Google and Bing’s search crawlers if it couldn’t make a training data deal with AI companies.
Last year, it successfully stonewalled its way out of the biggest protest in its history after changes to its third-party API access pricing caused developers of the most popular Reddit apps to shut down.
As Bloomberg writes, Reddit’s year-over-year revenue was up by 20 percent by the end of 2023, but it was still $200 million shy of a $1 billion target it had set two years prior.
The company was reportedly advised to seek a $5 billion valuation when it opens up for public investment, which is expected to happen in March.
The original article contains 346 words, the summary contains 175 words. Saved 49%. I'm a bot and I'm open source!