this post was submitted on 26 Jun 2023
38 points (97.5% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

54424 readers
436 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others

Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):

💰 Please help cover server costs.

Ko-Fi Liberapay
Ko-fi Liberapay

founded 1 year ago
MODERATORS
db0@lemmy.dbzer0.com
sunbrothersco@lemmy.dbzer0.com
dataprolet@lemmy.dbzer0.com
Flatworm7591@lemmy.dbzer0.com
RandomLegend@lemmy.dbzer0.com
38
Reddit comments/submissions 2005-06 to 2022-12 (btdig.com)
submitted 1 year ago* (last edited 1 year ago) by InternetPirate@lemmy.fmhy.ml to c/piracy@lemmy.dbzer0.com
5 comments fedilink hide all child comments
 

It would be helpful if there were an instance that migrated all of this to Lemmy so that we could access it from any other instance, instead of having to download it for local browsing.

This was data from pushshift before Reddit nuked it in March. You can find this torrent (called "Reddit comments/submissions 2005-06 to 2022-12") and others, including 2023-01 and 2023-02, on https://academictorrents.com by user Watchful1.

JSON compressed with zstd. You can also grab individual subreddits at https://the-eye.eu/redarcs/

you are viewing a single comment's thread
view the rest of the comments
[–] heartlessevil@lemmy.one 6 points 1 year ago (2 children)

What's the context and background here? It would be nice to know what's in some of these 4GB compressed files before downloading them.

[–] InternetPirate@lemmy.fmhy.ml 7 points 1 year ago

It has json files with every written post on Reddit.

[–] jacaw@lemmy.ml 1 points 1 year ago (1 children)

Agreed, what’s in these? Raw text? Image metadata?

[–] theUnlikely@sopuli.xyz 2 points 1 year ago

Nothin' but JSON compressed with zstd. You can also grab individual subreddits at https://the-eye.eu/redarcs/