this post was submitted on 11 Sep 2024
121 points (96.9% liked)

Ask Lemmy

26270 readers
1435 users here now

A Fediverse community for open-ended, thought provoking questions


Rules: (interactive)


1) Be nice and; have funDoxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them


2) All posts must end with a '?'This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?


3) No spamPlease do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.


4) NSFW is okay, within reasonJust remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com. NSFW comments should be restricted to posts tagged [NSFW].


5) This is not a support community.
It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.


Reminder: The terms of service apply here too.

Partnered Communities:

Tech Support

No Stupid Questions

You Should Know

Reddit

Jokes

Ask Ouija


Logo design credit goes to: tubbadu


founded 1 year ago
MODERATORS
 

Quite frequently I come across scanned books that are viewable for free online. For example, the publisher put them there (such as preview chapters), a library (old books from their collection that are in public domain), etc. Since I like hoarding data, and the online viewers that are used to present the book to me might not be very practical, I frequently try to download the books one way or another. This requires toying with the "inspect element" tool and various other methods of getting the images/PDF. Now, all that I access is what is, well, accessible; I don't hack into the servers or something. But - the stuff is meant to be hidden from the normal user. Does that act of hiding the material, no matter how primitive and easily circumvented, mean that I'm not allowed to access it at all?

I suppose ripping a public domain book is no big deal, but would books under copyright fare differently?

Mainly I'm asking out of curiosity, I don't expect the police to come visit me for ripping a 16th century dictionary.

Note: I live in EU, but I'd be curious to hear how this is treated elsewhere too.

Edit: I also remembered a funny trick I noticed on one site - it allows viewing PDFs on their website, but not downloading, unless you pay for the PDF. But when you load the page, even without paying, the PDF is already downloaded onto your computer and can be found in the browser cache. Is it legal to simply save the file that is already on your computer?

top 50 comments
sorted by: hot top controversial new old
[–] stoly@lemmy.world 3 points 4 days ago

They aren’t going after the hoarders, they are going after the sharers.

[–] ulterno@lemmy.kde.social 26 points 6 days ago* (last edited 6 days ago)

viewable for free online

If you are viewing it on your computer, you have already downloaded it.
Don't let anyone tell you otherwise.

already downloaded onto your computer and can be found in the browser cache

Exactly.

[–] Excrubulent 13 points 6 days ago* (last edited 6 days ago) (1 children)

I'd say if the copyright holder says you're not allowed to then you're not. It's piracy.

People will tell you that you've already downloaded the data so saving it is fundamentally, technically no different, but that doesn't matter to the law, it's still piracy.

Like yeah, it's absurd and pointless and anti-consumer and anti-knowledge and unenforceable and unsustainable, but that's copyright. It's always been that way.

Copyright destroys culture and piracy is our ethical duty in the face of that. The only reason to care about it is so you don't get caught.

[–] Zoot@reddthat.com 1 points 5 days ago (1 children)

What about AI? Don't they basically do exactly this.

[–] Excrubulent 1 points 4 days ago

Sure, and I'd say that's piracy too. I wouldn't mind if it wasn't also being siloed into private hands to enrich the wealthy and screw the rest of us.

[–] Etterra@lemmy.world 6 points 6 days ago (2 children)

It might be illegal to post it without permission, but you can download it all you damn well please and they can't stop you. Unless it's like government top secret something or other. In that case you probably don't want it anywhere near your computer and should probably tell somebody where you found it.

[–] arefx@lemmy.ml 7 points 6 days ago (1 children)

Warthunder discord server lol

[–] steeznson@lemmy.world 2 points 6 days ago

Astonishing listening to the news coverage of that story where the anchors were reading some terminally online nonsense from the teleprompter about Discord "Thug Shakers"

[–] ulterno@lemmy.kde.social 7 points 6 days ago

should probably tell somebody where you found it

Somebody, as in your lawyer. Who can then inform the correct authorities, while making sure you don't become their scapegoat.

[–] AlphaOmega@lemmy.world 7 points 6 days ago

Everything on the Internet can be downloaded, copied etc

[–] clark@midwest.social 5 points 6 days ago (2 children)

Mind posting a guide on how you tinker with those inspect element tools?

[–] antonim@lemmy.dbzer0.com 2 points 8 hours ago

(Sorry for the late response.) Well it depends a lot on the site. Since I focus on books and scholarly articles, the ideal way is to find the URL of the original PDF. The website might show you just individual pages as images, but it might hide the link to the PDF somewhere in the code. Alternatively, you might just obtain all the URLs of the individual page images, put them all into a download manager, and later bundle them all into a new PDF. (When you open the "inspect element" window, you just have to figure out which part of the code is meant to display the pages/images to you.) Sometimes the PDFs and page images can be found in your browser cache, as I mention in the OP. There's quite some variety among the different sites, but with even the most rudimentary knowledge of web design you should be able to figure out most of them.

If need help with ripping something in particular, DM me and I'll give it a try.

[–] Excrubulent 3 points 6 days ago* (last edited 5 days ago) (1 children)

Right click -> inspect element (Q) works.

You can also press F12.

And if right click is blocked, on Firefox holding SHIFT will unblock right click. There is also a plugin that does this for you.

Often websites will put an invisible element in front of the content to intercept this trick, but you can navigate through the elements to find the one they were trying to obfuscate.

[–] Buddahriffic@lemmy.world 2 points 6 days ago

Also you can just block elements you right click on in Firefox (though this might be an option added by an add-on). If there's hidden elements you just need to go through each of those until you can click on the one you want directly (and you can tell by what is highlighted in the inspect element mode).

You can also hit delete in inspect element mode to remove that element. You can also edit whatever you want in the element. Makes me wish it existed back when I was doing more web dev work, would have made things a lot easier when debugging.

[–] orcrist@lemm.ee 2 points 6 days ago

If something is in the public domain, there is no copyright covering it, so you should make as many copies as you feel like. Many public domain books are posted on the Internet Archive, where you can easily download them in various formats. Then you won't have to work hard to get the data. Public domain artwork, likewise, is often available on Wikimedia Commons.

[–] simple@lemm.ee 55 points 1 week ago (2 children)

AFAIK web scraping (the act of grabbing and downloading any data you see available on the internet) isn't illegal, and I would assume downloading PDFs provided to you online would fall under that. Since it is copyrighted it would probably be illegal to share it, though.

[–] Mango@lemmy.world 1 points 6 days ago (1 children)

What if I web scraped something like a pirate site full of all the good media?

[–] papalonian@lemmy.world 1 points 6 days ago (1 children)

If you scraped a pirate site and stored a bunch of links to copyrighted content you'd probably be fine, actually using those links to download or share copyrighted content is what's illegal. It'd be like buying the stuff to make a bomb or drugs, but then not making any bombs or drugs.

That being said, while not necessarily illegal, I wouldn't want authorities to find my bomb and drug ingredients, or my scraped piracy links, as I'd probably have some 'splainin to do.

(Not a lawyer)

[–] Mango@lemmy.world 1 points 6 days ago (1 children)

Why can I scrape the content from one place and not another?

[–] papalonian@lemmy.world 1 points 6 days ago (1 children)

Who said that you can't scrape content from the other place?

If you scraped a pirate site and stored a bunch of links to copyrighted content you'd probably be fine,

If you're referring to the last line, I say I wouldn't want authorities to find it because I don't want to have to explain it. I'm 99% sure someone would not just store links to a bunch of pirated content for fun, they probably have accessed said pirated content, now you have to explain to the authorities why you have links to pirated content without implicating yourself in copyright infringement.

Like I said, probably fine, I just wouldn't want the hassle if I somehow got caught.

[–] Mango@lemmy.world 1 points 6 days ago (1 children)
[–] papalonian@lemmy.world 1 points 6 days ago

Sorry man, I'm not exactly sure what you're asking.

If you are able to load the content on your computer without infringing copyright laws, you're allowed to circumvent whatever the website has in place to store whatever data you would like from whatever website you would like, regardless of the nature of the site, so long as the content is legal (is not CP) and again not being presented in a way that infringes aforementioned copyright laws.

If you're asking why the copyright laws exist, I can't really help you with that one.

[–] nvermind@lemm.ee 24 points 1 week ago* (last edited 1 week ago)

This. In a case around LinkedIn courts ruled that in the US it’s legal to scrape publicly available data. The company doing the scraping was selling that data to corporate customers, but ultimately use might depend on the information you’re accessing and under what permissions. (Not a lawyer)

[–] Vipsu@lemmy.world 53 points 1 week ago (2 children)

According to the big tech its ok if you're training large language model with it.

[–] Anticorp@lemmy.world 9 points 6 days ago (1 children)

My brain is essentially an enormous language model.

[–] SlothMama@lemmy.world 4 points 6 days ago

Unironically yes, you would not know who Spiderman was without viewing a copyrighted work demonstrating what he looks like, and now you understand while generative AI fundamentally has to ingest copyrighted works.

[–] lugal@lemmy.world 14 points 1 week ago (1 children)

You're confusing the law that applies for the ruling class with the one that applies to common people

[–] Mango@lemmy.world 2 points 6 days ago

There's a law for the ruling class? I always figured they gotta just cut their political buddies in.

[–] Windex007@lemmy.world 43 points 1 week ago

If you can see it, you've already downloaded it. You're just chosing to retain it.

[–] slazer2au@lemmy.world 39 points 1 week ago (1 children)

As with everything with the law, it depends.

In Australia, distribution is the illegal part, seeding/sharing is where they get you. Not the actual download itself.

[–] leisesprecher@feddit.org 6 points 1 week ago (1 children)

It's usually not a question of legality, but efficiency.

It's easy and efficient to bust someone for seeding, but busting hundreds for the odd file you can prove they downloaded is expensive and takes forever.

load more comments (1 replies)
[–] aaaaace@lemmy.blahaj.zone 25 points 1 week ago (1 children)

Ask the AI companies who scraped my sites while the media companies were DCMA-ing everything in sight and working with enforcement paid for with publuc funds to prosecute/persecute the "pirates".

[–] Anticorp@lemmy.world 5 points 6 days ago* (last edited 6 days ago)

It's ridiculous that Homeland Security is spending resources taking down pirate sites. That's a department specifically created to prevent terrorism, and instead they're operating as Pinkertons for broadcasting companies.

[–] Tracked@sopuli.xyz 25 points 1 week ago (4 children)

You wouldn't download a car...

[–] Steamymoomilk@sh.itjust.works 8 points 1 week ago

1000016919

Nooo never...

load more comments (3 replies)
[–] n3m37h@sh.itjust.works 13 points 1 week ago (1 children)

The laws are bullshit and shouldn't be followed. Information should be free to all

[–] antonim@lemmy.dbzer0.com 15 points 1 week ago

I never said I follow the law, I'm just wondering what the law says ;)

[–] The_v@lemmy.world 13 points 1 week ago

Not an expert, but in the U.S. making a copy of a broadcast for personal use is legal under fair-use. Anything that loads up on your computer screen you can make a copy and save it for personal use. So screen captures are by definition legal.

How exactly you copy the material on your screen gets tricky under the DMCA clusterfuck. Breaking encryption to copy the material is illegal unless there is an valid exception for fair-use. What exactly those valid exceptions are is above my paygrade.

[–] DarkThoughts@fedia.io 12 points 1 week ago (1 children)

Laws of course differ from country to country but generally if it is legally publicly available then no, it at best violates their EULA or something if you scrap such data. A company trying to prevent direct downloads cannot really charge you for you finding ways around that, because from a technical point of view the data was already cached onto your PC anyway.

As a tip, use the browsers F12 console's Network tab, instead of inspect element. For videos you may also try the absolute right click addon. It breaks the video player controls when enabled but often you can just right click save video if it isn't timed out and you can also enable regular controls via right click show controls. Tools like JDownloader2 can also often scrap various files but the former methods may work better.

[–] Buddahriffic@lemmy.world 1 points 6 days ago (1 children)

There's also the video download helper add-on for Firefox that will allow you to download streams that aren't just media files your browser can http get. Though your browser can still access those streams, it needs a script component to handle it, so the built in file downloader/saver won't even see it as a thing to download.

[–] DarkThoughts@fedia.io 1 points 6 days ago (1 children)

That one is scummy as hell.

[–] Buddahriffic@lemmy.world 1 points 6 days ago (1 children)
[–] DarkThoughts@fedia.io 1 points 6 days ago (1 children)

Just check the reviews, or the permissions.

[–] Buddahriffic@lemmy.world 1 points 6 days ago

Reviews say it's adding a giant QR code to downloaded videos to get people to pay a license fee but I do not see that after downloading something just now. Though tbf, they did update it yesterday and might have removed that because of the feedback they were getting.

Permissions look reasonable to me, based on my understanding of what they need to do for the functionality, though I suppose there is potential for abuse.

It requires a companion desktop program for some streams, which did seem sketchy at first but I wasn't able to find any specific claims of it doing anything undesired, just people who noped out when they saw it wanted them to install something and others who said it does function as desired. Again, hard to say if it does anything in addition to enabling some streams to be downloaded, but I haven't noticed anything out of place on my PC since installing it either from tool-based scans or manual checks of places where malware can put itself to survive restarts.

There were also claims that it didn't work with YouTube in the reviews, but that doesn't seem to be the case for me, since it does light up. Though maybe that was timing-based, too, where Google briefly managed to block it only for them to adjust.

So I haven't seen any of those issues but YMMV. I'm going to keep using it but will also keep an eye on it. Either way, thanks for letting me know.

[–] HootinNHollerin@lemmy.world 6 points 1 week ago

You care more than all of the ‘AI’ companies combined

load more comments
view more: next ›