this post was submitted on 30 Oct 2024
336 points (98.0% liked)

Privacy

32003 readers
1020 users here now

A place to discuss privacy and freedom in the digital world.

Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.

In this community everyone is welcome to post links and discuss topics related to privacy.

Some Rules

Related communities

Chat rooms

much thanks to @gary_host_laptop for the logo design :)

founded 5 years ago
MODERATORS
 

actually awesome and fast search engine (depending on which instance you use) with no trashy AI and ADs results also great for privacy, if you don't know which instance to use go to https://searx.space/ and choose an instance closest to you

you are viewing a single comment's thread
view the rest of the comments
[–] Mojeek@lemmy.ml 3 points 2 weeks ago (1 children)

our preference is always to find out why the block is happening and try to convince people it should be otherwise; widespread abuse of robots.txt does no-one any good, having been crawling and indexing for so long it's a standard that we understand and are quite fond of

we can see some of the perils and pitfalls of it too, but web builders need to be given some tools and assurances that those tools will work for them

[–] notfromhere@lemmy.ml 1 points 2 weeks ago (1 children)

That makes sense. One thing I’ve noticed with Mojeek search results compared to Google is that I do not encounter the “old web” any more on Mojeek than on Google. Are you not crawling/indexing web 1.0 blogs and sites at all?

[–] Mojeek@lemmy.ml 2 points 2 weeks ago

probably a sample size issue, we crawl and index everything we are able to; have seen many of this kind of site in the past, and finding them is something that other people have said they enjoy about mojeek