this post was submitted on 30 Oct 2023
50 points (100.0% liked)

Ask Lemmy

26668 readers
1801 users here now

A Fediverse community for open-ended, thought provoking questions


Rules: (interactive)


1) Be nice and; have funDoxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them


2) All posts must end with a '?'This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?


3) No spamPlease do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.


4) NSFW is okay, within reasonJust remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com. NSFW comments should be restricted to posts tagged [NSFW].


5) This is not a support community.
It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.


Reminder: The terms of service apply here too.

Partnered Communities:

Tech Support

No Stupid Questions

You Should Know

Reddit

Jokes

Ask Ouija


Logo design credit goes to: tubbadu


founded 1 year ago
MODERATORS
 

When a lemmy instance federates, does it connect to one big lemmy network, or can there be multiple disconnected, yet locally federated instances? What I'd like to know is, can I simply join any Lemmy server and choose "All" to view everything Lemmy has to offer, or is there still hidden content?

I understand that some servers are unfederated. I guess I'm curious about the reach of the "All" mode.

top 14 comments
sorted by: hot top controversial new old
[–] ada@lemmy.blahaj.zone 32 points 1 year ago (3 children)

Your instance connects directly to other instances. All of the lemmy instances doing that with each other is the lemmy network.

Each instance can connect with any other instance unless blocked, but will not do so until someone on your instance follows a community on the remote instance.

In short, there is no way to see everything, and there is no one true view

[–] inspxtr@lemmy.world 2 points 1 year ago (2 children)

In short, there is no way to see everything, and there is no one true view

I thought viewing on the browser without logging in may show everything? Is that not true?

[–] new_guy@lemmy.world 5 points 1 year ago (1 children)

It may show everything that the instance itself knows about.

The "true view" they're saying is like if there's an instance that federates with every single other instance but that's highly improbable

[–] ada@lemmy.blahaj.zone 2 points 1 year ago

More impossible than improbable. An instance that willingly federates with every other instance would be blocked in a heart beat by many other instance admins, because if they're fine federating with CSAM, nazis and the like, then they're not going to be welcome.

[–] gamermanh@lemmy.dbzer0.com 1 points 1 year ago

You'll only see what the instance you're viewing has federated with (as well as it's own, obvs)

[–] Valmond@lemmy.mindoki.com 2 points 1 year ago (1 children)

Couldn't you make a script crawl the lemmy-space with API calls and just add all instances to your private instance?

I mean if it can take the hit it would have it all :-)

[–] e0qdk@kbin.social 6 points 1 year ago (1 children)

You could crawl the Fediverse looking for instances and communities of the sort that your instance understands, but new servers and communities can show up whenever, so you'd have to keep looking continuously. Stuff also gets interesting because different servers have different views of content.

I've seen posts from users on two different servers talking in a thread on a 3rd server asking other users to help proxy messages manually between them because one of the servers was defederated from another and the messages were only going one way between the two users... I'm not sure in that case what the communication pattern was between the three servers (never mind me on kbin.social -- which isn't a Lemmy server at all -- also able to see the conversation), but it seemed like a big headache.

I've manually gone to different instances to make sure my posts show up when I make them; kbin is often pretty bad at getting new photo threads to federate out and sometimes needs a bit of coaxing... Looking at my profile on those instances though shows wildly different thread and comment counts sometimes. As of the time of writing this (before posting this comment) I have 30 threads and 85 comments listed in my profile on kbin.social. lemmy.world shows me as having 30 "posts" (threads) and 78 comments. lemmy.mindoki.com (your instance) shows 0 posts and just 10 comments!

There's also users on Mastodon and Misskey which show up for me as part of the regular experience of using kbin but which are a bit more awkward to interact with from Lemmy, I think? If I manually put in a mastodon.social user's account into lemmy.world's user lookup, for example, I can see some of their posts, but I'm not sure if they would ever actually show up anywhere on Lemmy without manually looking for a user?

Nevermind the other parts of the Fediverse like Peertube and AP-enabled Wordpress blogs and whatever else is out there... You can probably get a decent view of most of the Lemmy/kbin-like communities if you have a good list of servers to scrape community lists from and subscribe to everything you find regularly, but I think you'll still have some problems in practice.

[–] Valmond@lemmy.mindoki.com 1 points 1 year ago

True true. I also forgot about the rest of the fediverse ...

[–] lazylion_ca@lemmy.ca 1 points 1 year ago

I think what many find confusing is that there is no master lemmy server to facilitate instances finding each other. I know they use the Activitypub protocol, but I dont know what it does.

I also dont understand how torrent clients find each other.

[–] yardy_sardley@lemmy.ca 6 points 1 year ago* (last edited 1 year ago) (2 children)

The way I think it works is that your local instance hosts its own communities, and then it will reach out to other instances to grab content from every external community that at least one local user has subscribed to. "All" mode is limited to that set of content.

So I think the only way to see the entire set of all content on lemmy would be to meticulously subscribe to every single community on every single instance.

And someone can correct me if I'm wrong, but I think you can still subscribe to subs on defederated instances, it's just the interactions that don't get passed back and forth.

[–] Max_P@lemmy.max-p.me 6 points 1 year ago

and then it will reach out to other instances to grab content from every external community that at least one local user has subscribed to

It's the other way around. The local user subscribes to the community on the remote instance, which causes the remote instance to then push you every action that occurs on that community as it happens. The pull method is only used once and doesn't bring in comments, it's meant as a preview for when a remote community is used for the first time.

And this is why their content won't make it to your instance: it expects the other instance to send it to you, but they're refusing to. Similarly, they won't accept content from your instance, even though it's trying to.

Local and remote communities are pretty similar internally, federation happens as a separate process in a queue system.

This leads to this:

you can still subscribe to subs on defederated instances, it's just the interactions that don't get passed back and forth.

[–] wetferret@lemmy.world 1 points 1 year ago (1 children)

Interesting. Is there a way to see which servers mine is currently federated with?

[–] wetferret@lemmy.world 1 points 1 year ago

Ah, I found the link at the bottom of the main page. I had no idea there were so many instances!

[–] ChaoticNeutralCzech@feddit.de 3 points 1 year ago

Yes, there can be two or more networks that just about completely defederate each other. However, you can host a Lemmy instance and federate with whomever you see fit unless they block you.