Instance A doesn't know about a community on instance B until somebody on instance A searches for it and (I think) subscribes to it. After that, the entire instance A can see the community on instance B.
So, with small instances and new communities there's a delay until and unless somebody does a search for it and starts interacting. And that means that the 'All' on difference instances, especially smaller instances, is going to be different. As more and more users join various instances and search for communities and interact with communities in the rest of the fediverse these will be more synced.