this post was submitted on 03 Aug 2023
68 points (94.7% liked)
Lemmy
12546 readers
24 users here now
Everything about Lemmy; bugs, gripes, praises, and advocacy.
For discussion about the lemmy.ml instance, go to !meta@lemmy.ml.
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I wonder how feasible it would be to set your instance up to aggregate content from duplicate communities.
We need something like "Multi-subreddits", where you can combine communities into the same entity. Only issue is that a lot of the same posts are posted a cross all the same communities.
I've been thinking about this all morning and have come up with this:
When the link is the same, we can just union on the thread and sort it as any other thread.
When the link is not the same, but the content is similar, I wonder if you could run a semantic comparison (I'm only just starting to learn about this), and when the comparison scores above a certain threshold, union the threads.
Self-text posts might just make sense to leave alone.