this post was submitted on 24 Aug 2024
-258 points (15.1% liked)

Santabot

27 readers
3 users here now

Santabot is an automated moderation tool, designed to reduce moderation load and remove bad actors in a way that is transparent to all and mostly resistant to abuse and evasion.

This is a community devoted to meta discussion for the bot.

founded 4 months ago
MODERATORS
auk
 

Everything's been working smoothly, with nothing to report about the moderation bot. The community has been quiet but productive, which was precisely the goal, and the bot working smoothly with no issues. However, something almost went wrong in a particular entertaining fashion which I thought I would share.

The algorithm for classifying troll users doesn't have any polarity. It only knows which users are opposed to which other users. 50% of the time, it'll get its whole ranking system backwards, so the troll users are the normal ones, and everyone else gets negative rank, because the math works just as well under that ranking regime. Generally this isn't a problem, because there's a step:

        # Flip the sign if we arrived at a majority-negative ranking, which can happen
        if -min_val > max_val:
            rank[1:] *= -1

The most popular user is always more popular than the least popular troll is unpopular, by quite a big margin, so that works fine.

However. Things have changed. MediaBiasFactChecker@lemmy.world is so unpopular that it's almost (1% margin) more unpopular than the highest-rank user is popular. If that had happened, the whole polarity would have flipped, every user would have been banned, all the trolls would have been unbanned. Mass hysteria. I only happened to notice it before it happened and stop the bot. It's on track to be the least popular user on Lemmy, with about 5 times lower rank than some of the most notorious trolls.

Have fun with this information. I started checking the median rank of all users, instead. Thanks MediaBiasFactChecker.

you are viewing a single comment's thread
view the rest of the comments
[–] Five 13 points 2 months ago* (last edited 2 months ago) (2 children)

As an outspoken critic of the MediaBiasFactChecker bot and the place of authority it gives to the deeply flawed site MediaBiasFactCheck.com, I find this hilarious.

MediaBiasFactChecker@lemmy.world is so unpopular that it’s almost (1% margin) more unpopular than the highest-rank user is popular.

Thank you for sharing this statistic! I'm excited that my downvotes may have contributed to this record-breaking achievement.

[–] auk 7 points 2 months ago

Everyone played their part, I'm sure.

And yes, it's funny as hell. That's why I wanted to spread the word!

[–] dharmacurious 4 points 2 months ago (1 children)

Can you give me a brief rundown on why the bot gets so much hate/what's wrong with its rankings/source site? Like, is it straight up wrong, is the problem that we shouldn't be trusting someone else to tell us what is biased/factual/good/bad info? I have no opinion currently, influence me!

[–] Five 3 points 2 months ago* (last edited 2 months ago) (1 children)