this post was submitted on 14 Jan 2024

202 points (94.7% liked)

Technology

59454 readers

3776 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

202

TikTok Shop sellers say its AI moderation has gone rogue, doling out 'bogus' violations and freezing products without a clear explanation (www.businessinsider.com)

submitted 10 months ago* (last edited 10 months ago) by throws_lemy@lemmy.nz to c/technology@lemmy.world

21 comments fedilink hide all child comments

all 22 comments

sorted by: hot top controversial new old

[–] vexikron@lemmy.zip 44 points 10 months ago (1 children)

Lol, perhaps even: lmao.

Huge tech corps fucking up in the most predictable yet also insane ways possible never ceases to bring a smile to my face.

[+] FaceDeer@kbin.social -13 points 10 months ago (2 children)

We hear about the instances where they screw up, but we don't hear about the ones where it's working just fine in the background.

[–] otter@lemmy.ca 10 points 10 months ago

They're supposed to work fine in the background

The point was about the many recent stories of companies rushing to use "AI" and the chaos it caused

[–] vexikron@lemmy.zip 6 points 10 months ago* (last edited 10 months ago) (1 children)

The whole point of having a large, comprehensive database is that it be robust, efficient, amd reliable.

When you introduce an immature, very hyped, untested at scale, other system or software to manage and curate said database, a system that is known to fail at edge cases, and you know your database features a lot of edge cases...

... the results are fairly predictable.

Large Corporate higher up types /consistently/ overlook the valid concerns that are later proven to be correct, which are raised by people in their companies that actually understand the technology their company uses.

This happens time and time again in large corporations where it has become very clear that ego and the potential reward of more profit, outweigh the expertise of the actual people in the company familiar with the technology the company uses, and causes massive, costly debacles.

This happens because, at this point, its clear that a large number of tech ceos and management do not actually know tech or the tech industry, and still operate with the reckless abandon from the 'move fast and break things' kind of mentality that /might/ work in a start up, but do not work at all with a larger, more established and mature business, and also more generally this happens in other industries because management doesnt really understand modern technology at anything beyond a surface level.

As a person who has actually worked on different databases and more generally different roles in different parts of the tech industry, and in software related roles in other industries, for around a decade, I have seen things like this happen basically multiple times at every job I have had, though not to this scale.

In summary: I am one of the people whonis responsible for things working smoothly and you not hearing about them, and I am telling you there are many other people like me and most of them will agree that these fuck ups you do hear about happen because people paid 10 to 100 times as much as us do not listen to us.

[–] FaceDeer@kbin.social -1 points 10 months ago

Sure. But my point is, we don't know how many companies are using AI where everything's working fine. We're only seeing some of the failures, we're not seeing the successes. So we can't draw general conclusions from these specific examples.

[–] thorbot@lemmy.world 22 points 10 months ago

Oh no!

Anyway…

[–] yuki2501@lemmy.world 12 points 10 months ago

There's few things that can inspire as much fear in the population as the phrase "gone rogue" applied to AI.

Example. (HZD spoilers)

[–] Fisk400@feddit.nu 9 points 10 months ago (2 children)

Humans go rouge, programs are broken. Stop using humanizing terms for algoritms.

[–] tabular@lemmy.world 13 points 10 months ago (1 children)

"Gone rogue" just means to behave in an unexpected way - a very common occurrence when I write software.

[–] Fisk400@feddit.nu -1 points 10 months ago (2 children)

You should stop using humanizing terms for algorithms.

[–] tabular@lemmy.world 4 points 10 months ago (1 children)

To convince me of that you may want to explain how it's a humanizing term, for starters.

[–] Fisk400@feddit.nu 0 points 10 months ago (2 children)

Rogue is a type of person and going rogue has the same etymology. We have lots off expressions that ascribes living qualities to inert things and that is fine. It is a very human thing to do. But in the field of AI we need to be very firm in what AI is.

[–] uriel238@lemmy.blahaj.zone 3 points 10 months ago

Rogue is a type of person, like a rogue planet or a rogue comet.

[–] tabular@lemmy.world 1 points 10 months ago

Okay, I grant that the term "rogue" is commonly used with a human aspect to it. Are you suggesting that by using a word about humans to describe the non-human algorithms that may make people misunderstand what is the AI we're talking about?

[–] LWD@lemm.ee 1 points 10 months ago* (last edited 10 months ago)

deleted

[–] AnUnusualRelic@lemmy.world 3 points 10 months ago (1 children)

Humans only go rouge when exposed to too much sun.

[–] uriel238@lemmy.blahaj.zone 1 points 10 months ago

...or join the circus.

[–] MonkderZweite@feddit.ch 9 points 10 months ago (1 children)

Tiktok sells stuff now?

[–] Corkyskog@sh.itjust.works 13 points 10 months ago

Yeah, it's like direct to consumer ads with shop links attached. It's pretty popular, prices are okay, but it's a lot of weird shit and gimmicks, you don't actually need. There are also live feeds that sell like Pokémon cards or fresh water clams, but that's a different story.

[–] Krauerking@lemy.lol 6 points 10 months ago

Ok but like this is barely a thing and it comes from people literally selling drugs and other illegal goods through this completely unregulated market.

And literally just to get the US regulators off their back they just dumped the still processing transactions and handed the money over to the US, as a not so subtle "please don't sue us"

All the early money was made and everyone got their piece of the pie even if it now screws over regular-ish people. Tiktok is risky business even if it made a lot of money.

[–] autotldr@lemmings.world 2 points 10 months ago

This is the best summary I could come up with:

He started making money on the app by offering fishing baits through TikTok Shop, selling around 92 strawberry- and sweet-corn-flavored "little bitz," for instance.

TikTok, in recent months, has been sending a flurry of violation claims to sellers that use its e-commerce platform, stating that they've set "spam prices" on products, inadequately displayed items during livestreams, assigned inaccurate product-listing titles, or incorrectly categorized their goods.

Some sellers have managed to slip prohibited goods like homemade foods, sex toys, and THC syrups past its moderation system, while other merchants have added knock-off products mimicking items from mainstream brands like Lululemon.

"We had an LDR (late dispatch rate) penalty put on our account right as we were hitting our peak in sales," said Jessica Slone, founder of Bad Addiction Boutique, a merchant that has sold tens of thousands of sweatshirts on TikTok.

Amazon uses bots to flag potential violations of its policies, which can lead to sellers' accounts being deactivated, sometimes taking business owners by surprise.

For small-business owners on TikTok, having to take time to repeatedly appeal Shop violations is a strain alongside the day-to-day work of fulfilling orders.

The original article contains 1,107 words, the summary contains 188 words. Saved 83%. I'm a bot and I'm open source!