TechTakes

1425 readers

275 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems

The Google AI isn’t hallucinating about glue in pizza, it’s just over indexing an 11 year old Reddit post by a dude named fucksmith. (lemmy.dbzer0.com)

submitted 6 months ago by db0@lemmy.dbzer0.com to c/techtakes@awful.systems

172 comments fedilink hide all child comments

Source

I see Google's deal with Reddit is going just great...

you are viewing a single comment's thread
view the rest of the comments

[–] Soyweiser@awful.systems 0 points 6 months ago (1 children)

I also wanted to post this post. But it is going to be very funny if it turns out that LLMs are partially very energy inefficient but very data efficient storage systems. Shannon would be pleased for us reaching the theoretical minimum of bits per char of words using AI.

[–] sinedpick@awful.systems 0 points 6 months ago* (last edited 6 months ago) (1 children)

huh, I looked into the LLM for compression thing and I found this survey CW: PDF which on the second page has a figure that says there were over 30k publications on using transformers for compression in 2023. Shannon must be so proud.

edit: never mind it's just publications on transformers, not compression. My brain is leaking through my ears.

[–] jonhendry@iosdev.space 1 points 6 months ago

@sinedpick

I wonder how many of those 30k were LLM-generated.