Technology

60085 readers

2827 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago

MODERATORS

932

Baidu CEO warns AI is just an inevitable bubble — 99% of AI companies are at risk of failing when the bubble bursts (www.tomshardware.com)

submitted 2 months ago by misk@sopuli.xyz to c/technology@lemmy.world

196 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] datelmd5sum@lemmy.world 10 points 2 months ago (3 children)

We're hitting logarithmic scaling with the model trainings. GPT-5 is going to cost 10x more than GPT-4 to train, but are people going to pay $200 / month for the gpt-5 subscription?

[–] madis@lemm.ee 4 points 2 months ago (1 children)

But it would use less energy afterwards? At least that was claimed with the 4o model for example.

[–] fuck_u_spez_in_particular@lemmy.world 3 points 2 months ago (1 children)

4o is also not really much better than 4, they likely just optimized it among others by reducing the model size. IME the "intelligence" has somewhat degraded over time. Also bigger Model (which in tha past was the deciding factor for better intelligence) needs more energy, and GPT5 will likely be much bigger than 4 unless they somehow make a breakthrough with the training/optimization of the model...

[–] hglman@lemmy.ml 2 points 2 months ago

4o is optimization of the model evaluation phase. The loss of intelligence is due to the addition of more and more safeguards and constraints by the use of adjunct models doing fine turning, or just rules that limit whole classes of responses.

[–] Skates@feddit.nl 4 points 2 months ago

Is it necessary to pay more, or is it enough to just pay for more time? If the product is good, it will be used.

[–] GeneralInterest@lemmy.world -2 points 2 months ago

Businesses might pay big money for LLMs to do specific tasks. And if chip makers invest more in NPUs then maybe LLMs will become cheaper to train. But I am just speculating because I don't have any special knowledge of this area whatsoever.