this post was submitted on 19 Oct 2023
535 points (96.5% liked)

Technology

59197 readers
2668 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Black Mirror creator unafraid of AI because it’s “boring”::Charlie Brooker doesn’t think AI is taking his job any time soon because it only produces trash

you are viewing a single comment's thread
view the rest of the comments
[–] lloram239@feddit.de 1 points 1 year ago

(it’s not, il the underlying tech is much older than that).

ChatGPT was released Nov 2022. Plain GPT1/2/3 neither had the chat interface nor the level of training data and fine tuning that ChatGPT/GPT-3.5 had and in turn were much less capable. They literally couldn't function in the way ChatGPT does. Even the original Google paper this is all based on only goes back to 2017.

LLMs are physically incapable

Yeah, LLM won't ever improve, because technology improving has never happened before in history... The stupid in your argument hurts.

Beside GPT-4 can already handle 32768 tokens, that's enough for your average movie, even without any special tricks (of which there are plenty).