this post was submitted on 19 Oct 2023
535 points (96.5% liked)
Technology
59197 readers
2668 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
ChatGPT was released Nov 2022. Plain GPT1/2/3 neither had the chat interface nor the level of training data and fine tuning that ChatGPT/GPT-3.5 had and in turn were much less capable. They literally couldn't function in the way ChatGPT does. Even the original Google paper this is all based on only goes back to 2017.
Yeah, LLM won't ever improve, because technology improving has never happened before in history... The stupid in your argument hurts.
Beside GPT-4 can already handle 32768 tokens, that's enough for your average movie, even without any special tricks (of which there are plenty).