this post was submitted on 05 Jun 2023
60 points (100.0% liked)
Technology
37713 readers
506 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I say that there's a natural asymptotic limit to the current approach to training generative AI and we are already near it. It may take decades for the next breakthrough to be established.
Since GPT is just trying to predict what words come next, it’s not really thinking of what it’s saying. Adding that thought process would be the next big thing. When that happens, stack overflow and other troubleshooting forums like that will be about as useful as a phone book. Sure, you can still use them, but why would you when there’s something so much better available.
Adding that is not something that can be done using the current approach. A new approach is not guaranteed to be found, may not be found anytime soon, could have been found by someone that hasn't made it public yet.