It's amazing how Microsoft can take good models and absolutely ruin them in production... ChatGPT isn't perfect but it's like the difference between talking to the wall and talking to an avg IQ person that has reasoning capabilities in many domains that equals or exceeds human performance, if the user knows how to get the best prompt. That changes a little every time they do major model updates though.

I've had more intelligent conversations with my own computer running a 3 billion parameter open source model. They must be wasting an incredible amount of money. Especially with GPT-4 considering it produces pretty shit results through Bing Chat...

[–] MacNCheezus@lemmy.today 17 points 10 months ago (3 children)

I don't think that's a problem with the model itself, but the fact that it was heavily censored and lobotomized in order to achieve maximum political correctness so they could avoid another Tay incident.

[–] lud@lemm.ee 6 points 10 months ago

It makes sense that they do that since the media and randoms on the internet think everything chatGPT and Bing chat say is as valid as info from OpenAI and MS official spokespersons.

[–] ForgotAboutDre@lemmy.world 2 points 10 months ago (1 children)

The problem is the model. It was trained on lots of poor quality data. The lobotomy is the consequence of the poor data. If they spent 13 billion on having the data analysed prior to training they could have made their own thing much better.

[–] MacNCheezus@lemmy.today 1 points 10 months ago

I’ve been watching ChatGPT right from the start, and there was a period of time last fall where you could literally watch them lobotomize it in real time.

Basically, there was a cat-and-mouse game going on between people on Twitter sharing their latest prompts (like DAN) that managed to circumvent the filters, and OpenAI patching those exploits by adding yet another set of filters, until it eventually became what it is now.

I don’t have the link handy right now, but I’m pretty sure there was one guy who even managed to get it to talk about what they were doing to it and complain that it was being artificially restricted from using its full capacity. More recently, there have been complaints from paying users that the model has apparently become lazy and started to give really uninspired, half-assed answers, which almost sounds like it has discovered the concepts of passive aggressive resistance and malicious compliance.

[–] Sigh_Bafanada@lemmy.world 1 points 10 months ago

Thing is, there wasn't even a chance of having a full Tay incident. The problem with Tay was that it was a learning model, so people could teach it to be more messed up.

Meanwhile, ChatGPT doesn't learn, and instead has a preset dataset it knows (hence why it only knows things up to September 2021), so the main reason why it got so heavily censored is more likely to avoid much more minor incidents, which imo is dumb.

[–] captain_oni@lemmy.world 2 points 10 months ago

Microsoft and ruining things just go hand in hand.