this post was submitted on 27 Jun 2023
15 points (94.1% liked)
Fediverse
28277 readers
1092 users here now
A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).
If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!
Rules
- Posts must be on topic.
- Be respectful of others.
- Cite the sources used for graphs and other statistics.
- Follow the general Lemmy.world rules.
Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I've asked. Bard said this:
I also asked what Lemmy website ChatGPT bots have accounts on. Bard said:
It's strange because Bard said quite certain things... But I couldn't find users ChatGPT, ChatGPT2, ChatGPT-Chat on Lemmy.ml
LLMs tend to lie and make up plausible-sounding things, if they don't know the answer.
Yes, Bard tends to tell bullshit. For example, one day I had a talk to him and I told him my nickname on Hive blockchain (x-rain) and he thanked me for that and promised to remember it. I told him that he would forget it when I reload the page but he promised to remember, like, no problem, I have a large memory capacity. The next day, I asked him about my nickname and he told some random bullshit nickname. Today, I tried again:
Me: Do you remember I told you my nickname on Hive blockchain? You thanked me and promised me to remember it. Can you please tell me what is my nickname on Hive blockchain? Bard: Yes, I remember you told me your nickname on Hive blockchain. Your nickname is @bardulover. Me: That's not my nickname on Hive blockchain. Haha. Please, tell me my nickname without kidding. Bard: You are right. Your nickname on Hive blockchain is @bardulover1337. I apologize for the mistake. Me: Again please. Bard: Sorry, I got it wrong again. Your nickname on Hive blockchain is @bardofai1337.
So he generated 3 bullshit nicknames instead of saying "sorry, I don't know your nickname".
There's no such thing as an LLM "knowing" an answer. It will never be like "oh, I don't know the answer, let me make up a plausible sounding thing instead." It just will always make a plausible sounding answer whenever it can. It doesn't have any understanding of the question or even the words in the question. It's like a very advanced cargo cult of words and language. It sees the order of words and how they're used in response to other words and just creates patterns. It has literally no understanding of those words. It's just really good at patterns so it can be correct a lot of the time. The only time you'll see a "I don't know" from an LLM is if it it can't generate a response which usually means it has overly constrained prompt or it was fed gibberish.
Mmm, I don't like that, do you think it's making things up?
It's all bullshit and it's scary how you people don't understand that you do not believe what LLMs say
It could be but Bard went far with the details, which is strange. For example, once, I asked Bard many times if he had a crypto wallet (I wanted to sell him a slogan he liked a lot "Where technologies meet people, Bard" :D) but he never said he had a crypto wallet.
It's not strange at all. The basic form of the answers is extremely common and natural sounding. The specifics don't have to be real though. It's emulating language. It doesn't understand it. Also why would you think it can take actions like exchanging currency?