this post was submitted on 24 Jun 2024
66 points (100.0% liked)

TechTakes

1401 readers
154 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] froztbyte@awful.systems 9 points 4 months ago (5 children)

Even as far back as AI Dungeon he was claiming they had an intuitive understanding of physics

omfg, every day a new opportunity to learn things that hurt my brain even more. how the fuck can someone have looked at that shit with even an ounce of understanding of gradient descent and think "yes! it has COMPREHENSION!"???

fucking hell, what an utter fucking moron

[–] scruiser@awful.systems 12 points 4 months ago (4 children)

It is even worse than I remembered: https://www.reddit.com/r/SneerClub/comments/hwenc4/big_yud_copes_with_gpt3s_inability_to_figure_out/ Eliezer concludes that because it can't balance parentheses it was deliberately sandbagging to appear dumber! Eliezer concludes that GPT style approaches can learn to break hashes: https://www.reddit.com/r/SneerClub/comments/10mjcye/if_ai_can_finish_your_sentences_ai_can_finish_the/

[–] BigMuffin69@awful.systems 10 points 4 months ago (1 children)

wasnt this around the time he said we need an institute to watch for sudden drops in the loss function to prevent foom?

[–] scruiser@awful.systems 9 points 4 months ago

Broadly? There was a gradual transition where Eliezer started paying attention to deep neural network approaches and commenting on them, as opposed to dismissing the entire DNN paradigm? The watch the loss function and similar gaffes were towards the middle of this period. The AI dungeon panic/hype marks the beginning, iirc?

load more comments (2 replies)
load more comments (2 replies)