TechTakes

1397 readers

126 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems

OpenAI, Google, Anthropic admit they can’t scale up their chatbots any further (pivot-to-ai.com)

submitted 1 day ago by dgerard@awful.systems to c/techtakes@awful.systems

37 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] bitofhope@awful.systems 20 points 1 day ago (1 children)

LLMs are quite impressive as chatbots all things considered. The conversations with them are way more realistic and almost as funny as the ones with the IRC markov chain my friend made as a freshman CS student.

Of course, out bot's training data only included the IRC channel's logs of a few years and the Finnish Bible we later threw in for shits and giggles. A training set of approximately zero terabytes in total.

LLMs are less a marvel of machine learning algorithms (though I admit they might play a part) and more one of data scraping. Based on their claims, they have already dug through the vast majority of publicly accessible world wide web, so where do you go from there? Sure, there are a lot of books that are not on the web, but feeding them in the machine is about as hard as getting them on the web to begin with.

[–] blakestacey@awful.systems 9 points 18 hours ago (2 children)

Senior year of college, I took an elective seminar on interactive fiction. For the final project, one of my classmates wrote a program that scraped a LiveJournal and converted it into a text adventure game.

[–] swlabr@awful.systems 6 points 8 hours ago (1 children)

You are standing in an open field west of a
giant castle, with an ornate front door.
Your name is Ebony Dark'ness Dementia Raven Way.
>

[–] blakestacey@awful.systems 6 points 5 hours ago

My own final project was a parody of the IMDb that was "what if the IMDb was about books instead of movies", except that the user reviews told stories about people who turned out to have all gone to high school together before scattering around the world, and reading them in the right sequence unlocked a finale in which they reunited for a New Year's party and their world dissolved so that their author could repurpose them for other stories.

[–] self@awful.systems 6 points 15 hours ago

fuck yes, why wasn’t my college this cool? all I got was an AI elective taught by a guy whose proudest achievement was having the only remaining Genera license on campus