this post was submitted on 24 Oct 2024
131 points (83.2% liked)

Technology

59436 readers
3000 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
131
submitted 3 weeks ago* (last edited 3 weeks ago) by jcg@halubilo.social to c/technology@lemmy.world
 

I've seen a lot of sentiment around Lemmy that AI is "useless". I think this tends to stem from the fact that AI has not delivered on, well, anything the capitalists that push it have promised it would. That is to say, it has failed to meaningfully replace workers with a less expensive solution - AI that actually attempts to replace people's jobs are incredibly expensive (and environmentally irresponsible) and they simply lie and say it's not. It's subsidized by that sweet sweet VC capital so they can keep the lie up. And I say attempt because AI is truly horrible at actually replacing people. It's going to make mistakes and while everybody's been trying real hard to make it less wrong, it's just never gonna be "smart" enough to not have a human reviewing its' behavior. Then you've got AI being shoehorned into every little thing that really, REALLY doesn't need it. I'd say that AI is useless.

But AIs have been very useful to me. For one thing, they're much better at googling than I am. They save me time by summarizing articles to just give me the broad strokes, and I can decide whether I want to go into the details from there. They're also good idea generators - I've used them in creative writing just to explore things like "how might this story go?" or "what are interesting ways to describe this?". I never really use what comes out of them verbatim - whether image or text - but it's a good way to explore and seeing things expressed in ways you never would've thought of (and also the juxtaposition of seeing it next to very obvious expressions) tends to push your mind into new directions.

Lastly, I don't know if it's just because there's an abundance of Japanese language learning content online, but GPT 4o has been incredibly useful in learning Japanese. I can ask it things like "how would a native speaker express X?" And it would give me some good answers that even my Japanese teacher agreed with. It can also give some incredibly accurate breakdowns of grammar. I've tried with less popular languages like Filipino and it just isn't the same, but as far as Japanese goes it's like having a tutor on standby 24/7. In fact, that's exactly how I've been using it - I have it grade my own translations and give feedback on what could've been said more naturally.

All this to say, AI when used as a tool, rather than a dystopic stand-in for a human, can be a very useful one. So, what are some use cases you guys have where AI actually is pretty useful?

you are viewing a single comment's thread
view the rest of the comments
[–] a_wild_mimic_appears@lemmy.dbzer0.com 10 points 3 weeks ago (5 children)

I switched to Linux a few weeks ago and i'm running a local LLM (which was stupidly easy to do compared to windows) which i ask for tips with regex, bash scripts, common tools to get my system running as i prefer, and translations/definitions. i don't copy/paste code, but let it explain stuff step by step, consult the man pages for the recommended tools, and then write my own stuff.

i will extend this to coding in the future; i do have a bit of coding experience, but it's mainly Pascal, which is horrendly outdated. At least i already have enough basic knowledge to know when the internal logic of what the LLM is spitting out is wrong.

[–] anhydrous@lemmy.world 1 points 3 weeks ago (1 children)
[–] a_wild_mimic_appears@lemmy.dbzer0.com 3 points 3 weeks ago (1 children)

i'm currently using Alpaca with a few LLMs installed, but i really like llama2 uncensored, which is pretty fast and responsive on my system.

[–] brucethemoose@lemmy.world 3 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

Llama 2 is really ancient now.

Try Qwen 2.5, whatever size fits on your system (probably 14B?). Its like night and day compared to llama2, and 34B/72B are like API model smart.

[–] a_wild_mimic_appears@lemmy.dbzer0.com 1 points 3 weeks ago (1 children)

thanks for the recommendation, will try it out over the next few days :-)

[–] brucethemoose@lemmy.world 1 points 3 weeks ago

I can link you to a good quantization, depending on your hardware!

And if you need long context (Qwen 2.5 is 32K, or potentially more), I can also point to the appropriate framework/settings.

load more comments (3 replies)