Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
Can't wait for the subset of self-host hobbyists to start posting about their self-hosted AI partners.
They could even arrange meetups like double dates and parties and such. The future is gonna be so chaotic. I love it.
Some would do that. Some wouldn't. Some would nudge in the direction of becoming even more fscked up.
Some moral limitations we take for given in real people (often imagined even there) don't exist for computer programs at all.
If the algorithms of social media are any indication, it's more likely they'd be programmed to manipulate the user into spending as much time with the AI as possible, while the AI serves them ads.
No VR boobies unless you get some sunlight today, babe
Hahahaha
I like how you think!
Until those partners have bodies ...
Big privacy advocate so I was curious what it takes to self host something like that, more so just wanting a very flexible personal assistant for product, weather alerts all in one.
Takes a lot of RAM and GPU power, more than I have sitting around.
Have you been looking at quantised models? You can get pretty good ones at the 20 gig RAM+VRAM level which is very reasonable if you have a gaming PC and are ok with responses not being instant.
Not just scraping data but spreading disinfo and radicalizing people. There was one case recently I saw about that. Not just AI lovers, but potentially a number of AI applications
Pasterama, Don't Date Fumos that are also Tulpas and if your cold their cold, put them behind 3 secret walls that are on fire, under the sea.
Neural engines are coming to basically all CPUs. It won’t be long before you can run your own girlfriend offline on your phone. Training the data is the expensive part after all. I can already run basic llama 2B on my iPad, though offloading the software instead of just downloading off the App Store.
I’m fairly sure anyone with a good GPU can also run these, but I haven’t tried.
Yes. The Llama 70B derived models, as well as Mixtral 8x7B and the new Mistral Medium 70B are competitive with ChatGPT 3.5. Most of them can do 16,000 token context similar to ChatGPT as well.
You only NEED 40GB of free RAM to run them at decent quality, but it's slow.
With a 24GB GPU like a 3090 or 4090 you can run them at a reasonable speed with partial GPU offload. About 1-2 words per second. I run 70Bs in this manner on my computer.
With two 24GB GPUs you can run them very fast, like ChatGPT.
There's of course a whole world in between as well, but those are the rough hardware requirements to match ChatGPT in a self-hosted sort of way. There's also a new thing people are doing where they add layers from one model onto another one, like a merge but keeping >50% of the original layers from each model. "Goliath 120B" and the like, which is made from 2 different 70Bs. They're even better but it's a bit beyond reasonable consumer hardware for now.
TBH at my personal actual point an "AI" girlfriend sounds better than an empowered feminist 🤣🤣.
…I swear these takes mainly reveal the fact that conservatives like you just see women as objects and that you don’t care about genuine partnership.
That may be an exception, but my best friend (temporarily not, but I'm sure he'll be that again) is in general pretty progressive, but when it comes to relationships, starts spewing something about "anti-male laws", feminists and so on.
And I know he doesn't see women as objects.
Some of us simply have overvalued ideas caused by trauma. I can't imagine what that was with him, because I remember him not being like that.
To be clear, I called that dude a conservative because of his username combined with his comment.
Leaving that aside, our patriarchal capitalist society (yeah yeah, buzzwords, I know) is very good as misdirecting frustration to mask the underlying dynamics; a lot of people, both men and women, are increasingly lonely because of societal problems. Decreased social cohesion because of different urban planning and the focus on the nuclear family for example, both of which are directly tied to capitalist ideology.
If you then get frustrated and blame that on feminism, that’s textbook conservative thought. A lot of people are misled into thinking these things (because misdirection of frustration is crucial to capitalism), even people who mostly aren’t conservative themselves. That’s just a product of the ubiquity of conservative thought.
Either way, I hope you can help your friend to escape that way of thinking. It’d be better for everyone.
It's cos I truly believe in genuine partnership why I would be more attracted to an "AI" girlfriend instead of a real empowered feminist girlfriend. At least the "AI" girlfriend will not be spending my money and gaslighting me at the same time.
How does an AI provide you genuine partnership? The kind that allows you to grow, enriches your life and makes you happier in the long term, I mean.
Do everyone a favor and just get one of these AIs and live in your basement without ever bothering anyone else.
Please just go back to reddit or truth social. Literally no one wants you to be here and your "say something edgy to get attention" behaviour is just kind of sad.