I've not thought of a good use case for the technology myself, but if i were to use it i'd prefer it be local just for conveniences sake.
ObsidianMD
Unofficial Lemmy community for https://obsidian.md/
I am generally interested in giving an LLM more context about my data and hobby project code, but I'd never give someone else such deep access. GPT4ALL sounds great and it's making me hopeful that we won't have to rely entirely on commercial GPTs in the future. It's the AI equivalent to what Linux and FreeBSD are to OSs.
But that still leaves the question of what to do with it. I see 2 main purposes:
- Asking the GPT questions about your material
- Writing more content for your vault
That both seems useful at first, but I don't think it's really necessary. A good fuzzy search like obsidian has and a good vault and note structure makes the first point pretty irrelevant.
Also, writing more content is really two things:
- Text generation/completion
- Research
I think a plugin might be nice and user friendly UI for the first point, but research is much better done in a chat-like environment. And for that I don't need an integration, as I probably have a web browser open anyways.
How is this possible? I thought that local LLM models nearly all required ludicrous amounts if VRAM, but I don’t see anything about system requirements on their website. Is this run in the cloud?
It supposedly runs on CPUs too as far as I understand it
It actually runs locally! I did that just two days ago. it's amazing!
it's all based on research by many people who wanted to make the LLMs more accessible because gating them behind large computational work isn't really fair/nice.