this post was submitted on 19 Jun 2023
8 points (100.0% liked)

ObsidianMD

4105 readers
1 users here now

Unofficial Lemmy community for https://obsidian.md/

founded 1 year ago
MODERATORS
grabyourmotherskeys@lemmy.world
Pexily@lemmy.world
8
How interested are you in using LLM AIs (such as ChatGPT) in your vault? How important is it, that they're running locally and private (like GPT4All)? (feddit.de)
submitted 1 year ago* (last edited 1 year ago) by swnt@feddit.de to c/obsidianmd@lemmy.world
5 comments fedilink hide all child comments
 

Would you like to see some plugins which integrate with local/self-hosted AI instead of sending it to ChatGPT? Or don't you care about privacy there as long as the results are good?

You might be interested in GPT4All (https://gpt4all.io/index.html), which can be easily downloaded as Desktops GUI. Simply download a model (like nous Hermes) for 7.5GB and run in even without a GPU right on your CPU l (albeit slightly slowish).

It's amazing what's already possible with local AI instead of relying on large scale expensive and corporate-dependent AIs such as ChatGPT

you are viewing a single comment's thread
view the rest of the comments
[–] maiskanzler@feddit.de 1 points 1 year ago

I am generally interested in giving an LLM more context about my data and hobby project code, but I'd never give someone else such deep access. GPT4ALL sounds great and it's making me hopeful that we won't have to rely entirely on commercial GPTs in the future. It's the AI equivalent to what Linux and FreeBSD are to OSs.

But that still leaves the question of what to do with it. I see 2 main purposes:

  • Asking the GPT questions about your material
  • Writing more content for your vault

That both seems useful at first, but I don't think it's really necessary. A good fuzzy search like obsidian has and a good vault and note structure makes the first point pretty irrelevant.

Also, writing more content is really two things:

  • Text generation/completion
  • Research

I think a plugin might be nice and user friendly UI for the first point, but research is much better done in a chat-like environment. And for that I don't need an integration, as I probably have a web browser open anyways.