https://github.com/imartinez/privateGPT
Interact privately with your documents using the power of GPT, 100% privately, no data leaks
this post was submitted on 27 Sep 2023
32 points (92.1% liked)
Programming
17450 readers
159 users here now
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Rules
- Follow the programming.dev instance rules
- Keep content related to programming in some way
- If you're posting long videos try to add in some form of tldr for those who don't want to watch videos
Wormhole
Follow the wormhole through a path of communities !webdev@programming.dev
founded 1 year ago
MODERATORS
Awesome, thank you !
You can easily build one yourself. Check llamaindex and langchain for prebacked solutions. Otherwise the math is pretty trivial if you are using normalized embeddings. You can quickly do one with numpy.
My suggestion anyway is to start with langchain, full of tutorials executable as jupyter notebook
I did this with my wiki in order to read each article and come up with a category and keyword cloud. I first started by attempting to use many different tools to build my own LLM and then realized that I was reinventing the wheel and shifted to using OpenAI’s API. I was able to prompt it to read each article as input and output what I needed in a machine readable format. It worked like a charm.
If you're in the Google ecosystem, Bard recently gained the (toggleable) ability to access you email/notes (can't remember if it can access documents)