LocalLLaMA

2237 readers

7 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

pax@sh.itjust.works

SkySyrup@sh.itjust.works

noneabove1182@sh.itjust.works

llama.cpp for GPU only (lemmy.ml)

submitted 1 year ago by bia@lemmy.ml to c/localllama@sh.itjust.works

0 comments fedilink hide all child comments

I’ve been using llama.cpp, gpt-llama and chatbot-ui for a while now, and I’m very happy with it. However, I’m now looking into a more stable setup using only GPU. Is this llama.cpp still still a good candidate for that?

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here