LocalLLaMA

2244 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

pax@sh.itjust.works

SkySyrup@sh.itjust.works

noneabove1182@sh.itjust.works

Llama 2 - Meta AI (ai.meta.com)

submitted 1 year ago* (last edited 1 year ago) by noneabove1182@sh.itjust.works to c/localllama@sh.itjust.works

7 comments fedilink hide all child comments

Blog post: https://about.fb.com/news/2023/07/llama-2/

you are viewing a single comment's thread
view the rest of the comments

[–] kakes@sh.itjust.works 5 points 1 year ago (3 children)

Is there any actual information here other than the number 2 being added to the name?

I gather it's better optimized for Windows, which is a welcome enough improvement imo. Other than that, they just go on about how "safe" it is.
I understand the concern about "AI safety" (at least in theory), but I wouldn't exactly call it a selling point.

[–] btobolaski@threads.ruin.io 9 points 1 year ago (1 children)

Double the training data, double the trained context (4096 now), a chat tuned varient, the omission of the 35b model for now (it apparently isn't "safe" enough), and commercial use is allowed (not that most of the people using llama cares about licensing).

[–] kakes@sh.itjust.works 2 points 1 year ago

Thanks, that sounds more exciting than just "safety" haha.

[–] Kerfuffle@sh.itjust.works 2 points 1 year ago

It also appears on the HF leaderboard now so you can get a very general idea of how (at least the 70b model) compares: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

[–] noneabove1182@sh.itjust.works 2 points 1 year ago (1 children)

There's a few things, one of the biggest is the commercial license and the 4k context

[–] kakes@sh.itjust.works 3 points 1 year ago

Nice, thanks for the info!