this post was submitted on 24 Aug 2023
17 points (90.5% liked)

Free Open-Source Artificial Intelligence

2889 readers
1 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 1 year ago
MODERATORS
Blaed@lemmy.world
fosai@lemmy.world
17
(Deleted for not relevant anymore) (lemmy.world)
submitted 1 year ago* (last edited 2 weeks ago) by cll7793@lemmy.world to c/fosai@lemmy.world
2 comments fedilink hide all child comments
 

(Deleted for not relevant anymore)

you are viewing a single comment's thread
view the rest of the comments
[–] micheal65536@lemmy.micheal65536.duckdns.org 1 points 1 year ago

AMD GPU support appears to be included in GGML. I don't see any reason why you wouldn't be able to split between multiple GPUs as the splitting is handled within GGML itself and not tied to any particular library/driver/backend.