Machine Learning

1765 readers

1 users here now

founded 4 years ago

MODERATORS

osipov@lemmy.ml

Dear ML users/researchers, what hardware do you use? (lemmy.ml)

submitted 1 year ago by joelthelion@lemmy.ml to c/machinelearning@lemmy.ml

7 comments fedilink hide all child comments

I am looking to replace my old PC, and wondering what other people use.

Do you use your own hardware? If so, what do you have? What do you think gives you the most bang for your buck at the moment?

Do you use the cloud instead? If so, why? Which service(s) do you use?

Thank you!

top 5 comments

sorted by: hot top controversial new old

[–] Sagar@sopuli.xyz 3 points 1 year ago (1 children)

SO Edge by Pine! Fantastic performance!

[–] joelthelion@lemmy.ml 2 points 1 year ago* (last edited 1 year ago)

undefined> SO Edge by Pine

Interesting! How do you use it? Do you connect it to your main PC? How?

Also, what RAM does it use? Does it use the main system RAM?

[–] __forward__@lemm.ee 2 points 1 year ago (1 children)

I think major training should just be done on dedicated servers/on the cloud. That being said it is very helpful to test locally, so in case you are planning on using Nvidia equipped servers just get any somewhat recent consumer Nvidia card and you can always run locally on some sample data and test much more easily.

[–] konodas@feddit.de 2 points 1 year ago* (last edited 1 year ago)

I second that. Being able to test medium sized models locally can make debugging much easier.

I have a 3070 with 8GB VRAM, which can train e.g. a GPT2 with a batch-size of 1 with full precision.

[–] tetelestia@lemmy.world 1 points 1 year ago

I do 95% of my personal stuff on a desktop with a GTX 1070, often remoting into it from a laptop. Someday soon I'll throw a bigger GPU in, but the 1070 has served me well for years.

I find the sunk cost of building a machine encourages me to use it more. I don't mind running something for a week even if I have no idea if it'll work or not.

Same deal at work, but with much beefier hardware. In both cases, I'll spin up a cloud instance if I want some results faster.

load more comments