yacgta

joined 1 year ago
[–] yacgta@infosec.pub 6 points 1 year ago

I quite like Tailscale SSH for this, but I don't have as many machines, so not sure how it will scale. You can definitely assign roles here to allow/deny SSH between hosts in your fleet though.

[–] yacgta@infosec.pub 8 points 1 year ago (3 children)

I keep hearing this about Arch: could you educate a noob on what kinds of things I'd be dealing with? I'm comfortable with Linux in general but somewhat apprehensive with what I hear about Arch

[–] yacgta@infosec.pub 5 points 1 year ago (1 children)

Specifically on what LLM to use, I've been meaning to try Starcoder, but can't vouch for how good it is. In general I've found Vicuna-13B pretty good at generating code.

As for general recommendations, I'd say the main determinant will be if you can afford the hardware requirements to locally host - I presume you're familiar with the fact that you'll (usually) need roughly 2x the number of parameters in VRAM (e.g. 7B parameters means 14GB of VRAM). Techniques like quantization to 8-bits halve the requirement, with the more extreme 4-bit quantization halving them again (at the expense of generation quality).

And if you don't have enough VRAM, there's always llama.cpp - I think that list of supported models is outdated, and it supports way more than those.

On the "what software to use for self-hosting" I've quite liked FastChat, they even have a way to run an OpenAI API compatible server, which will be useful if your tools expect OpenAI.

Hope this is helpful!

[–] yacgta@infosec.pub 2 points 1 year ago

That was it, thank you!

[–] yacgta@infosec.pub 6 points 1 year ago (2 children)

I have a few of these but I forget where they came from, curious if anyone here knows

 

As title

[–] yacgta@infosec.pub 1 points 1 year ago

Ivory for Mastodon also has it, and I'm assuming it came from their Twitter client (never used it myself though)

[–] yacgta@infosec.pub 10 points 1 year ago* (last edited 1 year ago) (2 children)
[–] yacgta@infosec.pub 2 points 1 year ago

Recently discovered this great site for making these https://youwouldntsteala.website/editor.html

[–] yacgta@infosec.pub 3 points 1 year ago (1 children)

Did you try manually setting the TDP? In Civ VI I set it to 7W (default graphics) and it has helped quite a bit.

[–] yacgta@infosec.pub 20 points 1 year ago

I mean, this is Google we're talking about...

 

I don't claim to have discovered this, all credit to this Github post

As a workaround (I assume Cemu/Yuzu is run in gaming mode from Steam):

Press STEAM button Open Controller Settings Edit layout Go to Gyro Select Gyro Behavior -> Directional Pad Choose anything for one of the positions of directional pad. Anything that won't intefere with using Cemu/Yuzu. I chose Action Sets->Cleared from Parent Now it should work.

That was enough to get Cemu working again. For Yuzu I had to remap the motion sensor. Best way to do that is to follow this video