this post was submitted on 01 Jun 2023
49 points (100.0% liked)

Lemmy Support

4634 readers
2 users here now

Support / questions about Lemmy.

Matrix Space: #lemmy-space

founded 5 years ago
MODERATORS
 

I'm the sysadmin for beehaw.org and our user-base has almost tripled in 24 hours. Our site has been crashing so much over this time period.

We do have some volunteers that are trying to figure out a reasonable solution for when this happens again four weeks from now.

Do you have any recommendations?

top 16 comments
sorted by: hot top controversial new old
[–] nutomic@lemmy.ml 27 points 1 year ago (3 children)

So far there are no major problems. Disk was filling up but probably unrelated. I guess beehaw grew a lot more in terms of percentage than lemmy.ml during this time.

The main things I can think of which might help are to increase database pool size (in config file) and number of federation workers (/admin). Also create a swapfile if you are running low on RAM.

[–] suspended@lemmy.ml 11 points 1 year ago
[–] kai@beehaw.org 3 points 1 year ago* (last edited 1 year ago) (2 children)

I mean I've been able to verify with a number of users in America, and in Europe that signups just "spin" on lemmy.ml and have been that way for 24 hours or so. I've personally tested it on iOS & Windows (Safari, librewolf and Vivaldi) as well as on multiple IPs and had a few friends in multiple countries (England, France and Germany) try as well. Something is hung up somewhere for a few people at least. I made a post about it shrug

Also there's a few posts on r/lemmy with others having this same problem too.

[–] nutomic@lemmy.ml 2 points 1 year ago

You can ask them to check the browser console for errors. Or sign up somewhere else. Anyway we are getting at least a dozen signups per hour so it's working for many.

[–] szeraax@lemmy.dcrich.net 2 points 1 year ago (1 children)

On my instance at least, spinning on click normally meant issue with email submission. But there wasn't any good feedback like "failed to send email"

[–] kai@beehaw.org 3 points 1 year ago* (last edited 1 year ago)

No issue using the same email server and naming structure for signup on beehaw (as far as user email field data goes).

Update: Yup just checked using a different email address and server.

[–] wintermute@feddit.de 1 points 1 year ago

Please consider running the lemmy-UI on worker threads

[–] dessalines@lemmy.ml 14 points 1 year ago (2 children)

Its a kludge, but in the time being you can also add a docker-compose restart in your server cron every day or few hours. Lemmy restarts are pretty seemless, as the websockets automatically reconnect.

The next release will have websockets removed which should fix some of the stability and memory issues.

[–] suspended@lemmy.ml 5 points 1 year ago (1 children)
[–] dessalines@lemmy.ml 3 points 1 year ago
[–] zergling_man@lemmy.perthchat.org 5 points 1 year ago (1 children)

Are they being replaced, or is it just going to be all REST?

[–] dessalines@lemmy.ml 3 points 1 year ago (1 children)
[–] szeraax@lemmy.dcrich.net 2 points 1 year ago (1 children)

/me goes and disable WSS support from nginx... :P

[–] dessalines@lemmy.ml 4 points 1 year ago

Some of the discussion of it is here. I was staunchly pro websocket, but it's become too much work to maintain, and doesn't scale well.

[–] db0@lemmy.dbzer0.com 6 points 1 year ago

What's your server load look like?

[–] nick@campfyre.nickwebster.dev 1 points 1 year ago

I made a kubernetes deployment for my lemmy service + use object storage for image hosting. Everything lemmy-side looks like it should scale fine. I'm not doing open registrations though, so it won't impact me. The key bottleneck in my case is the database, but if need be a larger node can be provisioned to let the DB expand a bit.

I think for larger instances some form of server-abstraction will be useful for scaling (i.e. k8s, cloud run, EKS, etc.)

load more comments
view more: next ›