That explains why I had a sudden burst. I use pgbouncer between Lemmy and the DB to help with connections, which seems to be the biggest problem. However, I had some values flipped. I had my max set to 180 and the min set to 190. This caused issues. After I resolved it, it was fine.
My DB supports up to 197 connections.