Borg backup, great software
Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
Borg is great, I actually switched from borg to restic because borg would index everything before backing up the files. Restic starts backing up while indexing is still happening. Not a huge deal normally, but it mattered a lot when it'd take 8+ hours to index lots of tiny files on a couple servers.
I never experienced it been slow.
Normally the hard drives and network is slower the Borg.
Have you reported the use case to the Borg backup developer's?
There were related github issues open, but not opened by me. It wasn't that borg itself was slow, but it was more to do with the number of files being backed up. Even a simple find . -type f
would take hours. My problem with it was that borg wouldn't start uploading data until that indexing finished.
Restic immediately started uploading while it was still indexing so it cut the overall backup time way down.
If it took 4 hours to index files and then 4 hours to upload those files, borg would total 8 hours while restic was only 4 hours total.
This was something like 10TB and hundreds of millions of files though. I never had an issue with borg on smaller datasets.
My vote goes to Kopia.
Added Kopia to my list, thanks! It doesn't look like it has a centralized management console, but that's probably alright if I only use it for desktops/laptops and not servers/vms.
When it's running in server mode it provides a similar UI too when it's a client, except now you can browse the snapshots/policies of each client that uses it.
Not quite full management but yeah, good for home use.
im using synology for most of my backups, you can run it on your own hardware.
Interesting, the synology backup software does look pretty nice. Can you run it without owning a synology nas though? I'm not finding much information about that so far after a quick search
Install Synology DSM on VirtualBox virtual machine
this will work with a number of vm hypervisors,
!synology@feddit.de can possibly help
Ohh I got it, I thought it was an officially supported thing. It looks pretty useful though, I'll do some research and try it out. Thanks!
its supported AFAIK, you should be able to use all the features, they make money on both the hardware and services like hyperbackup.
If you ever want to use DSM, you can use the dockerimage of virtual dsm
No need to own a Synology, no limits, no account required ☺️
That is certainly neat, I've never seen kvm in docker before. Thanks for the tip, this will help to at least evaluate it!
I mean Nextcloud would work on this case
I'm looking for a solution for both servers and clients. I do have nextcloud and could use it to sync files from some of the client machines to a server that gets backed up, but I haven't had a lot of luck with the nextcloud cli in the past. It also doesn't preserve things like ownership/permissions :(
Ahhh that makes sense
Urbackup is ok. Veeam has a free version for 10 clients but it only runs on windows and is really poorly made so it sucks down resources.
I use Restic for servers, Kopia for desktops. Restic tends to end up with problematic locks on systems that shutdown uncleanly sometimes.
Another comment recommended Kopia, I've been testing it out on a desktop and one vm and it seems good so far. Was there a reason you aren't using Kopia on the servers too?
I use restic for servers currently, but might try kopia since having a basic web ui is kind of nice to see what's being backed up.
I have more experience with Restic so I’m more comfortable with it on servers, but the lock files don’t work properly on desktops that shutdown uncleanly.