restlessyet

@restlessyet@discuss.tchncs.de

This profile is from a federated server and may be incomplete. Browse more on the original instance.

What's an elegant way of automatically backing up the contents of a large drive to multiple smaller drives that add up to the capacity of the large drive?

So I have a nearly full 4 TB hard drive in my server that I want to make an offline backup of. However, the only spare hard drives I have are a few 500 GB and 1 TB ones, so the entire contents will not fit all at once, but I do have enough total space for it. I also only have one USB hard drive dock so I can only plug in one...

restlessyet,

I ran into the same problem some months ago when my cloud backups stopped being financially viable and I decided to recycle my old drives. For offline backups mergerfs will not work as far as I understand. Creating tar archives of 130TB+ also doesnt sound like a good option. Some of the tape backup solutions looked to be possible options, but are often complex and use special archive formats…

I ended up writing my own solution in python using json state files. It’s complete enough to run the backup, but otherwise very work-in-progress with no restore at all. So I do not want to publish it.

If you find a suitable solution I am also very interested 😅

restlessyet,

Honestly, unless you can spend more $, one or two USB disks for the mini pc is probably your only choice.

restlessyet,

If this fits your budget (you still need the actuals disks…) it’s not a bad choice. Speed should be sufficient for HDDs, as it’s USB 3.

As the other poster suggested, don’t use its hardware raid. Use it as a JBOD and configure the raid in Linux with ZFS or similar.

And never forget: RAID is not a backup! You still need to do regular backups, at least for important data.

restlessyet, (edited )

From your description I would gues that the affected trackers have some rate or connection limits, and your qbittorrent announces are exceeding them. try setting a higher announce interval, like 1+ hours

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • localhost
  • All magazines
    •
    Loading…
    Loading the web debug toolbar…
    Attempt #