Any point in backing up or redundancy for this? reddit / selfhosted ---------------------------------------------------------------------- JustNathan1_0 · 2023-11-21 21:48 Hey guys. Im using jellyfin to watch movies on my server and im looking at getting a 8tb hdd to start off. I was wondering if it would be stupid to have no redundancy because I kinda figured it would be pointless to me since if the drive was to fail I could just retorrent the movies again? My OS (proxmox) is on a 500gb nvme ssd. ---------------------------------------------------------------------- dcabines · 2023-11-21 21:51 That is something for you to decide. If you don’t value the data why spend money protecting it? ---------------------------------------------------------------------- JustNathan1_0 · 2023-11-21 21:54 Ok yeah thats what I thought. Im just always seeing people talking about there redundancy and how its stupid to not backup and/or have redundancy ---------------------------------------------------------------------- dazchad · 2023-11-22 00:21 If you don't care about the data, then its fine. I do have RAID for all my files, because even though I could get them again, it doesn't mean it's going to be easy or fast. Downloading 8TB even on a saturated 1gbps link takes ~18 hours. ---------------------------------------------------------------------- JustNathan1_0 · 2023-11-22 03:02 Yeah but thats fine. Idc how long it takes since if I get another drive which I plan on doing way before this one should theoretically even begin showing signs of failure I would just download it to that one and watch it on the second drive instead while I wait for drive #1 replacement to redownload everything. Besides 18 hours into too too bad. I have a 1gbps connection ---------------------------------------------------------------------- Still-Snow-3743 · 2023-11-22 03:17 I wrote a bunch of scripts that for each file I got from bittorrent, it removes it from the daily backups, and instead has a log of what file goes where and what torrent it came from. One of these days I will clean up the script and make it portable... ---------------------------------------------------------------------- JustNathan1_0 · 2023-11-22 03:19 If you could get that for me that would be amazing. Is it compatible with windows or linux or both? ---------------------------------------------------------------------- dazchad · 2023-11-22 05:35 Sounds like a plan! ---------------------------------------------------------------------- Still-Snow-3743 · 2023-11-22 06:47 its a real mess of code right now, its not really portable. Here's all the steps it has to do lol: * Intercept all torrent files that get added and record what the torrent url was for the file * Set a custom directory for the torrent and add it to the torrent client * Watch the directory to see if the torrent file completed * Upon completion, hash each file with sha1 to get its signature and record that to a file On backup, * Create a snapshot of my BTRFS drive in read write mode * Go through the snapshot and for each file larger than 1 MB large, hash it with SHA1 if we haven't seen it before based on file name/size. * If the file hash matches a hash of a torrent file that was downloaded, save it to a csv of what the file was, what the file was called in the torrent that was downloaded, and the url the torrent came from * Save this csv to the backup * Backup the snapshot to whatever targets I am baking my stuff up to On restore, * Read the csv file of what files need downloading and where they should go, get every unique torrent url, add them to the torrent client * Upon file completion, hash the files. If the file matches the hash of a file in the backup, move it to where it is supposed to go All of this relies specifically on me having a btrfs file system and transmission bittorrent client (openvpn-transmission docker container). If my mess of files is useful I could package them up, but it would probably take you awhile to get it set up. If this is a rabbit hole you want to go down though I can archive it all and tell you what to put where and while it's really haphazardly written, it does in fact work! I'd love to make a more portable, standalone version of all this... ---------------------------------------------------------------------- JustNathan1_0 · 2023-11-22 07:12 Yeah idk if imma do that right now because I'm just trying to get everything online to begin with but it would be amazing if someday you could clean it up and make it public. If you decide to do that lmk ---------------------------------------------------------------------- ElEd0 · 2023-11-22 09:41 For pirated movies, I meaaan... linux ISOS, is fine not to have backups cause as you said you can re-download them. My SSD with all my jellyfin media died recently and it kinda sucked but at least I didnt lose anything important. I guess most people in this sub that have redundancy with their media is because they rip the movies out of blu-rays they bought rather than download it. I also save copies of my ripped (legally) videogames. ---------------------------------------------------------------------- Still-Snow-3743 · 2023-11-22 12:45 Will keep it in the back of my mind, maybe one day! ---------------------------------------------------------------------- lilolalu · 2023-11-22 14:43 I am collecting hard to find art house stuff. So I have redundancy, but no backup. If your collection is easy to redownload I totally would use the interwebs as my backup. ---------------------------------------------------------------------- JustNathan1_0 · 2023-11-22 15:27 I've never ripped anything before. Does it wipe it off the cd your ripping from? If you rip a movie off a cd and then your drive fails is there any way of reripping the same movie again? ---------------------------------------------------------------------- schistosomnia · 2023-11-22 19:17 Nyawww, kids these days are so cute. No, ripping does not affect the disk - I think they just mean it would just take a long time to re-rip a large collection ---------------------------------------------------------------------- JustNathan1_0 · 2023-11-22 19:34 Ok that's what I thought lol. How could you guess I'm younger 😂😂