Post BAKrGiCPjbKScfUK3M by splitshockvirus@mstdn.starnix.network
(DIR) More posts by splitshockvirus@mstdn.starnix.network
(DIR) Post #BAKjyxSbYWp33weGAK by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
EVERYONE I FOUND THE PROBLEM.I ran rclone syncI'm fucking retarded.rclone sync, syncs source to destination and deletes everything not at source.so local disk has switched off at Aug 31st, I ran rclone copy, some time I ran rclone sync after assuming it would detect files that already exist, it did, and then deleted files that didn't exist on source.literally as shrimple as that. So... media is gone between Sep 1 and Sep 5, sorry fellas :cirno_shrug: What a stupid command
(DIR) Post #BAKmxPywqFlUnvjZIG by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@benis_redux You don't need to rub it in nigga :bball1:
(DIR) Post #BAKnYmXPwTSpTVfnYu by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@benis_redux That shit was a glimpse of what my previous j*b was like.
(DIR) Post #BAKoLYsDXEuTHif6oq by sjb@mstdn.io
0 likes, 0 repeats
@splitshockvirus This is why one of my sync scripts has an "if there are less than 100 files in source, abort with a warning" in it.[edit] and the same for "destination file is newer than the source".
(DIR) Post #BAKrGiCPjbKScfUK3M by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@sjb rsync ๐๐ผrclone sync ๐
(DIR) Post #BALLiDWCOcMWCVm2XA by sjb@mstdn.io
0 likes, 0 repeats
@splitshockvirus I should stop going down this rabbit hole.https://blog.everpuredata.com/purely-educational/rclone-vs-rsync/
(DIR) Post #BALNl5yX64rlaFWjlw by sjb@mstdn.io
0 likes, 1 repeats
@splitshockvirus Aha now I see the issue.
(DIR) Post #BALOWVjd8nqH5PALia by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@sjb that's basically the long and short of it.I can properly guess my exact mentality at the time too. The destination bucket isn't online so it doesn't matter if it deletes diff. I forgor it was online.
(DIR) Post #BALPTpS5TdDFK5FH0a by sjb@mstdn.io
0 likes, 0 repeats
@splitshockvirus A while back I had some Windows HDD go unmounted and then my automatic backup script deleted all the backups because it saw 0 files on the source.
(DIR) Post #BALQAuEdZMW0bqUkN6 by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@sjb Amazing how in my 5+ years using rsync I have never accidentally deleted files. Because you have to specify a flag. And rclone just deletes files by default.
(DIR) Post #BALQOgMzusdPf4yTy4 by sjb@mstdn.io
0 likes, 0 repeats
@splitshockvirus This might be a rare case of the best design being NO default (at least for rclone). You have to specify what you mean because there are about 6 ways of doing backup/sync.I also got caught out by one that used timestamps and FAT32 apparently has a fit when changing out of daylight saving time, started overwriting newer files.
(DIR) Post #BALR2nyv2HhSqsqNrE by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@sjb I'm guessing the logic being that rclone sync, in English sounds more correct to what it's actually doing. But coming from rsync, sync in my mind is checksum files that already exist compare and transfer those that don't exist or are differnet based on checksum.clone copy is basically rsync, but in shell cp is copy. copying without checksuming is possible but it's slower because it overwrites files that might already exist.I would have preferred rclone mirror
(DIR) Post #BALRVXzZYz3Xewr4HQ by sjb@mstdn.io
0 likes, 0 repeats
@splitshockvirus I was asking AI about it but I've also pretty recently had AI give me shell code that did the exact opposite of what I wanted (overwrite newer config with old).By the way mstdn.io is planning to shut down. I already have a mstdn.starnix account. Although was also wondering about trying to host my own one. Maybe on a new VPS, not sure it's sensible to also put it on my existing website host.
(DIR) Post #BALS594Vh5MmnN8fsu by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@sjb If you have the resources to host your own I would recommend that because then you don't have to deal with our defeds. If you want to save some ๐ you can setup a VPN+reverse proxy on your current host and run an instance with a spare computer.
(DIR) Post #BALTFuuEnm6K072BIO by sjb@mstdn.io
0 likes, 0 repeats
@splitshockvirus I might spin up an entirely different VPS for independence purposes. My main website is only $12/mo or something, I believe a VPS for a single Mastodon would be even less(?)Ideal situation is if I could subdomain mstdn.stephenbrooks.org to point at that new server too.
(DIR) Post #BALUIrYVoaUmQsqC1I by splitshockvirus@mstdn.starnix.network
0 likes, 0 repeats
@sjb nah it's more, hosting prices have gotten insane recently due to flash mem prices. Mastodon requires something like 8-16GBs to compile the ruby env. Also you are required to cache remote media which eats storage space.You can get around the later by setting up an S3 bucket and or setting retention to 1 day but mastodon is really meant for 100s of clients, same with misskey.I don't like pleroma but it's better for single user instances like your use case.