[HN Gopher] Rclone: Rsync for cloud storage - CLI to sync betwee...
___________________________________________________________________
Rclone: Rsync for cloud storage - CLI to sync between cloud storage
providers
Author : gilad
Score : 82 points
Date : 2021-12-03 21:27 UTC (1 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| glitchcrab wrote:
| Nick Craig-Wood (ncw) was the CEO of the last company I worked
| for, and I consider it a privilege to have worked for him. He's
| one of the smartest people I've ever met, and an incredibly nice
| person too. I have many fond memories of the annual staff
| barbecue in his garden.
| meirelles wrote:
| He reviewed my first Go PR a few years back when I posted
| something new for rclone. He's super nice, indeed. Kudos Nick!
| barelyusable wrote:
| Love this tool. Along with Golang's Excelize library I use it to
| build a bunch of tools
| xanaxagoras wrote:
| Rclone is great! All of my duplicati backups go to S3, then in
| the run-script-after script rclone copies them from S3 to B2.
| bckygldstn wrote:
| Rclone is fantastic. It's much easier to use that most of the
| cloud storage APIs themselves.
|
| Plus rclone makes it easy to migrate between providers. I just
| moved a backup process from Gcloud to B2 now my side business is
| growing up: you can start with whatever storage is
| free/convenient then switch to something more mature later with
| minimal effort.
| artificialLimbs wrote:
| Hear hear.
|
| Been personally using for 1.5 years with Backblaze thanks to HN
| with _0_ problems. Have even done some restores succesfully!
| guilhas wrote:
| Is this a good multi threaded local/ssh alternative to rsync?
| throwaway999901 wrote:
| It is. Another good alternative is lftp.
| techisnotmagic wrote:
| I'm not sure why this bothers me so much but it does not "sync
| between cloud storage providers".
|
| I don't really know how this misunderstanding is so pervasive,
| even among the HN crowd, but no, no amount of magical code can
| make it possible to directly migrate between S3 and Google Drive.
| It's going to download, and upload to sync.
|
| This is even reflected in the project's description line, which
| is more accurate than the current HN headline: _Rclone ( "rsync
| for cloud storage") is a command-line program to sync files and
| directories to and from different cloud storage providers._
|
| That having been said, it's of course invaluable software.
| Mounting 10TB of Google Drive into a Raspberry Pi running Plex is
| still something that feels like it should be harder to accomplish
| than it is.
| divbzero wrote:
| I like rclone for the wide array of storage options [1] plus a
| special crypt remote [2] that provides client-side encryption for
| any of the other storage options. There is also a browser GUI you
| can spin up locally if that floats your boat [3].
|
| [1]: https://rclone.org/overview/
|
| [2]: https://rclone.org/crypt/
|
| [3]: https://rclone.org/gui/
| folli wrote:
| Since we're on the topic: Which cloud provider do you recommend
| for backup of personal files?
| nikisweeting wrote:
| Backblaze B2 has free ingress and egress (w/ Cloudflare) and
| the cheapest pricing that I know of per GB, but it looks like
| CloudFlare's block storage might be a competitor soon.
| k8sToGo wrote:
| Depends on the amount you have.
| rsync wrote:
| There is only one provider that _has rclone built into the
| platform_ : ssh user@rsync.net rclone sync
| s3remote:bucket path/path/dir
|
| So you can transfer directly between endpoints without using
| your own bandwidth.
|
| In fact, you don't even need to install rclone yourself - just
| run it, over SSH, at rsync.net.
|
| Here is a broad overview of using rclone with your rsync.net
| account:
|
| https://www.rsync.net/products/rclone.html
| vlmutolo wrote:
| $100/TB/month is significantly more expensive than the
| standard object storage options. Backblaze is $5/TB/month,
| for example.
|
| For personal file backup, you only need a fairly reliable
| object storage system. And Backblaze seems to be the
| cheapest.
| rsync wrote:
| Standard pricing is $25/TB/month.
|
| We have had a "HN reader discount" for many years ... just
| email and ask.
|
| If you're optimizing for price, I would suggest Backblaze.
| kingcharles wrote:
| Right now I'm using Dropbox, One Drive and iDrive, none of
| which are that great. I've looked at tons of others.
|
| Your prices aren't offensive, but they're not cheap.
|
| I have a need to store several terabytes of PDFs - mainly old
| magazines that are in the public domain, or where the
| copyright is essentially lost. Are your systems going to scan
| every item that gets uploaded and then erase my account and
| all my files if one PDF comes up as having a current
| copyright issue?
|
| I ask in all seriousness because this happens regularly to
| those of us on
|
| https://www.reddit.com/r/DataHoarder/
|
| see, e.g.
|
| https://www.reddit.com/r/Degoo/comments/iixlse/degoo_copyrig.
| ..
| rsync wrote:
| "Are your systems going to scan every item that gets
| uploaded and then erase my account and all my files if one
| PDF comes up as having a current copyright issue?"
|
| This is who we are:
|
| https://www.rsync.net/resources/notices/canary.txt
|
| We were the first provider to publish a Warrant Canary and
| it appears we're one of the few that still update it.
|
| So, no. No, we do not scan accounts for _any purpose
| whatsoever_. Please review our extremely short and simple
| privacy policy:
|
| https://www.rsync.net/resources/regulatory/privacy.html
|
| ... and do be in touch about the HN readers discount.
| lelandfe wrote:
| I like Backblaze because it works well on my Mac and I don't
| have to think about it. That's about all I want!
| rsync wrote:
| Here is a keystroke-by-keystroke HOWTO that we wrote last year:
|
| https://rsync.net/resources/howto/rclone.html
|
| and although the example is S3 <-> rsync.net, it is _not
| necessarily_ rsync.net-specific.
|
| You could use this HOWTO/workflow for any two targets.
| earthscienceman wrote:
| Do you contribute code to rclone?
| gary_0 wrote:
| Past discussions:
|
| https://news.ycombinator.com/item?id=12398303 (5 years ago)
|
| https://news.ycombinator.com/item?id=22791036 (2 years ago)
| stavros wrote:
| Rclone is excellent, I use it to deploy my static site to
| Neocities and it's worked excellently for ages.
| ehPReth wrote:
| Love this software, use it for everything from mounting cloud
| storage to syncing backups
___________________________________________________________________
(page generated 2021-12-03 23:00 UTC)