Data to S3 - google or s3 which one is cheapest?
Looking for bash script/sotfware or anything which can transfer data from Google Drive (2TB) to S3 storage. In short, with automation.
Another question: Google Drive (2TB, $10/month) or AWS-S3 (2TB) (which one is cheapest)
Please recommend and give your suggestions.
⚆ ͜ʖ ͡⚆ Thanked by (1281): verjin
Tagged:
Comments
Rclone?
https://forum.rclone.org/t/make-a-copy-of-folder-on-google-drive-using-rclone/11259
I am using rclone since years and was not sure if its able to do or not but thanks for reminding.
Correct link is this https://forum.rclone.org/t/copy-files-from-google-drive-to-s3/8711
⚆ ͜ʖ ͡⚆ Thanked by (1281): verjinUpdate: Transfer looks good. Rclone is
⚆ ͜ʖ ͡⚆ Thanked by (1281): verjinWasabi is the cheapest S3 compatible storage provider. Just $6 per TB/month. No egress costs.
https://wasabi.com/cloud-storage-pricing/#three-info
LinuxFreek.com
Agree on Wasabi. Use it daily, using restic on all of my servers.
https://restic.net/
Just use gsuite for business?
Note that wasabi has a 90 day retention policy on data. So any data written to them will have a minimum charge of 90 days even if it's deleted. After 90 days any data removed won't be charged. This isn't a big deal for backup but should be remembered regardless of use case also the egress is basically a monthly limit on the amount your storing. So if it's 1tb it's 1tb of egress a month before they "warn" you. I don't know how much of a hard limit that egress is but it's now noted on their site. They are still worth consideration though. Honestly a good backup use case would be both wasabi and another location/company as a two company two data Center redundancy.
Didn't know, good addition! Thanks
LinuxFreek.com
Works a lot cheaper than B2
blog | exploring visually |
Again though you have to remember the 90 day billing cycle on new data which B2 doesn't have. I believe they bill for day on the day.
https://wasabi.com/cloud-storage-pricing/pricing-faqs/#:~:text=With Wasabi minimum storage retention,using Wasabi's RCS pricing model
Also please be aware Wasabi's uptime record isn't good compared to B2, S3 or Google.
Wasabi was a mandatory dependency of our provisioning system but we moved to self-hosted minio last month to get rid of frequent performance issues and downtime :-(
Misaka.io | Blazing fast AnyCast DNS with 60+ POPs GeoDNS, AXFR, DNSSEC supported.
And Reliable high-performance virtual server | Ashburn, New York, Seattle, San Jose, Hong Kong, Tokyo, Singapore, São Paulo, Johannesburg
ping.sx | Ping any server from global locations in parallel
Scaleway offer 75GB free S3 storage and 75GB outgoing traffic.
Their datacenters are located in Amsterdam and Paris.
https://www.scaleway.com/en/object-storage
Interesting. Which data Center location were you using? Also how's minio been treating you? Did you use a cluster in one location or cluster over multiple locations? Or single system stored locally?
I have some atom nucs and tempted to try out a 12tb raid 1 setup now that 12tb drives are actually affordable
was us-east-1 then us-east-2 after the two-weeks-long outage.
We've moved to a 3-node cluster in Reston over our own VM platform. So it's a single location.
Misaka.io | Blazing fast AnyCast DNS with 60+ POPs GeoDNS, AXFR, DNSSEC supported.
And Reliable high-performance virtual server | Ashburn, New York, Seattle, San Jose, Hong Kong, Tokyo, Singapore, São Paulo, Johannesburg
ping.sx | Ping any server from global locations in parallel
Nice! How's performance and reliability been with minio? Do you have all the same size drives or mix and match?