Contemplating Dallas colo for storage, anyone interested
Lately I'm toying with the idea of setting up a server for cold storage (i.e. backups of backups) in one of the Dallas DCs. I'm wondering if anyone wants to do some cost-sharing. If I start with 48TB, it is probably around $1/TB/mo, but if I pack in 192TB (which I cannot use by myself) it goes down to more like $0.60-0.70.
Pros: new enterprise drives in RAID 5/6, KVM, pretty cheap (per TB), no exorbitant BW costs, flexible on config (this means you can use your own drives, send encrypted data via mail if you time it right, have your own RAID array or whatever).
Cons: this would be a bit older hardware (think 2x E5-2630 v3). So this is NOT for anyone who wants to run Plex with transcoding, CPU-based encryption, etc. No fancy SolusVM or DA control panel. No SLA - I am not your hosting company so it is not for you if you need 24/7 support or "five-nines" type uptime or will squeal if the ping is over 10 msec to your location.
Thoughts? Interest? At the moment still just contemplating the idea and haven't crunched it in detail, so no decision to do it yet.
Comments
I'm interested. Crunch some numbers please. Right now I have a box from Shock Hosting in Dallas I added 2x4tb that I'm paying $35 for. Maybe we can split this one as my storage needs have gone down? This box has a total of 10TB so that's like $3.5 per TB which isn't great as I would prefer something for $2 per tb or less. But it's got a dedicated 1270v3 with 32 GB of ram and I'm sure Shock will let me send them some different drives to swap out.
Definitely interested in about 6tb ish raid 6 (or raid z1/2 preferably) . Lmk final pricing if you proceed.
Recommended hosts:
Letbox, Data ideas, Hetzner
I am sure interested if I can get 4+TB storage with decent bandwith for <6$. Will be nice if I can run plex (will not be transcoding)
Need to see how much people want to store (on average). Putting 192TB into a HP Proliant DL380 in RAID5 works out to around $0.70/TB/mo. That colo plan has 5 usable IPs, so each person needs to take around 35TB on average (~$25/mo), otherwise there's an extra IP cost (~$1/IPv4/mo), IPv6-only, or some loss of efficiency.
If we go smaller, say a DL360 with 64TB, then we don't get the same scale and the per-TB cost becomes around $1.23/TB/mo, or (on average) around 10TB for $12/mo for 5 people.
That's all plus tax. Also depends what the arrangements are - I mean, I don't want to plonk down $600 for drives and then have someone cancel after a month leaving me stuck with unused drives, so we probably need to talk some type of setup cost sharing rather than just "per month".
Currently looking Equinix DA1, but that's just the "straw man" for pricing.
What is your definition of "decent"?
I might be interested in this, depending on the DC that you end up with.
Might make sense to be ipv6 only/nat ipv4 as its only meant to be backup storage. Cutting that cost would allow more users.
Recommended hosts:
Letbox, Data ideas, Hetzner
>
That's one inherent risk when doing something like this. Would need to be an understanding that if someone bails, the rest of the group would have to absorb the cost until someone else can step in to take their place.
Who are using for the colo and what is the monthly? joesdatacenter has some nice colo pricing with a /29 in KC for like $50 a month if Dallas isn't a hard point.
I would ideally like to avoid the ones used by the other VPS providers in case I end up with backups in the same building, but not sure how realistic that is. So probably not ColoCrossing, Dedipath, QuadraNet, Psychz. Currently looking Equinix DA1 or CoreSpace Dallas, but early stages.
That's a good comment. On the other hand more users is more admin and I don't want to become a hosting provider. I certainly don't want people taking 1TB here and there, that's an admin nightmare for me.
Yes. Personally I don't mind carrying the colo risk if people pay the pro-rata share of the drive purchase. So 4TB becomes something like $65 up-front and then $2.50-3.50/mo (equivalent) with no obligation. For that price, you'd potentially get something like 4-5 dedicated cores, 2.5GB RAM, 4TB HDD (based on splitting a DL360 into 12), which seems decent . Not everyone is in a position to do that up-front, so there's probably room to discuss something in-between.
Nothing fixed, still looking, but prices generally seem $30-35/mo range for 1U (e.g. LevelOne have this in Carrier-1) and $60/mo for 2U. Going to 2U can get 1Gbps unmetered. Dallas is a fixed thing for me.
Hmm, maybe. It doesn't have to be vps: borg or rsync is fine. I don't see a need for ip addresses, especially v4. v6-only or shared v4 is fine for this type of thing. Raid level should not be 5. raid-6 or zfs or (depending on how many drives) software erasure code all work. The cpus you mention are not too bad. You'd be buying the drives new? Would you require up front payment for 3 years or anything like that? How many drives in the box?
Actually this could be nice for initially backing up my laptop, if there is a usb port on the box. It would be great if I could send you a 256gb usb stick or sd card to plug in for a while. My home internet upload speed is slow enough that uploading that much isn't feasible for me.
I have 5TB in Hetzner Storagebox right now so I guess I'd want a similar amount with you.
A missile will destroy multiple data centers.
It might be safer to colo at @DataIdeas that is in Texas but not Dallas.
Very few VPS provides are in that city.
Accepting submissions for IPv6 less than /64 Hall of Incompetence.
Yeah, I suspect several people who only want to use borg would be happy sharing an IP address. But it would be good to have a shared IPv4 as not all the servers I want to back up have IPv6.
I'd be interested for borg, but I'd probably only need 1-2TB, so I'm not really in your target demographic anyway. I'd maybe take more if you could get the prices really cheap though.
If you can beat my 12Tb for $30 with HostHatch am in
Doesn't have to be a VPS: true, but the server still has a cost to be spread around even if the resources are idle. So either we allocate the resources, or leave them shared. Giving people the option (dedicated or shared) is also fine; just means that there's more need for some "AUP" (even if informal) to ensure everyone gets a fair go. Same with IPs. Open for discussion.
RAID: it is a backup of a backup of a backup for me, so RAID5 keeps the cost down. If there's 4 drives then going to RAID6 means 2 data drives instead of 3, so the "cost/usable TB" goes up 50%. If there's 12 drives then OK, it is pretty marginal. So it depends a bit on the demand. As said above, I'm not looking to become a host and certainly don't want to deal with 100 people (think 1/10 of that, absolute max) and based on the comments so far we're looking at less than 10TB/person.
Drives would be new enterprise drives from a known brand (WD, Seagate, Toshiba, ...) with a 5-year warranty (2.5M hr MTBF). I allowed for a few replacements at cost, but generally I'm assuming the manufacturer stays in business and would honor the warranty, thus averaged the cost over 60 months. I could get a refurb DL360 with 4- or 8-bays (1U), or a DL380 with 12 bays (2U). Don't necessarily have to populate all the bays up front (but will need 3-4 depending on RAID).
Payment: open for discussion, but see previous comment. Drives are the largest cost. For 4TB, the "share" of the drive cost would be around $80 (depends on RAID level etc.) and the drive life is 5 years. One option is an up-front cost like $80 then a much smaller (like $2.50-3.50) monthly cost. After 5 years the amortization is basically zero and do it again with the then-current specs. People could also potentially get some lesser amount of TB and then pay a further share as they add more (i.e. pay as the drives are purchased). I'm open to a lower up-front cost (within reason) but that kind of equates to everyone else giving financing for drives and taking on the risk.
I'm very open to this, assuming data is encrypted etc. From memory the DL360 has 3 USB slots. Would kind of prefer it to having everyone saturate the network 24/7 for the first X months. The main constraint would be timing - needs to be before the thing is taken to the DC.
Dallas is fixed, so if someone is worried about a missile then they should pass on this.
$2.50/TB is beatable. I guess HH got you to prepay for a year or two (which funded the drive purchase).
More generally (for everyone): As mentioned, this would be a "cost sharing" project - I'm not a hosting company and don't have any SLA or 24/7 support, so if you're comparing with your current host remember that is a cost for them. But in some cases I might not have a disadvantage
Nah it’s monthly, I want out though. Would be happy to pre pay x amount of months too
Probably a bit on the low side, but maybe keep an eye on how it develops. Do you have a target for "really cheap"? I suppose at some price point it 4TB becomes cheaper than 1TB somewhere else.
Given you don't want to become a host I'd probably reccomend not selling this as a vps and just selling straight storage. Easier to manage and you won't have to eventually deal with the headache of who did what download of kiddie porn or other questionable activities. Especially if there is shared risk involved where the group eats the startup cost of the drives having potential liabilities ain't great.
Recommended hosts:
Letbox, Data ideas, Hetzner
StorageBox is monthly and is about $2/TB. The SX dedi line is a little bit out of whack starting at €1.44/TB/m for raw storage, but the last refresh was in early 2021, right in the middle of the Chia lunacy iirc. So maybe another refresh is due.
I see, I'd want to get the USB thing back after the data is tranferred though? I guess the transfer could happen during pre-deployment testing.
Whenever I've done the math on this kind of thing in the past, it's been hard to beat Hetzner, especially counting avoiding the hassle of mucking around with the hardware. Right now Hetzner is a little worse but with any luck they will resync soon.
Where are you located (general region) if I can ask? Near Dallas?
Those concerns are real. I don't look at it as "selling" at all, I look at it as cost-sharing amongst a restricted/invite-only group. So to be clear there will be no "ordering" web site and yes, there will be discrimination based on things like having a LES account for some period of time/some type of reputation, and there will be a restriction on the number of users to reduce the statistical probability of some idiot slipping through. There's a bit of trust involved in both directions.
Yes, assuming you are in the US then I don't see much of a problem.
I'm not keen on doing this for fun, so if a better option comes up then I'd take it and encourage everyone else to do likewise.
The problem for me is that getting the $/TB to a reasonable point generally requires a higher volume than I need (I'm happy with 10TB, myself). I'm actually already running a DL360 with 2x4TB + 2xSSD at home which amortizes to about $2/TB/mo (obviously no colo charge, but also pretty low density) and my server load is like 0.00 - it is totally underutilized.
DFW area.
Small note, Hetzner Auction has much better storage deals with no setup fees starting at 1 euro per TB.
https://www.serverhunter.com/#sort=price_per_hdd_capacity&sort_dir=asc
I am a representative of Advin Servers
It is a good point. A few "gotchas": the price/TB does not take RAID into consideration as I've been doing, so if you take that 4x10TB server and put it in RAID6, the price per TB is doubled.
You also only get that price with 20TB+. If the question is asked differently, "what is the cheapest for 10TB (usable) in RAID1/6/10" then the answer with the Hetzner auctions is "over $40" which isn't so great.
But maybe the answer for a lot of people is to stick with Hetzner, or at least stick with them if you want 20TB+.
Seems like the interest level here (with limited samples) is more around the 4-8 TB level.
Based on what people have said so far, see if this "straw man" outline sounds interesting.
Start-up:
Ongoing:
Admin:
So if you add the up-front cost to the ongoing cost, it is in the range $0.83-$1.61/TB/mo for RAID6 depending how densely the server is configured, with some reasonable (4TB?) minimum.
That's just for a proposal to gauge the reaction. I've made assumptions which could turn out to be off the mark.
If you were doing this for fun, I would have researched and provided some options, but since you aren't, I'll just come out and say it: Don't do it.
It will be far more trouble than it's worth: you only need 10TB, and the difference between your rate (0.6$) and the market rate (2.0$, ServaRica) means you'll save a grand total of 14 dollars, which is roughly an okay McD meal.
If you need a storage VPS, go for ServaRica BF Offers (2TB at 4$ or 3.5TB at 7$, paid annually).
Otherwise, get decent cloud storage at a discount:
MS OneDrive: Get 4 * MS 365 Personal 15-month subscriptions at 4 * 60$, redeem on MS website, add a month of MS 365 Family at 10$. 250$ gets you 6TB of storage for 5 years and 1 month.
Google Drive: CryptoRefill/BitRefill, get Turkey gift card to use Turkey's discounted pricing.
Fair comments; I already have Servarica and that's great but don't want to put all my eggs in one basket with them. Not willing to use MS or Google. I'm also looking at shutting down several other VMs which I currently am spending a few hundred on per year. For me this isn't "just" cheap storage.
The Hetzner alternative that Advin mentioned might be feasible though. It isn't in the US which is a limitation.
I haven't been following happenings in HD costs but this impressed me:
https://www.newegg.com/red-plus-wd120efbx-12tb/p/N82E16822234466
WD Red 12TB drives for $220 minus a $40 promo code = $180, so $15/T.B (T.B separated by a period is my abbreviation for decimal terabytes, i.e. 1e12 bytes). They are consumer drives with 3 year warranty but that is still under $.50/T.B/month.
Using 12 drives with raid-6 (2 parity drives), I get: 12T.B=10.9 TiB. 12 drives in box minus 2 parity = 10x10.9TiB=109 TiB in box. $2160 drive costs split over 36 months = $60/month, so $0.55/TiB/m for disk drives. Obviously that ignores the server cost and colo cost. And it would be lower if computed by 5 years, but 3 years may be more realistic given the still ongoing decreases in drive costs.
I'm not sure why use enterprise drives. Backblaze and seemingly other big users have consumer drives and just swap them out when they have to.
The Hetzner auction servers (15x 10TB drives for $118/month) are actually very attractive compared to this, enough to put me close to the "don't do it" camp. With two parity drives that is $1/TiB/month but that includes the entire server with beefy cpu and lots of ram, hosting, no setup fees, etc. Maybe we should be talking about splitting up one of those servers instead of this colo idea. With THREE parity disks it's $1.08/TiB/m. Hard to resist. (Edit: fixed some wrong numbers).
More bandwith than storage. Double/Triple would be awesome. Ready to reduce a bit of storage space for more bandwith
@tetech
If you're set on direct access to the HDD, these seem to be your options:
A Hetzner Auction server (storage servers seem to start around 33 euros, and the biggest ones go below 1e/TB)
Server-Factory storage VPS (2e/TB for NAT on multi-year payments)
PulsedMedia and HostHatch offers, when available.
If cloud storage (with RClone encryption) is feasible, you have GDrive and OneDrive, and smaller options like 1Fichier, Mega.nz etc.
Do you mean monthly? Idk how the economics works out but this storage is imagined as pure cold backups, I think. So there's not really a way to use bw=3x storage for the intended purpose and even 2x seems hard.
For colo'ing something an LTO tape drive would be really nice if they weren't so durn expensive.
All the said providers aren’t doing storage in Dallas, that was my main interest point