I wanted to reboot a Stockholm VM into an ISO. "Booting up" -> "Offline". Wanted to create a ticket. Now Cloudflare tells me cloud.hosthatch.com is down.
Storage server in Stockholm: pings over ipv4/v6, but otherwise unconnectable/unresponsive. The online console reveals a ton of error messages over the last few hours. Reboot/poweroff through the website fails. Host/hardware crash?
I am wondering if we're on the different nodes. No outage here and IPv6 is up & running. Last time was right the opposite. IPv6 was up for everyone except for me.
@beagle said:
My storage server in NL is down since 15:00 GMT.
Waiting for their response to my ticket.
Their response:
The host node your VM is being hosted on suffered from a hardware failure and we had to dispatch a technician to replace the RAID controller. It is now back online and we are continue to monitoring it closely. We are sorry for the inconvenience caused.
This is an important message regarding your server(s);
server (x.x.x.x) - Los Angeles
Due to a multi disk failure in the RAID50 array, we were not able to restore your Storage VM (mentioned above) to its previous state. Please login to your account at cloud.hosthatch.com and use the reinstall feature to start using it again.
We have moved your server to a node with RAID10 HDD storage at no additional cost, for better redundancy and performance of your VM in the future. We will also be issuing 30 days of credit to your account later this week.
Thank you for your understanding and we apologize for the inconvenience caused.
This is an important message regarding your server(s);
server (x.x.x.x) - Los Angeles
Due to a multi disk failure in the RAID50 array, we were not able to restore your Storage VM (mentioned above) to its previous state. Please login to your account at cloud.hosthatch.com and use the reinstall feature to start using it again.
We have moved your server to a node with RAID10 HDD storage at no additional cost, for better redundancy and performance of your VM in the future. We will also be issuing 30 days of credit to your account later this week.
Thank you for your understanding and we apologize for the inconvenience caused.
RAID10 ftw and they should have done this from the get go.
Looks like my Stockholm VM is off again (same problem as reported in this thread).
Reboots fail and console just 'Waiting' - panel shows as @ offline.
Power off and boot, panel showing VM offline
Also getting cloudflare timeouts when accessing https://cloud.hosthatch.com/
Comments
Isn't console the old panel that was supposed to be dead?
https://cloud.hosthatch.com/login
My server in Amsterdam is online.
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png
cloud.hosthatch.com
is up and so is my VPS (Netherlands)Both
cloud.hosthatch.com
and my VPS in Stockholm are accessible.At leat the console is up again, so I can create a ticket regarding the boot issue.
My storage server in NL is down since 15:00 GMT.
Waiting for their response to my ticket.
Storage server in Stockholm: pings over ipv4/v6, but otherwise unconnectable/unresponsive. The online console reveals a ton of error messages over the last few hours. Reboot/poweroff through the website fails. Host/hardware crash?
YAY DRAMA, BILLIONS LOST
edit: things are back
HH storage STO Confirmed downtime 18min according to hetrix, now back again
Sultan Muda - Amazon Store
Hetrixtools show 8 minutes downtime.
Seems to be an ipv6 issue again.
I don't monitor IPv6 uptime here (my bad, I should...) but right this moment when I saw your post and checked, IPv6 works for me.
Support replied they had a hardware failure in Stockholm.
Same here the StockHolm VM was unbootable from the panel yesterday. Seems to be fixed now but IPv6 is now broken.
I am wondering if we're on the different nodes. No outage here and IPv6 is up & running. Last time was right the opposite. IPv6 was up for everyone except for me.
Could have been related to the storage servers.
My E5 NVMe server has been up.
Ah, this would explain it. I don't have storage server there.
Indeed mine is a storage server in Stockholm.
Their response:
Storage server in SE back up, but IPv6 is now broken
Same here:
Update from HH LA storage server:
RAID10 ftw and they should have done this from the get go.
I bench YABS 24/7/365 unless it's a leap year.
Seems like bandwidth accounting does not work any more. Stockholm storage is stuck at 300mb and Amsterdam has not used anything yet.
It sounds like 80% of my VPSes :P
But I moved around 2 TB
IPv6 not working on the LA replacement server.
Opened a ticket on 27th and I'm still waiting for a response.
same too, that's too bad
Looks like my Stockholm VM is off again (same problem as reported in this thread).
Reboots fail and console just 'Waiting' - panel shows as @ offline.
Power off and boot, panel showing VM offline
Also getting cloudflare timeouts when accessing https://cloud.hosthatch.com/
Storage or NVMe package?
My NVMe VPS is up.
My Stockholm storage vm is also down.
Same here with storage, but seems up again.