Miami is offline since an hour ago. Operation Timed Out After 90001 Milliseconds With 0 Bytes Received
I don't know which node because my records are stored in Seafile hosted on this node.
I can't peek into the backup server because the decryption key is stored in Seafile.
Something's wrong with my backup arrangement.
Update: found an unencrypted backup of my notes.
It's MIAZ011.
Priority Ticket #225283
We accept Karma donations for the last flan. 🍮 affbrr
MIAZ011: the host operating system may be corrupt. We're still attempting to bring the server back online but may need to proceed wit emergency migrations.
So, everyone is dead, all data is lost?
We accept Karma donations for the last flan. 🍮 affbrr
I expect you already know the answer to this question ....
Specials have low prices, but limited extra features.
All of my non limited special (aka regular) VMs are full featured, with all the buttons. So if you want these options they are available at a slightly higher price point.
@yoursunny said: MIAZ011: the host operating system may be corrupt. We're still attempting to bring the server back online but may need to proceed wit emergency migrations.
So, everyone is dead, all data is lost?
Having a hard time with this one, mainly limited on time since everything happened all at once again and ASRock IPMI being not great. Data corruption is on the OS drive, not the volume that holds customer's VM data, at least seems that way so far. I've had to work on other things for last few hours but hopefully can resume on this soon.
This server has way too many drives so we'll be able to get it back up in any case without hardware replacements. I don't know how the hell this happened but it has 4x2TB NVMe on a riser, 2x2TB NVMe on M.2 slots, and 3x 1TB SATA SSDs. I guess I had fun with this one.
(edit) Which is kind of funny now that I think about it because one of the servers in Miami has a lack of drives. I wonder if that's related. It actually may be... I think one or two of them came from HV so maybe the riser got placed into the wrong server. Anyway that's a problem for another day.
Small question @VirMach, with those 6 NVMe configurations, did you ever experience drives just randomly dropping out on X470/X570 boards? I've tested a few configurations with 4 x 500GB Gen4 NVMe on the riser and 2 on the motherboard on various motherboards and setups, but they just kept on dropping out for absolutely no reason whatsoever, at random, and then they would magically reappear after a reboot. I've heard 1 or 2 other providers/people with the exact same issue :'(
@yoursunny said: Now I hope the VM data is lost, so I can read drama threads.
Looks like your wish may be coming true, to some degree.
It's all over the place, might be the motherboard at this point or any other part connected to the motherboard. That's how far I've narrowed it down (that's a joke.) NIC is going haywire, IPMI is giving me continued troubles, all the disks are being whacky so it can't just be a disk failing.
(edit) Okay I finally figured it out, it's two separate issues presenting as a third. And each of those might also be as a result of two separate sub-issues. This is going to be fun, definitely going to just try to get the data off and abandon ship unless a miracle happens but just getting the data off might be the miracle. I don't even know how to explain it without it being extremely convoluted so I'm not updating network status for now.
@VirMach said: .. requires a final touch and reboot.
That's a slow reboot!
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural. It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
@yoursunny said:
Miami is offline since an hour ago. Operation Timed Out After 90001 Milliseconds With 0 Bytes Received
I don't know which node because my records are stored in Seafile hosted on this node.
I can't peek into the backup server because the decryption key is stored in Seafile.
Something's wrong with my backup arrangement.
Update: found an unencrypted backup of my notes.
It's MIAZ011.
Priority Ticket #225283
You should make a backup of backup of backup server.
@VirMach said: The reboot was completed, is your service not online?
I don't have one on that node. You had just gone all quiet, after your flurry of activity
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural. It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural. It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
I've been extremely happy with the CPU, network speed, and uptime of my Virmach NVMe2G:
Not going to say just what node it is on because don't want to jinx it but - it's above the equator
@AlwaysSkint said:
What's with the Retired tag? Retired CW?
@vyas asked to have his account retired as he wants to scale back and reduce his online time/footprint a bit. He is always welcome to return, should he desire to. Going to miss him dearly and I hope we see him return before long
@taizi said:
website is weird,i ask me relogin so fast that i even don't have time to reply a ticket...
This is maybe the 2nd report of this, I'm not sure if the other report was from you or another but I do know the other case the person had multiple accounts. So it seems like it's related to multiple accounts, or likely.
@Encoders said: I moved my dns to virmach. it's been up more than 2 month without issue in TYO. very suspicious, the fuckening is near
Yeah it's suspicious for me too. I don't want to get my hopes up and actually I won't say anything to jinx it.
me too, but i don't login at the same time(even not in the same browser), what issue will occur?
also,i also have to do cloudflare captcha again, but because my VPN has autoswitch, still need to confirm it isn't because the ip changed.
So did you have multiple accounts?
the legacy issue, I created a service transfer request half a year and a half ago, and it finally finished two days ago.
the last issue is I sent the incorrect amount(binance minus 1 for network fee) in a coinbase invoice two months ago,i will request to delete the account after this ticket finished, since the account is too dangerous to give back to original owner(unknow flags).
@VirMach I think I'm officially the last person still waiting for their flash sale server.
$12.95 / year
KVM - 1 GIGABIT
2253 MB RAM
2 x FAIR SHARE CPU vCORE
40 GB SSD (NVMe)
4096 GB BANDWIDTH
NYC METRO, NJ LOCATION
1 DEDICATED IPv4
@Mumbly said:
I see also two nodes in .de and one in .nl atm down.
This looks like a network issue affecting multiple VirMach locations. ~~I can't connect to my VM on DALZ010 , but it is running when I connect via VNC so probably not hardware failure, which is good~~.
Dallas is working again.
I am not sure if that's connected but my only VPS which is up is the one in NJ who doesn't use 47.87.* IP subnet. Also xTOM IPV6 in .de respond to the ping, just Zenlayer/Alibaba IPv4 doesn't.
@Mumbly said:
I am not sure if that's connected but my only VPS which is up is the one in NJ who doesn't use 47.87.* IP subnet. Also xTOM IPV6 in .de respond to the ping, just IPv4 doesn't.
I just checked and I have seven VMs that are not on 47.87.*, all are reachable.
I cannot reach my EU VMs in Amsterdam and Frankfurt from the interwebs, but I can get to them from a 47.87.xx.xx VM in Dallas.
Comments
Weekly check whether Virmach ran away.
Why flash special can not be migrated!
Ontario Dildo Inspector
Miami is offline since an hour ago.
Operation Timed Out After 90001 Milliseconds With 0 Bytes Received
I don't know which node because my records are stored in Seafile hosted on this node.
I can't peek into the backup server because the decryption key is stored in Seafile.
Something's wrong with my backup arrangement.
Update: found an unencrypted backup of my notes.
It's MIAZ011.
Priority Ticket #225283
We accept Karma donations for the last flan. 🍮 affbrr
MIAZ011: the host operating system may be corrupt. We're still attempting to bring the server back online but may need to proceed wit emergency migrations.
So, everyone is dead, all data is lost?
We accept Karma donations for the last flan. 🍮 affbrr
I expect you already know the answer to this question ....
Specials have low prices, but limited extra features.
All of my non limited special (aka regular) VMs are full featured, with all the buttons. So if you want these options they are available at a slightly higher price point.
By the way how did your exam go ?
Having a hard time with this one, mainly limited on time since everything happened all at once again and ASRock IPMI being not great. Data corruption is on the OS drive, not the volume that holds customer's VM data, at least seems that way so far. I've had to work on other things for last few hours but hopefully can resume on this soon.
This server has way too many drives so we'll be able to get it back up in any case without hardware replacements. I don't know how the hell this happened but it has 4x2TB NVMe on a riser, 2x2TB NVMe on M.2 slots, and 3x 1TB SATA SSDs. I guess I had fun with this one.
(edit) Which is kind of funny now that I think about it because one of the servers in Miami has a lack of drives. I wonder if that's related. It actually may be... I think one or two of them came from HV so maybe the riser got placed into the wrong server. Anyway that's a problem for another day.
@VirMach
Thank You!
Made my day happy with the rDNS option
The rDNS settings worked on SolusVM panel for one of my VM's IP from 47.87.226.XX range
Regarding MIAZ011 with a Ryzen 5950x, 128 GB RAM, 15TB NVMe/SSD there must be some mighty strange plans on that node.
Next flash sale ....
Knowing VirBot, it'd probably end up being more like...
Small question @VirMach, with those 6 NVMe configurations, did you ever experience drives just randomly dropping out on X470/X570 boards? I've tested a few configurations with 4 x 500GB Gen4 NVMe on the riser and 2 on the motherboard on various motherboards and setups, but they just kept on dropping out for absolutely no reason whatsoever, at random, and then they would magically reappear after a reboot. I've heard 1 or 2 other providers/people with the exact same issue :'(
I am a representative of Advin Servers
I spent all night restoring Seafile onto another server.
No data was lost in Seafile.
Now I hope the VM data is lost, so I can read drama threads.
We accept Karma donations for the last flan. 🍮 affbrr
Looks like your wish may be coming true, to some degree.
It's all over the place, might be the motherboard at this point or any other part connected to the motherboard. That's how far I've narrowed it down (that's a joke.) NIC is going haywire, IPMI is giving me continued troubles, all the disks are being whacky so it can't just be a disk failing.
(edit) Okay I finally figured it out, it's two separate issues presenting as a third. And each of those might also be as a result of two separate sub-issues. This is going to be fun, definitely going to just try to get the data off and abandon ship unless a miracle happens but just getting the data off might be the miracle. I don't even know how to explain it without it being extremely convoluted so I'm not updating network status for now.
Okay so issue 1 out of 4(?) resolved. Progress.
@yoursunny sorry no drama, everything fixed, data intact.
(edit) Oh wait requires a final touch and reboot.
That's a slow reboot!
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural.
It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
You should make a backup of backup of backup server.
/Jk
https://microlxc.net/
You scared me for a second, I thought it had already crashed again. The reboot was completed, is your service not online? Seems operational.
Great news! VirNerd reported lots of bad reviews in trustpilot. Yeah!
Hey FFME002 has been really stable these past weeks.
Keep up the good work Vir!
https://microlxc.net/
I don't have one on that node. You had just gone all quiet, after your flurry of activity
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural.
It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
Thank you @VirMach for the "Refugee" transfer for Stormonic VPS.
I had a 2 year plan- but you did it anyways.
Logged on to acknowledge what you are doing for the community.
Thanks and best wishes.
blog archives
What's with the Retired tag? Retired CW?
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural.
It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
production
I bench YABS 24/7/365 unless it's a leap year.
I've been extremely happy with the CPU, network speed, and uptime of my Virmach NVMe2G:
Not going to say just what node it is on because don't want to jinx it but - it's above the equator
More Tokyo deals please!
VirMach: Customer’s Service cannot use more than 10% of the monthly allocated bandwidth in under twenty-four (24) hours.
https://virmach.com/terms-conditions/#aup
@vyas asked to have his account retired as he wants to scale back and reduce his online time/footprint a bit. He is always welcome to return, should he desire to. Going to miss him dearly and I hope we see him return before long
yabs daddy
website is weird,i ask me relogin so fast that i even don't have time to reply a ticket...
I moved my dns to virmach. it's been up more than 2 month without issue in TYO. very suspicious, the fuckening is near
Fuck this 24/7 internet spew of trivia and celebrity bullshit.
i want to use TYO too, but yeah very eerily stable.
I bench YABS 24/7/365 unless it's a leap year.
This is maybe the 2nd report of this, I'm not sure if the other report was from you or another but I do know the other case the person had multiple accounts. So it seems like it's related to multiple accounts, or likely.
Yeah it's suspicious for me too. I don't want to get my hopes up and actually I won't say anything to jinx it.
me too, but i don't login at the same time(even not in the same browser), what issue will occur?
also,i also have to do cloudflare captcha again, but because my VPN has autoswitch, still need to confirm it isn't because the ip changed.
So did you have multiple accounts?
I am a representative of Advin Servers
the legacy issue, I created a service transfer request half a year and a half ago, and it finally finished two days ago.
the last issue is I sent the incorrect amount(binance minus 1 for network fee) in a coinbase invoice two months ago,i will request to delete the account after this ticket finished, since the account is too dangerous to give back to original owner(unknow flags).
@VirMach I think I'm officially the last person still waiting for their flash sale server.
$12.95 / year
KVM - 1 GIGABIT
2253 MB RAM
2 x FAIR SHARE CPU vCORE
40 GB SSD (NVMe)
4096 GB BANDWIDTH
NYC METRO, NJ LOCATION
1 DEDICATED IPv4
Good bye old friend.
Is TYOC007 offline?
yes.
EDIT: Additionally, I am seeing eight nodes in NYC and the three in Miami that show issues.
EDIT2: Down in Atlanta as well
I see also two nodes in .de and one in .nl atm down.
This looks like a network issue affecting multiple VirMach locations.
~~I can't connect to my VM on DALZ010 , but it is running when I connect via VNC so probably not hardware failure, which is good~~.
Dallas is working again.
Seattle and Chicago flapping as well
The Ultimate Speedtest Script | Get Instant Alerts on new LES/LET deals | Cheap VPS Deals | VirMach Flash Sales Notifier
FREE KVM VPS - FreeVPS.org | FREE LXC VPS - MicroLXC
Intermittent connectivity on Los Angeles (LAXA031). Can't ping my machine from different locations and connecting outbound to some servers fail.
There is some network/routing issue with Germany location?
Anyone with same experience?
https://i.imgur.com/dt4JrTn.png
https://i.imgur.com/UFBrhzD.png
From what I see at https://status.virm.ac
All the nodes in Frankfurt and Amsterdam are affected.
Uptimerobot shows multiple European vps down, but they are actually up - but seem not to be reachable from some networks.
is this part of virmach network upgrade?
I bench YABS 24/7/365 unless it's a leap year.
Could be, but if that is it, I expect one of the VirMach minion fat fingered something, badly.
LAXA009
https://imgur.com/a/yDNwGXM
VirMach: Customer’s Service cannot use more than 10% of the monthly allocated bandwidth in under twenty-four (24) hours.
https://virmach.com/terms-conditions/#aup
I am not sure if that's connected but my only VPS which is up is the one in NJ who doesn't use 47.87.* IP subnet. Also xTOM IPV6 in .de respond to the ping, just Zenlayer/Alibaba IPv4 doesn't.
@FrankZ are your non 47.87.* VPSes affected?
My VPSs in Buffalo, NY are also down. Can't SSH.
Powerful AMD Ryzen VPS (aff)
I just checked and I have seven VMs that are not on 47.87.*, all are reachable.
I cannot reach my EU VMs in Amsterdam and Frankfurt from the interwebs, but I can get to them from a 47.87.xx.xx VM in Dallas.
This sounds likely. I have 2 uptime Kuma on ovh and multacom. Not reachable from ovh, hetrix and sites via cloudflare. But pinging from Multacom fine.
The Ultimate Speedtest Script | Get Instant Alerts on new LES/LET deals | Cheap VPS Deals | VirMach Flash Sales Notifier
FREE KVM VPS - FreeVPS.org | FREE LXC VPS - MicroLXC