@msatt said:
AMSD018 Looks like the disk has gone walkies....
Swap went read only, reboot
Boot failed: could not read the boot disk
Edit - another server in AMSD018 is working so just a VM issue.
Likely one disk having issues, I’ll have a look once I’m back from the datacenter.
I need to do a round of abuse cleanup for that location, I already have an idea of what likely happened. (There’s this one guy that really likes that location and mass orders across multiple accounts.)
@msatt said:
AMSD018 Looks like the disk has gone walkies....
Swap went read only, reboot
Boot failed: could not read the boot disk
Edit - another server in AMSD018 is working so just a VM issue.
Likely one disk having issues, I’ll have a look once I’m back from the datacenter.
I need to do a round of abuse cleanup for that location, I already have an idea of what likely happened. (There’s this one guy that really likes that location and mass orders across multiple accounts.)
Yep - other VM has also just failed id=722545 and id=722166 timeout accessing control panel.
Enjoy your cleanup
No panic.
With that kind of monies I would run dedi and didn't suffer HDD speeds on my backup server.
Fuck HDD speeds.
Someone sell me big SSD for nothing as I am still waiting for my big SSD from @crunchbits
Thanks virmach - both working again.
How is the clean up going....
id=722166 Has gone read only again, assume the disk is still having issues or the clear up is ongoing. Expect other VM will be going soon (tm virmach). No panic, just let you / others know AMSD018 is not feeling well.
@matcha said: @VirMach NYCB037 down since last month, do you have any idea?
I'm aware. It's fully dead and every option requires more coordination/planning than usual, so unfortunately I keep postponing and losing track of time.
I'm glad I found this thread, and that I realized my plans were on NYCB037 as well. Seeing my tickets sit in "AI Assisted" state for a month with no response was rubbing me the wrong way - but now that I can see a human actually has a plan I feel much calmer
We cannot load the controls for your service at this time.
This could either mean:
A) It took too long to load. The server controls have been automatically disabled due to an anomaly.
C) The server could be offline, in which case we have already been notified.
Limited Controls
We're currently experiencing communication issues with the server management system. Basic information is displayed below. Full controls will be restored once connectivity is re-established.
@msatt said:
AMSD018 controls are still locked out .... Do we have a major problem?
To keep it stable. It'll likely need some scheduled maintenance but I'm trying to avoid turning it into anything worse right now. I'm cautiously unlocking controls now.
FYI, if you are not having fun, it's time to pick up a new job
Some have this thing where "fun" very often involves having a bad week. The person everyone depends on sometimes finds that that job is the most fulfilling (or fun). It is sometimes all to easy to wonder why one is made that way, but then the prospect of being bored feels worse.
We have temporarily paused controls for this service as we are performing maintenance on the server.
Please check back later.
This usually means we are aware of a problem and working to resolve it, or have purposefully temporarily removed controls to prevent potential issues with your service while we work on it.
Anyone else on this node facing issues? Been like this over a week. Sigh
Comments
Likely one disk having issues, I’ll have a look once I’m back from the datacenter.
I need to do a round of abuse cleanup for that location, I already have an idea of what likely happened. (There’s this one guy that really likes that location and mass orders across multiple accounts.)
Yep - other VM has also just failed id=722545 and id=722166 timeout accessing control panel.
Enjoy your cleanup
No panic.
PAAAAAAAAAAAAAAAAAAAAAANIC
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png
Everybody put your hands up!
Thanks virmach - both working again.
How is the clean up going....
With that kind of monies I would run dedi and didn't suffer HDD speeds on my backup server.
Fuck HDD speeds.
Someone sell me big SSD for nothing as I am still waiting for my big SSD from @crunchbits
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png
Virmach storage servers are fast... I think.
Well mine is fast.
Possible, but VirMach storage servers are on the other side of Pond so they were no go for me :-D
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png
My vps in OKC has 81days uptime, still going strong.
id=722166 Has gone read only again, assume the disk is still having issues or the clear up is ongoing. Expect other VM will be going soon (tm virmach). No panic, just let you / others know AMSD018 is not feeling well.
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png
For some reason, I can't connect to my new dedi using any of my two VPN servers.
Weird.
It's not Proxmox blocking it. I've booted grml and it's the same story.
a week ago,i can't open dedi panel with some of my hong kong ip,but the connection to the dedi itself was fine
Seems like someone was playing around with region blocking
Never make the same mistake twice. There are so many new ones to make.
It’s OK if you disagree with me. I can’t force you to be right.
@VirMach are you still doing mtce on AMSD018 as controls are still locked out (just incase you forgot
)
I'm glad I found this thread, and that I realized my plans were on NYCB037 as well. Seeing my tickets sit in "AI Assisted" state for a month with no response was rubbing me the wrong way - but now that I can see a human actually has a plan I feel much calmer
@VirMach
We cannot load the controls for your service at this time.
This could either mean:
A) It took too long to load.
The server controls have been automatically disabled due to an anomaly.
C) The server could be offline, in which case we have already been notified.
Limited Controls
We're currently experiencing communication issues with the server management system. Basic information is displayed below. Full controls will be restored once connectivity is re-established.
Last Node: LAXA017
Viirrrrrmaaaaaaaaaaaaaaaaaaaaaaaachh
IPPPPPPPPPPPPPPPPPPPs
AMSD018 controls are still locked out .... Do we have a major problem?
Depends on your definition of "we" I think. I don't. :P
Is @virmach alive?
Where is @FrankZ?
@FrankZ was last seen April 1, 2025, so I am guessing either busy or dead.
@VirMach, well, i guess if he has not buried himself in the new servers he got, should be out there configuring them?
Never make the same mistake twice. There are so many new ones to make.
It’s OK if you disagree with me. I can’t force you to be right.
@VirMach RYZE.TYO-C005.VMS
May I ask how long it will take for Node 5 in Japan to recover? It hasn't been used for two months.
Ticket ID? The node should be fine so it's likely an issue with your VPS.
Having a bad week, the usual.
To keep it stable. It'll likely need some scheduled maintenance but I'm trying to avoid turning it into anything worse right now. I'm cautiously unlocking controls now.
Finally ready. I'll try to get these to you guys today or tomorrow. I'm still probably going to be pretty quiet here for a few more days.
OMG! He isn't dead!
FYI, if you are not having fun, it's time to pick up a new job
Never make the same mistake twice. There are so many new ones to make.
It’s OK if you disagree with me. I can’t force you to be right.
Some have this thing where "fun" very often involves having a bad week. The person everyone depends on sometimes finds that that job is the most fulfilling (or fun). It is sometimes all to easy to wonder why one is made that way, but then the prospect of being bored feels worse.
Oh no! What happened?
OK it will be tomorrow 😃
@VirMach
Last Node: LAXA017
We have temporarily paused controls for this service as we are performing maintenance on the server.
Please check back later.
This usually means we are aware of a problem and working to resolve it, or have purposefully temporarily removed controls to prevent potential issues with your service while we work on it.
Anyone else on this node facing issues? Been like this over a week. Sigh
OK maybe maybe tomorrow 😜