What are the chances that those new IPs gonna be perm IPs and we won't go back to Alibaba next day(s)?
What are the chances that Alibaba thing will work again within next let's say 12 hours?
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
@Jab said:
What are the chances that those new IPs gonna be perm IPs and we won't go back to Alibaba next day(s)?
What are the chances that Alibaba thing will work again within next let's say 12 hours?
Frankfurt and Amsterdam will remain as such. We will not switch them back.
Also I found out what caused all this to happen in the first place... this was the old bank that they switched abruptly so I guess it's not their fault either, and I finally got a confirmation from our bank that they "rejected" the payment multiple days after it was supposed to complete to the new one. They finally replied 20 minutes ago or so and trying to arrange the new payment now.
@VirMach said: Frankfurt and Amsterdam will remain as such. We will not switch them back.
So time to update my DNSes and configs, sad
But thanks for answer.
@ehab said: @VirMach i hope you didn't loose money from SVB adding to the list on the ice-berg?
I think VirMach said that the company they lease IPs is (was ) using SVB and after the switch few days ago (or earlier) theirs new bank returned all payments from VirMach bank... so VirMach not in SVB, I would assume.
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
@Jab said:
Wait, I can start ticket for each of my affected services and get SLA credits - grand total of 0.02$?!
Mmmmmm
Your ticket would be closed as "mass issue" and there's no SLA credits.
This was what happened to my MIAZ011 ticket last week.
Oof. This happened to me as well. SJCZ010 was network unreachable for a period but then came back online. Got closed for mass issue and not sure about SLA credit for 2 services there.
Love ya VirMach but these service outages are killing me!
hello, man, u still alive?
i hope you are well and family is good.
you should be more active, at least in LES, we all have our pants down so you can feel at home
ehab
ps: edited for my finglish before @AlwaysSkint fingers me again.
@geo said: Love ya VirMach but these service outages are killing me!
Trying to be more careful with the mass issue flags. It's just very hard since most people mash random buttons but there's got to be a better way for me to filter them.
@netomx said:
47.87.184.x is LA? I cannot know where my VPS is, as the status page throws Operation Timed Out After 90001 Milliseconds With 0 Bytes Received
Doesn't matter where it is, all of them are down, it's IP routing issue.
@netomx said: I cannot know where my VPS is, as the status page throws Operation Timed Out After 90001 Milliseconds With 0 Bytes Received
By the way we have something planned for correcting this on our projects list, we agree it's helpful to be able to see that instead of a timeout (which is shared with other issues as well.) Currently not our code.
@Calypso said:
... f*ck... connection to my host on AMSD029 is gone again ...
Expected. Reference:
@VirMach said: Unfortunately if you're early to the reconfiguring I can't promise it won't go down for a mass reconfigure as the script that pings first to reconfigure isn't working great and developer's not around so we're using a different method. Could mean one last VM reboot.
Virmach can you please inform us about NY ? is it possible there to change IP's or is this going to take much more time ?
(Then i start restoring things to another host)
@hike said:
Virmach can you please inform us about NY ? is it possible there to change IP's or is this going to take much more time ?
(Then i start restoring things to another host)
Once I have information, I'd update the network status page as I did and also most likely provide an update here.
They're aware of the issue now and working to restore it. I do not know how long that will take, but what I can say is that the IP address will not change in this case (unless they come back and say the block is no longer available, if somehow over the last 12 hours they've resold it, in which case there would obviously be a change. I don't expect this to happen but I'm attempting to cover all possibilities here.)
I do not know how that company operate and what is the bill and I bet its not small, if they do not contact the user/ even more long term client I just can say fuck to them..........
@VirMach
Do you anticipate getting back the IP blocks from leaser?
Reason why I ask is my DA license is locked to these assigned IPs. As with recent DA license change they are blocking IP change for Internal DC licenses
@bula said:
Do you anticipate getting back the IP blocks from leaser?
Reason why I ask is my DA license is locked to these assigned IPs. As with recent DA license change they are blocking IP change for Internal DC licenses
I think that means no. There (could be) double IP for some period of time, but the main IP is already migrated and in long run we will only have the new-new-new one. In theory of course, VirMach life is hard so it can all change
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
@reb0rn said: I just can say fuck to them..........
It seems like with any IP lessor, we're at their mercy to a great level. Seems to be how they operate in general, all of them. They have the limited resource/entire supply and you're the demand. So far they've been good in that at least they do not threaten to terminate us for a normal level of abuse reports.
While I definitely do not like what happened and how it occurred, it'd realistically not benefit us or our customers to try to change them. With Frankfurt and Amsterdam we could do it quickly, but that's not something we could reproduce smoothly with the other datacenter partners. I already know INAP/Unitas Global would most likely take multiple days for new announcement. We could maybe get them to rush it but it's too close to the weekend for comfort. QN, maybe. HV, definitely not.
So any chance there is of avoiding swaps, I'll take it. And that's before we get into the mass confusion and support overhead that comes with IP changes.
@bula said: Do you anticipate getting back the IP blocks from leaser?
Yes, I highly doubt they would have re-sold them this quickly and it looks like it just went back to Alibaba and not some other third party but it's strange they'd actually rather just pull them without even asking for their money (if they thought we didn't send/they didn't receive it) unless they had some opportunity, so I don't know.
I haven't got any communication that indicates they may no longer have it available.
@hike said: @VirMach , so there is no possibility to change IP's now just like you did in AMS and FRA i assume this is the only block you can route there ?
Only if we get forced to do it but if that happens, it will not be faster as it was for AMS/FRA. It will be slower.
@hike said:
And if this is all not possible, can you at least make the VNC available ?
That's going to be worked on next but we're not at that stage yet. Still wrapping up Frankfurt and Amsterdam, and other things. I'm hoping it won't be necessary. Nodes to get VNC back first are intended to be HV nodes, and we'll gear up for migrating those next (unless IPv4 is restored by then.)
@bula said: Do you anticipate getting back the IP blocks from leaser?
Yes, I highly doubt they would have re-sold them this quickly and it looks like it just went back to Alibaba and not some other third party but it's strange they'd actually rather just pull them without even asking for their money (if they thought we didn't send/they didn't receive it) unless they had some opportunity, so I don't know.
I haven't got any communication that indicates they may no longer have it available.
OK I certainly hope you get these IP blocks back as it would be a bummer as like I said DA has changed their license system so would loose the license access for my VPS under you if new address is assigned.
@bula said: Do you anticipate getting back the IP blocks from leaser?
Yes, I highly doubt they would have re-sold them this quickly and it looks like it just went back to Alibaba and not some other third party but it's strange they'd actually rather just pull them without even asking for their money (if they thought we didn't send/they didn't receive it) unless they had some opportunity, so I don't know.
I haven't got any communication that indicates they may no longer have it available.
OK I certainly hope you get these IP blocks back as it would be a bummer as like I said DA has changed their license system so would loose the license access for my VPS under you if new address is assigned.
Yeah for me it'd mostly be a bummer because it means I probably can't sleep for the next 2 days but we're definitely on the same team here, I just hope we get them back soon.
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural. It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
Seems like I did not miss anything while I was away. /s
My Amsterdam and Frankfurt VMs are working fine now with the new IPs.
Just a quick note for Alma 8 users....
I found each of my three EU VMs stuck at a waiting on rc.local job during boot after the old IPv4 were removed. While using VNC and booting into Alma 8 rescue mode from the boot menu, not rescue mode in SolusVM, I was able to start the VMs normally and change what needed to be changed regarding IPv4 configurations.
EDIT: Spoke too soon, both Frankfurt VMs are unreachable again.
Oddly, Hetrix reports 47.87.196.xxx alternating between reachable and non-reachable, depending on which origin is attempting to hit it.
I guess it's a lingering BGP route?
Yeah, seems like something (or someone) shut down everything I had in Frankfurt/Amsterdam and I had to manually click BOOT in panel. Is this IP renumbering script going crazy?
Agent hasn't sent any data in the past: 16 minutes
Welp, there goes uptime
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
@erk said:
Oddly, Hetrix reports 47.87.196.xxx alternating between reachable and non-reachable, depending on which origin is attempting to hit it.
I guess it's a lingering BGP route?
Yep, they didn't even pull it correctly. Usually how it works is they would make de-announcement requests. They just unsigned the records, didn't pull it from ARIN. Which makes it easier to bring it back so whatever.
@Jab said: all new IPs just went down, lmao/panic.
@FrankZ said: EDIT: Spoke too soon, both Frankfurt VMs are unreachable again.
Frankfurt got rebooted. Amsterdam should still be in the same state as it was a few hours ago.
Comments
i have not touched anything yet ... will do that in next coming days.... maybe miraculously migrate button also appears.
Please! Can you have a look at 47.87.171.xxx LA server
He already gave an update earlier on this page.
What are the chances that those new IPs gonna be perm IPs and we won't go back to Alibaba next day(s)?
What are the chances that Alibaba thing will work again within next let's say 12 hours?
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
Frankfurt and Amsterdam will remain as such. We will not switch them back.
Also I found out what caused all this to happen in the first place... this was the old bank that they switched abruptly so I guess it's not their fault either, and I finally got a confirmation from our bank that they "rejected" the payment multiple days after it was supposed to complete to the new one. They finally replied 20 minutes ago or so and trying to arrange the new payment now.
@VirMach i hope you didn't loose money from SVB adding to the list on the ice-berg?
So time to update my DNSes and configs, sad
But thanks for answer.
I think VirMach said that the company they lease IPs is (was
) using SVB and after the switch few days ago (or earlier) theirs new bank returned all payments from VirMach bank... so VirMach not in SVB, I would assume.
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
We're not cool enough to use SVB so we dodged that one.
Oof. This happened to me as well. SJCZ010 was network unreachable for a period but then came back online. Got closed for mass issue and not sure about SLA credit for 2 services there.
Love ya VirMach but these service outages are killing me!
Thank you.
I do, just a lot on my life.
@FrankZ thank you!
Trying to be more careful with the mass issue flags. It's just very hard since most people mash random buttons but there's got to be a better way for me to filter them.
I have an idea for pulling these, will try to update you here.
47.87.184.x is LA? I cannot know where my VPS is, as the status page throws Operation Timed Out After 90001 Milliseconds With 0 Bytes Received
Doesn't matter where it is, all of them are down, it's IP routing issue.
But that's NYC.
By the way we have something planned for correcting this on our projects list, we agree it's helpful to be able to see that instead of a timeout (which is shared with other issues as well.) Currently not our code.
... f*ck... connection to my host on AMSD029 is gone again ...
rDNS for Amsterdam/Tokyo/Frankfurt will become available most likely tomorrow by the way, but let's say end of week.
Expected. Reference:
Almost done.
Not for me as a customer
Will update network status page.
Had to reinstall my vps on AMSD026 and now that ones back up.
Now to wait for the ~20 usa vps's to have their routing fixed and then I can go back to successfully idling 90% of my VPS's.
Virmach can you please inform us about NY ? is it possible there to change IP's or is this going to take much more time ?
(Then i start restoring things to another host)
Once I have information, I'd update the network status page as I did and also most likely provide an update here.
They're aware of the issue now and working to restore it. I do not know how long that will take, but what I can say is that the IP address will not change in this case (unless they come back and say the block is no longer available, if somehow over the last 12 hours they've resold it, in which case there would obviously be a change. I don't expect this to happen but I'm attempting to cover all possibilities here.)
Fucking reconfigure network using
eth0rather than properens$number- had to manually fix one server... rest seems to accepted reconfigure networkHaven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
I do not know how that company operate and what is the bill and I bet its not small, if they do not contact the user/ even more long term client I just can say fuck to them..........
@VirMach
Do you anticipate getting back the IP blocks from leaser?
Reason why I ask is my DA license is locked to these assigned IPs. As with recent DA license change they are blocking IP change for Internal DC licenses
@VirMach , so there is no possibility to change IP's now just like you did in AMS and FRA i assume this is the only block you can route there ?
And if this is all not possible, can you at least make the VNC available ?
https://lowendspirit.com/discussion/comment/135222/#Comment_135222
I think that means no. There (could be) double IP for some period of time, but the
mainIP is already migrated and in long run we will only have thenew-new-newone. In theory of course, VirMach life is hard so it can all changeHaven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
It seems like with any IP lessor, we're at their mercy to a great level. Seems to be how they operate in general, all of them. They have the limited resource/entire supply and you're the demand. So far they've been good in that at least they do not threaten to terminate us for a normal level of abuse reports.
While I definitely do not like what happened and how it occurred, it'd realistically not benefit us or our customers to try to change them. With Frankfurt and Amsterdam we could do it quickly, but that's not something we could reproduce smoothly with the other datacenter partners. I already know INAP/Unitas Global would most likely take multiple days for new announcement. We could maybe get them to rush it but it's too close to the weekend for comfort. QN, maybe. HV, definitely not.
So any chance there is of avoiding swaps, I'll take it. And that's before we get into the mass confusion and support overhead that comes with IP changes.
Yes, I highly doubt they would have re-sold them this quickly and it looks like it just went back to Alibaba and not some other third party but it's strange they'd actually rather just pull them without even asking for their money (if they thought we didn't send/they didn't receive it) unless they had some opportunity, so I don't know.
I haven't got any communication that indicates they may no longer have it available.
Only if we get forced to do it but if that happens, it will not be faster as it was for AMS/FRA. It will be slower.
That's going to be worked on next but we're not at that stage yet. Still wrapping up Frankfurt and Amsterdam, and other things. I'm hoping it won't be necessary. Nodes to get VNC back first are intended to be HV nodes, and we'll gear up for migrating those next (unless IPv4 is restored by then.)
OK I certainly hope you get these IP blocks back as it would be a bummer as like I said DA has changed their license system so would loose the license access for my VPS under you if new address is assigned.
Yeah for me it'd mostly be a bummer because it means I probably can't sleep for the next 2 days but we're definitely on the same team here, I just hope we get them back soon.
dafaq ? i have a buffalo VPS from you, but cant reach it today
New York is not Buffalo.
Miami also down for me
That was amazing (TED)talk
-- dafaq ? i have a buffalo VPS from you, but cant reach it today
-- New York is not Buffalo.
-- Miami also down for me
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
my 2 data servers are down...
and whmcs gives error "Operation Timed Out After 90001 Milliseconds With 0 Bytes Received"
oh my.
^ Due to being a Windoze luser.
In stasis until the shitposting stops/abates.
Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural.
It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).
I'd be using Linux if I could get into one of my VPSs.
Seems like I did not miss anything while I was away. /s
My Amsterdam and Frankfurt VMs are working fine now with the new IPs.
Just a quick note for Alma 8 users....
I found each of my three EU VMs stuck at a waiting on rc.local job during boot after the old IPv4 were removed. While using VNC and booting into Alma 8 rescue mode from the boot menu, not rescue mode in SolusVM, I was able to start the VMs normally and change what needed to be changed regarding IPv4 configurations.
EDIT: Spoke too soon, both Frankfurt VMs are unreachable again.
all the 47.87.xx.xx is gone forever it seems.
Oddly, Hetrix reports 47.87.196.xxx alternating between reachable and non-reachable, depending on which origin is attempting to hit it.
I guess it's a lingering BGP route?
P A N I C
all new IPs just went down, lmao/panic.
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
Only took 8 minutes from the time @FrankZ when online in Frankfurt.
I just booted both mine up and they're good now.
Yeah, seems like something (or someone) shut down everything I had in Frankfurt/Amsterdam and I had to manually click BOOT in panel. Is this IP renumbering script going crazy?
Agent hasn't sent any data in the past: 16 minutes
Welp, there goes uptime
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
Yep, they didn't even pull it correctly. Usually how it works is they would make de-announcement requests. They just unsigned the records, didn't pull it from ARIN. Which makes it easier to bring it back so whatever.
Frankfurt got rebooted. Amsterdam should still be in the same state as it was a few hours ago.
I guess this is new entry in Network status, but this needs timestamps in some known timezone, @VirMach please next time - put timestamps on updates.
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.