VirMach - Complain - Moan - Praise - Chit Chat - Flan

1113114116118119274

Comments

  • FrankZFrankZ ModeratorOG

    @yoursunny said: Rule of thumb:
    You can have at most one server at each location.
    A location is the size of a Western Europe country.

    I'm glad that you are able to do that. I've pulled a VirMach on you and twice wrote out walls of text trying to explain why that was not going to work for me. Instead I'll just say that's not going to work for me and try and live with the understanding that babies are going to die in the future due to climate change because of my extensive use of Low End VMs today.

  • @DeviousDev said:
    Hello everyone, 1st post on LES but not in the lowend-X community.

    I don't know if someone can help me figure out there, but i tried to open a ticket twice to get migrated from SEA to NYC both get refused and directly closed i followed the instruction on the status page telling to open a ticket with subjet set to "SEA Migrate Immediately to NYC" and that i agree to be moved and i know i wont be able to move back and data will be delete and also i would like backup loaded and acknowledge about the 15$ as seen in the instruction am i missing something ?

    Maybe im missing something can you point me out.

    Thanks guys :)

    DeviousDev

    It's on the network status update, we may refuse for any reason to process it but per comment here earlier, usually if rejected it means either not done correctly, which you've confirmed it was done correctly, or that you were marked as previously have made a ticket about an issue that was already discussed on network status page. (Could also technically be previous similar situation.)

  • Okay slightly more detailed timeline/events, maybe.

    San Jose - I'm flying there tomorrow afternoon until Wednesday afternoon and hopefully I'll be able to do something, if not then whatever, at least a change of workplace, I'm already set up with multiple portable monitors and such. If that fails, then we have someone who can maybe do it Wednesday or Thursday, if that fails then defaults to Evocative hands Friday to Saturday.

    Seattle - Got confirmation from them they're speaking with Unitas Global for the blend, he's trying to send out the quote as soon as possible still. I do technically have the option to hop from SJC to SEA if needed Wednesday to Thursday as well.

    Phoenix - Haven't heard any further from here, timeline is still today until Wednesday. We won't be loading in from backups as this is a relatively short wait here in any case. Relatively.


    For Dallas and Denver, we're dividing everyone out for emergency migrations. Haven't heard back from SolusVM today yet. I'll see if I can drop of servers to QN. Deja vu, I feel like I keep saying that and then not doing it because I run out of time. Last hold up was trying to finish the migrations from before the weekend.

  • FrankZFrankZ ModeratorOG

    @VirMach thank you for the continuing updates, it has made it much easier to work around the issues. It might seem ironic, but knowing that a particular DC is not coming back online today has helped me sleep better.

  • NY down ?

  • @hike said:
    NY down ?

    Yes, caused by me. I made a really stupid mistake, immediately realized it and contacted the datacenter/made network issue.

  • Is back , short glitch

  • edited September 2023

    @hike said:
    NY down ?

    @VirMach said:
    Yes, caused by me. I made a really stupid mistake, immediately realized it and contacted the datacenter/made network issue.

    Can imagen with all going on , hope when all sorted you can take some holiday.
    Good luck !


  • There is a problem with NYCB046's network and cannot connect to the Internet. :#

  • Alhamdulillah, Thanks @VirMach My storage is active again with a new IP

  • @KuYeHQ said:

    There is a problem with NYCB046's network and cannot connect to the Internet. :#

    How do we know that's not just your VM has messed up networking after the re-IP?

  • FrankZFrankZ ModeratorOG
    edited September 2023

    @KuYeHQ said: There is a problem with NYCB046's network and cannot connect to the Internet. :#

    I expect that VirMach is traveling to San Jose today so may be unavailable to answer your question. If you will send me via DM a screenshot of the following

    ip addr show
    ip route show
    netstat -anp | grep tcp
    cat /etc/resolv.conf
    The IP that shows in the billing panel that was assigned to your VM

    I will see if there is anything that can be done to get you going without VirMach's intervention.

  • cybertechcybertech OGBenchmark King YABS 24/7/365

    good for san jose!

    I bench YABS 24/7/365 unless it's a leap year.

  • I had to force myself to sleep last night after the huge error I made, and it was very difficult to do even though I'm exhausted. Luckily I was able to probably sleep for another 4 hours after laying there for a few hours. So far so good, didn't miss my early morning call with Flexential. We'll likely be consolidating Atlanta, Denver, and Dallas into just one location the way the quotes are going.

    They seem to have a "minimum price" no matter what you get, a sweet spot, then high again. So we're trying to hit that middle ground and to do that, consolidation is required.

    I'm still trying to fly to San Jose in a few hours, but haven't heard back from Evocative San Jose on whether I have direct access to move the equipment as they were supposed to remove them from the rack. Gathering everything up so I'll be able to continue work in San Jose regardless of whether or not I'm able to do the earlier move.

    Phoenix is still scheduled for Wednesday, they weren't able to do it sooner.

    No update on Sabey (Seattle.)

    No update on SolusVM.

    We moved as much as we could given SolusVM acting strangely.

    @FrankZ said:

    @KuYeHQ said: There is a problem with NYCB046's network and cannot connect to the Internet. :#

    I expect that VirMach is traveling to San Jose today so may be unavailable to answer your question. If you will send me via DM a screenshot of the following

    ip addr show
    ip route show
    netstat -anp | grep tcp
    cat /etc/resolv.conf
    The IP that shows in the billing panel that was assigned to your VM

    I will see if there is anything that can be done to get you going without VirMach's intervention.

    He is likely on one of the new blocks added which I'm trying to have fixed still. Until it's marked as done on network status page, it's not done. He left out a lot of details but given the timing of his post I assume he was migrated yesterday and needs the new IPv4 to have connectivity still.

    This involves my screw-up on the switch yesterday, so I'm not touching anything and just waiting on network engineer.

  • Let's petition for @FrankZ to be granted backend access, so that he can solve everyone's problem without guessing.

    We accept Karma donations for the last flan. 🍮 affbrr

  • FrankZFrankZ ModeratorOG

    @VirMach said: We'll likely be consolidating Atlanta, Denver, and Dallas into just one location the way the quotes are going.

    Any chance that the location that you will consolidate them to will be Dallas ?


    @yoursunny I know my guessing correctly percentage is down a little lately, but I still thought it was pretty good, no ?

  • @FrankZ said: ..the location that you will consolidate them to will be Dallas ?

    The geographic median, sort of. ;)

    In stasis until the shitposting stops/abates.
    Than=compare;then=sequence:brought=bring;bought=buy:staffs=pile of sticks:informations/infos=no plural.
    It wisnae me! A big boy done it and ran away. || NVMe2G for life! until death (the end is nigh).

  • @FrankZ said:

    @VirMach said: We'll likely be consolidating Atlanta, Denver, and Dallas into just one location the way the quotes are going.

    Any chance that the location that you will consolidate them to will be Dallas ?

    I would have selected Dallas, but it's double the setup time for that as they do not have power drops yet and most of Dallas has already been migrated to NYC since it went down. Atlanta is technically still online, and should still remain online until the maintenance window to set up the new cabinet. It'd make the most sense to not consolidate to Dallas given that we'd have to cause more problems in Atlanta for existing customers who are online and fine.

    Very much playing the cards we're dealt.

    I do see Dallas returning as a location after we deal with all these issues, but that location is kind of oversaturated at this point and all the positives it had seem to be going away (mainly cheap power, it seems.) This also gives us time to make the right choice for that location instead of the first available, and it just looks like everything is going to be long delays for setup there right now. I'm jumping ahead right now but I did also contact some companies in the surrounding areas. It could be cool to try to do Oklahoma City instead and if I had free reign over Atlanta, I'd probably would have wanted to move it to Saint Louis instead in my pursuit to keep things interesting. But yeah, most likely Dallas comes back, just don't know under who yet or when.

  • I'm going to try very hard not to miss my flight to San Jose.

    I already got confirmation that a tech will get there before I do and he's more than capable to do everything himself if I run into problems. Networking team, I say team but it seems to be one person for San Jose is still unfortunately sick, and for whatever reason he's the only guy in the entire facility that could assist us with the networking setup though so even if we set up the cabinet today, we won't have any connectivity until that gets sorted.

  • FrankZFrankZ ModeratorOG
    edited September 2023

    @VirMach said:

    @FrankZ said:

    @VirMach said: We'll likely be consolidating Atlanta, Denver, and Dallas into just one location the way the quotes are going.

    Any chance that the location that you will consolidate them to will be Dallas ?

    I would have selected Dallas, but it's double the setup time for that as they do not have power drops yet and most of Dallas has already been migrated to NYC since it went down. Atlanta is technically still online, and should still remain online until the maintenance window to set up the new cabinet. It'd make the most sense to not consolidate to Dallas given that we'd have to cause more problems in Atlanta for existing customers who are online and fine.

    Very much playing the cards we're dealt.

    I do see Dallas returning as a location after we deal with all these issues, but that location is kind of oversaturated at this point and all the positives it had seem to be going away (mainly cheap power, it seems.) This also gives us time to make the right choice for that location instead of the first available, and it just looks like everything is going to be long delays for setup there right now. I'm jumping ahead right now but I did also contact some companies in the surrounding areas. It could be cool to try to do Oklahoma City instead and if I had free reign over Atlanta, I'd probably would have wanted to move it to Saint Louis instead in my pursuit to keep things interesting. But yeah, most likely Dallas comes back, just don't know under who yet or when.

    Thank you for the followup. All the above makes complete sense to me. Have a good flight.

  • Still no update on Sabey.

    Still no update on connectivity for new blocks on NYC (these are people who got migrated to NYC mostly, but not all of them, some already have connectivity.)

    San Jose earliest time back seems to be tomorrow, latest seems to be Saturday.

    Phoenix still on track for tomorrow.

    Dallas has 3 nodes left to "move." To clarify, by that I mean just getting SolusVM to list it as the proper new node.

    Denver, about half of everyone moved, half left. By move I mean same as above.

    Los Angeles, never got to take servers down but it seems like they're less likely to be required. That's slated for when I get back from San Jose, hopefully.

    IPv4 change notification may end up getting pushed into tomorrow, we'll see how everything else goes today.

  • JabJab TOP Member 2027

    @VirMach said:
    Networking team, I say team but it seems to be one person for San Jose is still unfortunately sick, and for whatever reason he's the only guy in the entire facility that could assist us with the networking setup

    They say one man VPS providers are bad... yet you can run one man whole DC :D

    Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.

  • Update on Coinbase payment method, they closed our service with no notification which was causing the errors. They are unwilling to open the account and unwilling to provide any information. I suspect perhaps their legal team maybe got a request as some payments probably come from shady sources as happens in this business, but for whatever reason they decided now would be the perfect time to permanently close our account.

    I've already got us set up with another similar provider/competitor and also adding another, and Bitcoin also has it's other. Luckily with cryptocurrency in the end it's semi-decentralized so we can always just add others.

  • @Jab said:

    @VirMach said:
    Networking team, I say team but it seems to be one person for San Jose is still unfortunately sick, and for whatever reason he's the only guy in the entire facility that could assist us with the networking setup

    They say one man VPS providers are bad... yet you can run one man whole DC :D

    I just love how the thing in question is networking, which is a job that can be done globally. So basically, effectively what they're saying is that they either don't want to assign anyone to help us or that there is one man on Earth that is the only guy that has access to doing anything for a company that owns 20 colocation facilities and basically bought out half of INAP.

  • @VirMach said:

    @Jab said:

    @VirMach said:
    Networking team, I say team but it seems to be one person for San Jose is still unfortunately sick, and for whatever reason he's the only guy in the entire facility that could assist us with the networking setup

    They say one man VPS providers are bad... yet you can run one man whole DC :D

    I just love how the thing in question is networking, which is a job that can be done globally. So basically, effectively what they're saying is that they either don't want to assign anyone to help us or that there is one man on Earth that is the only guy that has access to doing anything for a company that owns 20 colocation facilities and basically bought out half of INAP.

    Buy iFog VPS and tunnel the whole rack through it.
    You'll get free IPv6 too.

    We accept Karma donations for the last flan. 🍮 affbrr

  • JabJab TOP Member 2027

    Would this explain a few things? :D

    Hivelocity | VPS Launching in Fall 2023

    Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.

  • @nyamenk said:
    Alhamdulillah, Thanks @VirMach My storage is active again with a new IP

    congratulations , glad to hear the news 🤜🤛

  • @Jab said:
    Would this explain a few things? :D

    Hivelocity | VPS Launching in Fall 2023

    They've had VPS for years now, they're just being deceptive about their marketing.

  • San Jose update: they don't have any bars near the datacenter, every restaurant that isn't fast food is closed or closing in like 10 minutes to an hour or closed on Tuesdays. A medium pizza is $21.

  • @VirMach said:

    @Jab said:

    @VirMach said:
    Networking team, I say team but it seems to be one person for San Jose is still unfortunately sick, and for whatever reason he's the only guy in the entire facility that could assist us with the networking setup

    They say one man VPS providers are bad... yet you can run one man whole DC :D

    I just love how the thing in question is networking, which is a job that can be done globally. So basically, effectively what they're saying is that they either don't want to assign anyone to help us or that there is one man on Earth that is the only guy that has access to doing anything for a company that owns 20 colocation facilities and basically bought out half of INAP.

    I sent them an email asking them if they had any single employee available anywhere that could potentially do announcement and confirm uplink information and they did get someone to assist us.

    Everything racked and has power. Side note, a while ago when Dedipath racked these, we had huge pain trying to get them to use our rail kits. It took several tries and eventually they blamed our rails (same ones in every location) and said they'd have to order in new rails. Today I found out by ordering new rails they meant getting non-sliding rails and then just stacking two servers at a time on them, our tech helping out was obviously very confused and probably initially thought we were the ones that wanted to do that. There's going to have to be another maintenance window in the future where we get actual rails, since it seems like Dedipath also threw away all our rails, except... one. For some reason they kept one.

    Networking will have to wait until tomorrow, I almost missed my flight (which also got delayed because the plane's electronic systems were malfunctioning) but anyway, that means since I was trying to make the flight I totally forgot to bring my dongles. Need to go get one from Best Buy tomorrow and I'll set everything up, fingers crossed.

  • cybertechcybertech OGBenchmark King YABS 24/7/365

    san joseeeeeeeeeee

    war cries

    I bench YABS 24/7/365 unless it's a leap year.

  • cybertechcybertech OGBenchmark King YABS 24/7/365

    the best location so far for me is AMS!

    second is Tokyo.

    I bench YABS 24/7/365 unless it's a leap year.

  • One of the AMS node down?

    Operation Timed Out from the VirMach panel

    From the SolusVM CP: RYZE.AMS-D001.VMS

  • @kheng86 said:
    One of the AMS node down?

    Operation Timed Out from the VirMach panel

    From the SolusVM CP: RYZE.AMS-D001.VMS

    Just controls.

  • @VirMach said:

    @kheng86 said:
    One of the AMS node down?

    Operation Timed Out from the VirMach panel

    From the SolusVM CP: RYZE.AMS-D001.VMS

    Just controls.

    VPS is down ("offline") in SolusVM as well. Can't boot etc.

  • @kheng86 said:

    @VirMach said:

    @kheng86 said:
    One of the AMS node down?

    Operation Timed Out from the VirMach panel

    From the SolusVM CP: RYZE.AMS-D001.VMS

    Just controls.

    VPS is down ("offline") in SolusVM as well. Can't boot etc.

    It's online but you're right, having other issues.

  • edited September 2023

    1 of my dallas -> NY VPS's is "up" with new IPs now (NYCB013), but sitting at a "No bootable device".

    Is it safe to reinstall or is there still more work being done? Not in a rush, it'll just go back to idling anyways.

  • @soulchief said:
    1 of my dallas -> NY VPS's is "up" with new IPs now (NYCB013), but sitting at a "No bootable device".

    Is it safe to reinstall or is there still more work being done? Not in a rush, it'll just go back to idling anyways.

    I reinstalled mine on that time the drive failed on one of their servers that affected mine, after some time it just rolled back presumably from their backups. I recommend to not touch anything for now.

    You probably saw me somewhere...

  • @soulchief said:
    1 of my dallas -> NY VPS's is "up" with new IPs now (NYCB013), but sitting at a "No bootable device".

    Is it safe to reinstall or is there still more work being done? Not in a rush, it'll just go back to idling anyways.

    Any unexpected issue like that, first check network status page, then if nothing is specifically mentioned that could be related (e.g, the node is listed as having some unidentified problem, disk problem, overloading, anything other than it being fully down) then you should open a ticket.

    Reinstall in these situations could result in disk disappearing completely. Just mention in your ticket that you are not trying to get the data back on it to speed it along and priority queue.

  • @nyamenk said:
    Alhamdulillah, Thanks @VirMach My storage is active again with a new IP

    Alhamdulillah

  • FrankZFrankZ ModeratorOG
    edited September 2023

    @soulchief @ricANNArdo I also have a couple of VMs that were migrated from Dallas that are in this same situation on NYCB45 & NYCB013. One thing that I have noticed in the past, but I am not totally sure that it would apply with these migrations, is when the VM in question shows no operating system in the solusVM panel. Don't do a reinstall or it will break things further. After time, which may take a couple of days, or up to a couple of weeks, the O/S will show up again in the solusVM panel then your VM will work again. I expect that VirMach makes the rounds and fixes them in batches on each node.

    EDIT: I also have some expectation that although my VMs show in the panel as being in NYC with the new IPs, they may still be in the process of being migrated. So I'm going to wait a few more days and see if they show up as working by themselves.

  • @FrankZ said:
    @soulchief @ricANNArdo I also have a couple of VMs that were migrated from Dallas that are in this same situation on NYCB45 & NYCB013. One thing that I have noticed in the past, but I am not totally sure that it would apply with these migrations, is when the VM in question shows no operating system in the solusVM panel. Don't do a reinstall or it will break things further. After time, which may take a couple of days, or up to a couple of weeks, the O/S will show up again in the solusVM panel then your VM will work again. I expect that VirMach makes the rounds and fixes them in batches on each node.

    EDIT: I also have some expectation that although my VMs show in the panel as being in NYC with the new IPs, they may still be in the process of being migrated. So I'm going to wait a few more days and see if they show up as working by themselves.

    This round, unless it's a very specific different batch which I doubt, should have the data ready once it appears in NYC. So it's not good that it looks like that but I'm checking with the team member that processed these to double check his work and also check how extensively this is happening and on which transfers.

    Either bad organization/processing, or bad backups. If it's the former what could possibly fix it would be to power down, then up. Unless it's very bad processing.

  • It could also technically be SolusVM in this case too, as you mentioned, what you described could be related to some config file issue/weird update since that also describes our other issue.

  • JabJab TOP Member 2027

    https://lowendtalk.com/discussion/188702/issues-with-ipxo#latest

    Welp, sounds familiar.

    Hello,

    I don't know if anyone has faced similar kinds of issues or not with IPXO like us.

    I have an active account with IPXO with 20+ IP ranges leased smoothly. But the problem starts when one ip out of /24 blocks is blacklisted, they suspend the whole account within a minute.
    When we activated our account we mentioned that if any illegal activities like spam, or phishing happened within 24 we'd terminate the service (server, not the IP) and they agreed on it. But still, they suspended the whole account. Now they do not respond to any emails or anything.

    Is this only us or does it happen to you also?

    Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.

  • Dalz007 is up according to Status page, but actually
    Operation Timed Out After 90001 Milliseconds With 0 Bytes Received

  • FrankZFrankZ ModeratorOG
    edited September 2023

    The node may. or may not, be up, but from what I understand there is no network, so the controls from the panel will not work.

    EDIT: According to the status page DALZ007 is/was in the process of being migrated as of yesterday to NYC. So you're probably not on DALZ007 anymore anyway. When the controls do come back up, you should note the hew node that you are on now for future reference.

  • JabJab TOP Member 2027
    edited September 2023

    Schrödinger's node

    Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.

  • FrankZFrankZ ModeratorOG

    @Jab said:
    Schrödinger's node

    LOL, exactly.

  • I have one VPS transfered to NYCB011X show OS but no boot, and looks like reinstall is no go (as I do not need data)

  • @FrankZ said: So your you're probably not on DALZ007 anymore anyway

    Fixed that for you.

Sign In or Register to comment.