VirMach
VirMach
About
- Username
- VirMach
- Joined
- Visits
- 3,207
- Last Active
- Roles
- Member
- Karma
- 9,672
Comments
-
(Quote) Yep, it's actually crazy how much of a massive improvements it made for Tokyo. Other regions improved maybe 20-30% after the change but Tokyo is probably an easy 70% across the board, that's lower load, CPU usage, improved ping and…
-
(Quote) All of NYC has also had this applied. DC had wrong ports labeled for about 7 servers so those are currently offline (networking-wise.) Around 6 can be fixed more quickly, one definitely can't because it has to wait on network engineer.
-
Oh by the way, we signed on for Chicago, Tampa, and Los Angeles with Hivelocity. Pretty excited about that. Basically it happened the second QN made me lose my mind over the nullroutes. Not that we're moving all of LA to Hivelocity, it'd j…
-
(Quote) I'm lucky enough to still have my parents around and every time we speak they remind me of this, and even though I'm a grown man now I still get a kick out of their reaction when I say something along the lines of "okay, I…
-
(Quote) This is knowledge from a long time ago and it's based on hearsay from someone who used to work for us, but in the past, we couldn't do static routing with SolusVM. I don't remember the specific nor do I want to dive into it ri…
-
(Quote) DALZ007 as well as a few others have been waiting probably nearly 2 weeks for networking to set up the VLAN properly. The way the teams function and how they do networking is not ideal in my opinion and we only have issues with this one part…
-
Tokyo is finally getting its long-overdue network overhaul. We had a good discussion about it and I want to kind of share what we believe is occurring right now and why. Turns out, pretty much every network engineer I've spoken with agrees tha…
-
(Quote) All I can immediately tell you is that it's not a node-wide issue and only 1 single person's service is "offline" and many are using networking and racking up bandwidth usage, with their service pinging. You might have to…
-
(Quote) Very vague so I'm unable to even figure out if you're on a location facing problems such as Seattle or if it's unique to your service. We'll allow people to request credits as long as they're very clear about it and …
-
Seattle finally got the switch configuration changes we requested. SEAZ004 and SEAZ008 having some issues with it (indirectly) so waiting on hands request for that, otherwise Seattle networking is finally decent. ATLZ007 had a disk issue that'…
-
(Quote) Some weird DNS issue that just went away. I don't remember who we set up for DNS but it's possible it briefly had a burst of connection issues in that route. Unrelated to SolusVM. It's WHMCS, it couldn't resolve Google ei…
-
(Quote) 09:29:04 up 29 days, 20:51
-
(Quote) I was already expecting their DDoS protection to be pretty bad, as in an attack would leak through. Never would I have guessed that it's so good that it doesn't let ANYTHING through. They've solved the universal problem of den…
-
SolusVM has migrated to either an Epyc or Ryzen servers, I don't remember. We got it like a year ago probably at this point and never used it until now. Let's see if this improves anything or if we're still stuck with PHP/MySQL bottle…
-
(Quote) It could be an IP conflict or IP change. If it continues let me know. We've brought people on, we actually have someone helping but unfortunately they're not at the level we need them to be to really make an impact. There's a…
-
(Quote) Yeah looks like syncs got absolutely gutted by everything I said above as well.
-
(Quote) The templates were all fixed for all migrations up until yesterday or so, but only on SolusVM. Those aren't tied to their original package anymore. WHMCS is next if I can squeeze it in.
-
(Quote) This was supposed to be a quick migration but QuadraNet has been nullrouting our IP addresses all day for doing the transfers. I guess their DDoS protection is some script they set up to deny you service, the 14 year old developer must have …
-
Side note on multi-IP, at this point it's going to require a lot of work to sort through all of it and that's after we set up more nodes. Multi-IP will most likely for most people require another migration as well. Originally this wasn…
-
(Quote) Bottom of the list at this point to be frank. I understand it's very important to some, we just have to make sure people have a functional service first, a functional IP second, that the networking actually functions well, more builds, …
-
Template Syncs - Ongoing, many more re-synced. OS installs should work better. QuadraNet's "DDoS Protection" is essentially just hefty false positives though so for Los Angeles I might have to literally drive down a hard drive and loa…
-
Networking Update - Just essentially waiting on DC hands at this point for NYC, Dallas, Atlanta, San Jose, Seattle, Phoenix, and Denver. Once these switch over networking should improve drastically and it should also have a positive impact on the CP…
-
(Quote) We're ramping up the abuse script. It's what it is called. I didn't say boot loop after migrating is abuse. Abuse script will just power it down, not suspend. I don't see the harm in powering down something stuck in a bo…
-
(Quote) Were these always offline after Ryzen Migrate button?
-
(Quote) This has an issue with a software getting stuck and duplicating its process over and over until it overloads and we have to reboot it. We made some changes, if it happens again we'll try to catch it earlier this time to avoid a reboot.
-
Settings stuck on FFME004 but I'm pretty sure I've said that once before. There's zero information on this but there's been constant kernel bugs regarding these fixes on Linux. I can't rewrite the Linux kernel right now so u…
-
(Quote) FFME004, we found ECC error, and the settings also dropped off again. Memory swap fixed FFME004, we couldn't send out migration emails in time because xTom worked very quickly to get this replaced. The setting drop-off caused a disk to …
-
(Quote) I'll make a network status page for it since it seems a lot of the emails failed to send.
-
(Quote) Well initially the way it's going to work is there will be a period of time where you're allowed to "Ryzen Migrate" to your desired location (without data) as everyone lands in their desired location. It'll be announ…
-
We're ramping up the abuse script temporarily. If you're at around full CPU usage on your VPS for more than 2 hours, it'll be powered down. We have too many VMs getting stuck on OS boot and negatively affecting others at this time, du…
-
(Quote) I understand, I'm just adding onto it that I agree with you and it's not user friendly and I'm also saying that unfortunately our current situation is similar and also not how we intended for it to be coded by the developer. I…
-
(Quote) I agree with you on this. We didn't really have another choice for these. It's painful and bad, for us as well. There are probably 5% of people that have been stuck for 48 hours now and I don't like that but we're doing a…
-
(Quote) Unfortunately there's pretty much nothing we can do about that really. I really think SolusVM did some updates to that tool and broke it for older operating systems recently. They've been breaking a lot of things, like libvirtd inc…
-
(Quote) Finally got an important setting to stick on this one.
-
(Quote) Good to hear Tokyo calmed down a bit, at least on a single server.
-
Some observations about the network, and ARP packets. We kind of spoke about this on OGF but I'm tired of going back there for now, so I'm providing a continuation of it here. These seem to happen whenever more than one subnet is on the s…
-
(Quote) Those have the whacky names because I'm an idiot and wanted to call them "NYCM" as in "M" for "Migrate" or something, because we set up the naming scheme before we verified some details about the servers, b…
-
(Quote) FFME006 should be fine I think, if yours is down it may be unrelated. FFME005, I don't remember, but FFME004 definitely had an issue. Worked on them an hour or so ago and updated the BIOS settings to match Tokyo which has similar disks …
-
In the meantime all Ryzen nodes are getting a final sync of netboot.xyz to make sure that at least works as an option.
-
(Quote) OS templates may have ran into issue for LAX since they were interrupted by the network issue we faced, and then interrupted again with mass migrations. I'll put in another sync soon.
-
Ryzen migrate button will be converted to Ryzen to Ryzen location change button by around the end of this week.
-
(Quote) Miami will be the next thing to be worked on, sometime this week. I do believe our schedule will open back up and we'll also be focusing on returning support response times to normal.
-
Bulk of migrations are complete to some level, with a lot of problems. FFM is still facing disk configuration issue, I couldn't get to it, but luckily only a small number of people are affected outside of FFME04 which rebooted into no disks, an…
-
All migrations ran into pretty much every problem they could with every step of the way. All nodes are going to unfortunately have negatively affected VMs but we're working hard to continue to make sure the majority are functional and we'r…
-
(Quote) A lot of things just end up taking a long time not because they would take a long time to do but because it's difficult to work it into the schedule without the rest of the day falling apart. But yes, walking is faster than taking a car…
-
(Quote) My current node expires on July 05. I'll try to work in time to set up a node here for you. It's all there, it just needs to be configured. Assuming the node doesn't just die on first boot. (Quote) Yeah, it's been rough…
-
(Quote) SolusVM isn't broken on it. I haven't had a chance to fix it since it's lower down the priority list since the node is actually online as you mentioned. Controls will be broken though so anyone's VM that's offline be…
-
(Quote) We're already in a halfway state there. There's probably three phases of old nodes: * Big VLAN, mixed /24 subnets. * Big VLAN, separated /24 subnets with mixed gateway. * Big VLAN, separated /24 subnets and separated gateways. We…
-
Frankfurt almost ready. This will be the first location that I'm trying to launch properly. There's two servers that have potential issues and will be skipped, two that got lost as previously mentioned so there's going to be five ser…
-
(Quote) Honestly I have a lot of notes all over the place and a lot of servers and parts going everywhere right now and don't remember that specifically but I don't remember that one as having NIC issue. I'd have to take a look at eve…