Site gone from Bing's SERP in a day! :)

This is an interesting problem I've never faced before, not could help myself by googling.
All the websites from bikegremlin.com domain (bike.bikegremlin.com, io.bikegremlin.com etc.) are gone from Bing's SERP starting from June 26th 2022. Zero, zilch.
DuckDuckGo does the same, while Google and Yandex show all the pages normaly in their serches.
Bing's dashboard shows no errors (robots, page test, live URL test etc.), except for the Site Scan. Site scan returns "Error 400-499".
Full report that I'll update if I get any more ideas, or hear from Bing's support:
Microsoft Bing – site gone from SERP overnight!
If anyone has any ideas to try, I'm all ears.
BikeGremlin I/O
Mostly WordPress ™
Comments
Clearly some IT gremlins at play!
...sorry couldn't help myself
I’ve seen such issues before on a client which got reported plenty of times by his competitors on search engines, for different reasons. Remembered that got removed from Bing and later on added after contacting support.
Web Design Agency - Custom Web Designs
WHMCS.design - WHMCS Themes | Blesta.shop - Blesta Themes
Something I was reading up today coincidentally...
look up Bing Indexnow.
Might be a dead end, or might lead to a solution. YMMV
VPS reviews | | MicroLXC | English is my nth language.
IIRC years ago DuckDuckGo was using Bing's backend when they first launched, so maybe that's still the case and would explain why both exhibit the same behaviour.
Hmm, I think my contents are indexed (according to Bing's dashboard and previous SERPs), it's just removed from SERP as of recently.
BikeGremlin I/O
Mostly WordPress ™
They still use Bing. Pretty much every search engine that isn't Google uses Bing in some way, as Bing is the largest search engine that has an official public search API that other companies can use (whereas Google does not have one). Voice assistants like Alexa also also use Bing.
Daniel15 | https://d.sb/. List of all my VPSes: https://d.sb/servers
dnstools.ws - DNS lookups, pings, and traceroutes from 30 locations worldwide.
Yup. Roughly 5 - 10 % traffic from those combined (about 70 - 80 % from Google).
Still, it's strange - and it sucks.
BikeGremlin I/O
Mostly WordPress ™
I shall check all mine later!
I sometimes worry that I'm so correct in all I say, that there might be something wrong with me
Any more details on this contacting support part?
Why?
I've used this situation to check out some Google alternatives.
Made a list of search engines that use Bing (Bing copies basically), followed by a list of search engines that seem to be independent.
Bing is still "working on this and keeping me informed."
BikeGremlin I/O
Mostly WordPress ™
Do you have Super Bot Mode enabled in Cloudflare?
No. But a good call - that's what CF support first asked.
Not all the CF sites are affected - though all used the same CF setup.
Only one domain. So it may not be CF-related at all.
Though one can never be certain - too many stuff in stack, relying on each other.
I'm surprised it ever works at all in the first place.
BikeGremlin I/O
Mostly WordPress ™
I have the same problem and made some analysis at bing webmaster to discover that Super Bot Mode is blocking Bing:
https://community.cloudflare.com/t/super-bot-mode-blocking-bing-bot-from-reading-sitemaps/316208
You can test this here: https://www.bing.com/webmasters/sitescan
I have superbot disabled.
Site Scan doesn't work on both affected and unaffected websites.
Go figure...
Relayed all the info to Bing's support.
BikeGremlin I/O
Mostly WordPress ™
Any updates on this?
Did you check your server logs for issues when you performed Bing Site Scan?
My reliable providers : Ramnode : HostHatch : Serverica : InceptionHosting : AlphaVps : LittleCreekHosting : NexusBytes : Hostodo
Couldn't find anything - not in Cloudflare WAF logs or in server logs.
Contacted both Bing, and Cloudflare support.
However, I host several websites with the same Cloudflare setup, and the same hosting provider, yet only one domain is affected (with more than one website).
That's why I think this is a Bing-induced problem and probably has nothing to do with Cloudflare or hosting.
I'm keeping the Bing website removal article up-to-date with any info.
BikeGremlin I/O
Mostly WordPress ™
@bikegremlin got linked to on Hacker News!
https://news.ycombinator.com/item?id=32361648
Seems like the home page is back to Bing & Co.
But zero search queries show any of my articles - so practically it’s still gone from Bing.
We’ll see if that changes.
BikeGremlin I/O
Mostly WordPress ™
He deserves it. Writes amazingly well and about interesting stuff!
Got an email from Bing that my websites were blocked, and upon review, they decided to lift the block - so it should all be fine in about 3 weeks. A bit more info:
Manual unblock?
We'll know by September, I suppose.
BikeGremlin I/O
Mostly WordPress ™