Site gone from Bing's SERP in a day! :)

2»

Comments

  • bikegremlinbikegremlin ModeratorOGContent Writer

    Bing seems to have gone broken, again - lol. :)

    Relja of House Novović, the First of His Name, King of the Plains, the Breaker of Chains, WirMach Wolves pack member
    BikeGremlin's web-hosting reviews

  • @bikegremlin I'd remove robots.txt if i were you.
    https://www.bikegremlin.com/robots.txt

    # Global rules
    # -----------------
    
    User-agent: *
    Disallow: /wp-json/
    Disallow: /wp-admin/
    Disallow: /cdn-cgi/
    Disallow: /cdn-cgi/bm/cv/
    Disallow: /cdn-cgi/challenge-platform/
    Allow: /wp-admin/admin-ajax.php
    
    Sitemap: https://www.bikegremlin.com/sitemap.xml?lang=hr
    Sitemap: https://www.bikegremlin.com/sitemap.xml?lang=en
    
    # Ban bots that don't benefit us.
    # --------------------------------
    
    User-agent: Nuclei
    User-agent: WikiDo
    User-agent: Riddler
    User-agent: PetalBot
    User-agent: Zoominfobot
    User-agent: Go-http-client
    User-agent: Node/simplecrawler
    User-agent: CazoodleBot
    User-agent: dotbot/1.0
    User-agent: Gigabot
    User-agent: Barkrowler
    User-agent: BLEXBot
    User-agent: magpie-crawler
    Disallow: /
    
    Thanked by (1)bikegremlin
  • bikegremlinbikegremlin ModeratorOGContent Writer

    @Janevski said:
    @bikegremlin I'd remove robots.txt if i were you.
    https://www.bikegremlin.com/robots.txt

    # Global rules
    # -----------------
    
    User-agent: *
    Disallow: /wp-json/
    Disallow: /wp-admin/
    Disallow: /cdn-cgi/
    Disallow: /cdn-cgi/bm/cv/
    Disallow: /cdn-cgi/challenge-platform/
    Allow: /wp-admin/admin-ajax.php
    
    Sitemap: https://www.bikegremlin.com/sitemap.xml?lang=hr
    Sitemap: https://www.bikegremlin.com/sitemap.xml?lang=en
    
    # Ban bots that don't benefit us.
    # --------------------------------
    
    User-agent: Nuclei
    User-agent: WikiDo
    User-agent: Riddler
    User-agent: PetalBot
    User-agent: Zoominfobot
    User-agent: Go-http-client
    User-agent: Node/simplecrawler
    User-agent: CazoodleBot
    User-agent: dotbot/1.0
    User-agent: Gigabot
    User-agent: Barkrowler
    User-agent: BLEXBot
    User-agent: magpie-crawler
    Disallow: /
    

    Why?

    Do you think there's a problem with that setup?

    I have done my best to double check and it seems to be perfectly fine.
    Also, with that same setup, Bing has been able to crawl and index - for a while at least. :)

    Finally, Google has zero complaints.

    Relja of House Novović, the First of His Name, King of the Plains, the Breaker of Chains, WirMach Wolves pack member
    BikeGremlin's web-hosting reviews

  • In my case, Bing removed all pages from the index, but a week ago new pages appeared in the results.

    Thanked by (1)bikegremlin
  • Check the "security & privacy" link in Bing webmaster. Bing removes the whole website from index if there is copyright complain.
    Google just removes pages in question.

    Thanked by (1)bikegremlin
  • bikegremlinbikegremlin ModeratorOGContent Writer
    edited September 2022

    @pkr said:
    Check the "security & privacy" link in Bing webmaster. Bing removes the whole website from index if there is copyright complain.
    Google just removes pages in question.

    Good thinking.

    (checked - all clear on my end )

    Relja of House Novović, the First of His Name, King of the Plains, the Breaker of Chains, WirMach Wolves pack member
    BikeGremlin's web-hosting reviews

Sign In or Register to comment.