guffronmh30

Hi @thegulshankumar

Thank you so much for this, I will take the step one by one from your list with my technical team.

Anyway, do you have any contact/linkedin URL so I can ask you and send screenshot during the process? If you don’t mind.

Thank you.

Gufron.

Hi all @threadi @marferblanco @thegulshankumar

Thank you for reaching me out and trying to help. Let me get the clearer situation from my end:

This is the URLs Example: https://edufrienz.com/edufrienz-blog/self-awareness-games-for-kids/

On Tuesday, March 3rd this page suddenly gone while previously this was rank 3. After I checked some of the new performing pages, yes they are gone. I tried to scrap with Screaming Frog, and they are still 200 (until now). But, when I checked with HTTP STATUS IO, and using googlebot crawlers, it somehow changed into 404 – while like Bingbot, Yahoobot and another crawlers, they are still 200.

So I found a summary that only Googlebot preventing my pages to the SERP.

After I checked on Google Search Console spefically on Live Test URL, it showed error noindex detected in X-Robots-tag http header

I was trying everything, starting from checking robots.txt, htaccess ,asking our hosting until the server level. But, to be honest they are fine.

Then I found a thing to fix which deleting code ‘nonidex’ on WPforms htaccess

After I checked again with Live Test URL, they back to green and successfully can be discovered.

—–

Now my problem is actually my sitemap is still failing to fetch. Is this just the delay or I still miss something? 🙁

—-

Hi Gulshan @thegulshankumar

Thanks for helping me in doing investigation.

For Cloudflare thing, noted I will ask server team to do that. But the estimation will be Monday as this is weekend.

And also about the list you sent, yes they are intentionally noindexed as they are not used anymore. I set noindexed either on robots.txt or manually from WP.

For specific URLs that need to be investigated, please kindly check these two examples:

• https://edufrienz.com/edufrienz-blog/self-awareness-games-for-kids/
• https://edufrienz.com/edufrienz-blog/responsible-decision-making-activities-for-students/
• https://edufrienz.com/product-category/executive-functions-workbook/

I need your further assistance on this. Thank you

Regards,

Gufron

Hi Marta, @marferblanco

Thanks for responding.

We barely touch Cloudflare and this non-indexed issue just happened recently.

And to answer managing our robots files, we are using Rank Math. I have read some of threads inside this forum, and one of them said it came from Rank Math header. we

Can you confirm with that?

• This reply was modified 3 months, 1 week ago by guffronmh30.