Title: Crawl Issue Last modified: November 14, 2022 --- # Crawl Issue * Resolved [dawodus](https://wordpress.org/support/users/dawodus/) * (@dawodus) * [3 years, 6 months ago](https://wordpress.org/support/topic/crawl-issue/) * Hello DevNihil, i have a crawling issues on my website.. Sitemap will not on the google search console even after I several attempt. i have check my Robots. txt file and everything is in order. * Here are the screenshot [https://prnt.sc/gNntUPkmTC1W](https://prnt.sc/gNntUPkmTC1W) and [https://prnt.sc/_U0n3UvrKJW7](https://prnt.sc/_U0n3UvrKJW7) and this [https://prnt.sc/4m4jo3HCu3lt](https://prnt.sc/4m4jo3HCu3lt) * I have checked all Noindex settings on the Yoast plugin but google won’t read the sitemap. * What do I do please. I need your help Viewing 3 replies - 1 through 3 (of 3 total) * [devnihil](https://wordpress.org/support/users/devnihil/) * (@devnihil) * [3 years, 6 months ago](https://wordpress.org/support/topic/crawl-issue/#post-16206132) * [@dawodus](https://wordpress.org/support/users/dawodus/) We’re sorry to hear you are experiencing this issue on your site. * We reviewed the screenshots you provided and responded to each individually: * > **For the image [https://prnt.sc/gNntUPkmTC1W](https://prnt.sc/gNntUPkmTC1W)** * We aren’t sure what you are trying to indicate as the problem with this specific page. Can you please clarify this? The page shows as being indexed, with no crawl issues, and the page fetch was successful. * > **For the image [https://prnt.sc/_U0n3UvrKJW7](https://prnt.sc/_U0n3UvrKJW7)** * First of all, this image indicates that the `sitemap_index.xml` file you submitted to Google Search Console shows as having been successfully submitted to Google Search Console, so it does appear that Google Search Console did read the sitemap without any issues. * You also indicated on this image that you are concerned by the **‘Discovered URLs’** showing a value of **‘0’**. * Are there any specific URLs that you are seeing as having been submitted, but are not indexed? * We are uncertain why it’s being reported with 0 URLs discovered in Google Search Console, but according to Google, it doesn’t necessarily indicate a problem. You can read more about this [here](https://support.google.com/webmasters/thread/18717501?hl=en). Most probably, Google needs some time to process the sitemap. And do keep in mind that Google Search Console reports are [not real-time](https://seroundtable.com/google-explains-why-the-search-console-has-reporting-delays-21688.html). * So we would like to suggest allowing some time for Google to process the sitemap. For a speedier resolution, you could delete the sitemap in Google Search Console and resubmit it again. Sometimes, it helps to fix the 0 discovered URLs notice faster. We have a good article that can be useful on this topic: [Submit Your Sitemap To Search Engines](https://yoast.com/help/submit-sitemap-search-engines/). * > **For the image [https://prnt.sc/4m4jo3HCu3lt](https://prnt.sc/4m4jo3HCu3lt)** * For the individual issues listed by Google for URLs in the sitemap, these would need to individually addressed, and without us knowing the URLs of the affected URLs, we aren’t able to say for certain whether the reported issues are correct. * For the URLs as being reported as **Not Found (404)**, have you checked any of these URLs to confirm whether they are returning a 404? If so, we’d recommend resolving that by redirecting the URL if possible. At the very least they shouldn’t be included in the sitemap. * As for the URLs being reported as **Excluded by ‘noindex’ tag**, if the Yoast SEO plugin has these pages set to noindex, then they shouldn’t be included in the sitemap at all. * If the sitemap contains pages that are set to noindex, it may indicate that the sitemap itself isn’t updated due it being cached or some other issue. Whereas the XML Sitemap should dynamically update after any modification to it, if the site or server is caching the sitemap this can cause it to not update right away. We also have additional information on this at the following link: [https://yoast.com/help/sitemap-does-not-update/](https://yoast.com/help/sitemap-does-not-update/). ​​ If you are not seeing the sitemap as updated, we would recommend checking your caching settings and to ensure that the sitemap is being excluded from the cache. * If the sitemap is being cached by a plugin we have directions on how to add an exclusion for the sitemap files to your cache plugin at the following link: [https://yoast.com/help/exclude-sitemaps-from-cache/](https://yoast.com/help/exclude-sitemaps-from-cache/) * If you are still experiencing an issue with the sitemap not updating after checking your site’s caching settings, you can also force a cache reset by temporarily disabling the sitemap feature, and then re-enabling it. To do so please perform the following steps: * In order to disable and then re-enable sitemaps in the Yoast SEO plugin, you would need to perform the following actions: - • In WordPress go to **Yoast SEO>General>Features** • Toggle the **‘XML Sitemaps’** option to **‘Off’** • Click **‘Save Changes’** • Toggle the **‘ XML Sitemaps’** option to** ‘On’** • Click **‘Save Changes’** * We also have a guide on how to enable and disable XML Sitemaps here: [https://yoast.com/help/xml-sitemaps-in-the-wordpress-seo-plugin/](https://yoast.com/help/xml-sitemaps-in-the-wordpress-seo-plugin/) * Can you please try the aforementioned suggestions and letting us know whether it resolves your issue and you are able to successfully update the sitemap? * Plugin Support [Maybellyne](https://wordpress.org/support/users/maybellyne/) * (@maybellyne) * [3 years, 6 months ago](https://wordpress.org/support/topic/crawl-issue/#post-16218262) * This thread was marked resolved due to a lack of activity, but you’re always welcome to re-open the topic. Please read [this post](https://wordpress.org/support/topic/read-this-before-your-post/) before [opening a new request](https://wordpress.org/support/plugin/wordpress-seo#new-post). * Thread Starter [dawodus](https://wordpress.org/support/users/dawodus/) * (@dawodus) * [3 years, 6 months ago](https://wordpress.org/support/topic/crawl-issue/#post-16236266) * Hello Maybellyne, * Thank you for your response. I have about 1300 URL in the sitemap but only 1001 are being indexed and 287 are not index on the google. See screenshot [https://prnt.sc/YOkJJG1qsBxU](https://prnt.sc/YOkJJG1qsBxU) * I have performed all troubleshooting process on Google Search Console and on my website but my changes were not updated on the GSC. See [https://tinyurl.com/yzfva2xc](https://tinyurl.com/yzfva2xc) * I am using Yoast but I still dont understand why this is happening. * Thank you Viewing 3 replies - 1 through 3 (of 3 total) The topic ‘Crawl Issue’ is closed to new replies. * ![](https://ps.w.org/wordpress-seo/assets/icon-256x256.gif?rev=3419908) * [Yoast SEO - Advanced SEO with real-time guidance and built-in AI](https://wordpress.org/plugins/wordpress-seo/) * [Frequently Asked Questions](https://wordpress.org/plugins/wordpress-seo/#faq) * [Support Threads](https://wordpress.org/support/plugin/wordpress-seo/) * [Active Topics](https://wordpress.org/support/plugin/wordpress-seo/active/) * [Unresolved Topics](https://wordpress.org/support/plugin/wordpress-seo/unresolved/) * [Reviews](https://wordpress.org/support/plugin/wordpress-seo/reviews/) * 3 replies * 3 participants * Last reply from: [dawodus](https://wordpress.org/support/users/dawodus/) * Last activity: [3 years, 6 months ago](https://wordpress.org/support/topic/crawl-issue/#post-16236266) * Status: resolved