Rebuild sitemap.xml

Resolved Col_Blimp
(@col_blimp)

10 years, 6 months ago

Hi there, sitemap.xml has only added 3 pages from my site, how to rebuild this?

https://ww.wp.xz.cn/plugins/autodescription/

Viewing 11 replies - 1 through 11 (of 11 total)

Plugin Author Sybre Waaijer
(@cybr)

10 years, 6 months ago

Hi @col_blimp,

The sitemap currently uses only WordPress’ Core Posts and Pages, which are public, published and haven’t been set to “noindex”.
So I’m wondering, are you using any special plugins to generate content?

To get back to your question:
The sitemap.xml content is rebuilt on any of the following actions, whichever comes first:
– After 7 days of last generation
– After post/page update
– After post/page publish
– After SEO Settings change
– After permalink structure update

The next update (2.4.0) will include other post types, I haven’t thought about that yet! Thanks 🙂

I hope this helps!
Thread Starter Col_Blimp
(@col_blimp)

10 years, 6 months ago
Hi there, well I have only a custom 404 page set to noindex and I’m using ‘Total’ theme but have nothing for generating content other than the WordPress editor.

I’ve just went through all pages on the site and edited the ‘Custom Page Title’ in your SEO settings then went to Settings->Permalinks then resaved but the xml remains the same.

Here what the xml looks like:
```
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">

	<url>
		<loc>https://mysite.com/</loc>
		<lastmod>2015-11-22</lastmod>
		<priority>1.0</priority>
	</url>
	<url>
		<loc>https://mysite.com/pageid:7/</loc>
		<lastmod>2015-11-22</lastmod>
		<priority>0.9</priority>
	</url>
	<url>
		<loc>https://mysite.com/postid:48/</loc>
		<lastmod>2015-11-22</lastmod>
		<priority>0.9</priority>
	</url>
</urlset>

```
so it has updated but for whatever reason its only listing pages it thinks were edited today but the three pages listed as edited today were not actually edited today other than the SEO edits.
Plugin Author Sybre Waaijer
(@cybr)

10 years, 6 months ago

Hi @col_blimp,

Take a close look at , for if it has changed it should be updated.

I’m not really sure but I think caching plugins can take over my perfectly calculated Transients :(.

Either way, if you’re using a caching plugin, try to see if clearing the total cache works. Otherwise, try re-saving the SEO settings, that should always work (the permalink ‘change’ will only affect the transient when it’s changed).

It’s hard to pinpoint the problem without seeing a website in front of me with the issue, however.

Please read the “SEO Tip of the Update” on the following page for more information regarding sitemaps and its (negligible) importance to SEO. http://theseoframework.com/2015/11/18/2-3-7-simple-sitemaps-revised/

bbPress (from your other question), is a Custom Post Type and is currently not supported for sitemaps. If you have a busy forum it will utterly destroy your website’s performance, so I need to find a way to implement this correctly :).

I hope this helps 🙂 If you have any other questions, feel free to ask!

Thread Starter Col_Blimp
(@col_blimp)

10 years, 6 months ago

Thanks, not using any caching plugins as it messed with the membership system I’m using so I only do browser caching of images.

I know its negligible but in this instance if a sitemap is found (with only 2 pages and a blog post) does that mean the search engine wont bother crawling the rest of the site?
Plugin Author Sybre Waaijer
(@cybr)

10 years, 6 months ago
Hi Col_Blimp,

Short answer:
Search Engines will crawl everything that can be found, regardless of sitemap.

Long answer:

Search Engines use the Sitemap as a tool, from there it will follow all links found, a no-follow tag will remove the link-juice. It will also follow all links from other sites linking to your sites, and from there it will follow everything again.

From an extensive study on sitemaps, they found, and I quote:
“The other 20% of content appear to be missing
content that Discovery found and was not in Sitemaps.” – http://www2009.eprints.org/100/1/p991.pdf

Discovery is the natural crawl of search engines.

More information: https://developers.google.com/custom-search/docs/annotations#sitemaps

Submitting Sitemaps is particularly helpful if your site has the following:
- Dynamic content
- Webpages that aren’t easily discovered by Googlebot (Google’s web crawler), such as pages with rich AJAX or Flash features
- Few websites linking to it. <p>Googlebot crawls the web by following links from one page to another, so if your site isn’t well linked, it is hard for the crawler to discover it. If your website is new, probably not many websites are pointing to your site. </p>
- A large archive of content pages that does not have a strong network of cross-linking
Even more information: https://developers.google.com/custom-search/docs/indexing?hl=en

And then some more: https://www.bing.com/webmaster/help/how-to-submit-sitemaps-82a15bd4

You can check if everything’s indexed, regardless of the sitemap through Google and Bing webmaster consoles.

The following search query will also help you give an idea of what’s indexed:
site:example.com

I hope this helps 🙂
Plugin Author Sybre Waaijer
(@cybr)

10 years, 6 months ago

Hi @col_blimp,

I have an alpha version for you which adds the forum pages, posts and replies to the sitemap.

You can download the alpha version of 2.4.0 of The SEO Framework here:
http://theseoframework.com/share/plugins/autodescription240alpha.zip

This alpha version only adds the functionality for the sitemaps, no extra options.
It will also not listen to the settings based on the indexing set in the pages and posts.

Please note that this will differ from the final version, and it’s not recommended to use on a live production website, as it may add unwanted things to the sitemap which can actually hurt your site’s SEO value.
It does not add extra options so this alpha version is completely backwards and forwards compatible. So you can downgrade (or upgrade, when available) at any time :).

If you wish to use it, please let me know of any bugs you might find 🙂

Thanks and have a great day!

Thread Starter Col_Blimp
(@col_blimp)

10 years, 6 months ago

Hi there, get the dreaded white page of death with the alpha, have all the php errors disabled but I can set them back up if you need some debugging info.

Plugin Author Sybre Waaijer
(@cybr)

10 years, 6 months ago

Hi @col_blimp,

No need! I’ll need to conduct more tests myself before I can release a stable version.

All I need to know is if this white screen of death was only on the Sitemap, or on every page? If it’s the latter there was probably something going wrong with my zipping or FTP.

Be sure to keep your eye out for version 2.4.0, where it will be all good 🙂

Thanks and have a great day!

Plugin Author Sybre Waaijer
(@cybr)

10 years, 6 months ago

Hi @col_blimp,

Although I was saying the sitemap isn’t all-that important, it absolutely won’t hurt to include more links!

So, I’ve rebuilt the sitemap query in 2.4.0, once again massively improved speed (0.1s generation time :D).

This update should include Forums and Topics within the sitemap, among various other custom post types :).

2.4.0 is underway! I’m marking this topic as solved, if you still have questions regarding this subject feel free to reply and/or re-open this topic.

I hope you have a great day!

Thread Starter Col_Blimp
(@col_blimp)

10 years, 6 months ago

Hi there, sitemap in the latest version is as expected, cheers.

Plugin Author Sybre Waaijer
(@cybr)

10 years, 6 months ago

Hi Col_Blimp!

That’s very good to hear! Thanks for confirming 🙂

Viewing 11 replies - 1 through 11 (of 11 total)

The topic ‘Rebuild sitemap.xml’ is closed to new replies.