selectums

I did finally figure this out.

If you are using Google XML Sitemaps with W3TC go to
Page Cache under “Performance” in sidebar
Scroll down to Cache Preload
Enter For Sitemap URL: /sitemap.xml

This made all of my google pagespeed 404 errors go away over 24 hours!