Title: Google Server Crawl Errors & robot txt fetch errors
Last modified: August 22, 2016

---

# Google Server Crawl Errors & robot txt fetch errors

 *  [rlueth](https://wordpress.org/support/users/rlueth/)
 * (@rlueth)
 * [11 years, 4 months ago](https://wordpress.org/support/topic/google-server-crawl-errors-robot-txt-fetch-errors/)
 * Changed to WordPress in January ’14 from standard a html format website. Getting
   GWT crawl errors at average 800+/day for last 90 days (at least) and all the 
   errors listed show a /xxxxx.html URL. These are the old (pre-WrodPress) URL’s
   and I don’t what is causing Google to look for those old URLs and not being directed
   to my new WP site ([http://pgaa.com](http://pgaa.com)). On Jan 2 I started getting
   robot txt fetch errors several times and as late as January 26. Are these affecting
   the visibility of my new WP sites? Should my hosting company be doing something?

Viewing 1 replies (of 1 total)

 *  [wldwil](https://wordpress.org/support/users/wldwil/)
 * (@wldwil)
 * [11 years, 4 months ago](https://wordpress.org/support/topic/google-server-crawl-errors-robot-txt-fetch-errors/#post-5721082)
 * Are all the pages from your old website deleted that had different URL then existing
   pages?
 * Have you done any redirecting from old pages to new ones if the URL has changed?
 * Have you created a new sitemap and submitted to Google through your Webmaster
   tools? I did not see a sitemap at pgaa.com/sitemap.xml
 * I scanned 500 pages of your website and found only 3 broken links.

Viewing 1 replies (of 1 total)

The topic ‘Google Server Crawl Errors & robot txt fetch errors’ is closed to new
replies.

## Tags

 * [GWT](https://wordpress.org/support/topic-tag/gwt/)

 * In: [Fixing WordPress](https://wordpress.org/support/forum/how-to-and-troubleshooting/)
 * 1 reply
 * 2 participants
 * Last reply from: [wldwil](https://wordpress.org/support/users/wldwil/)
 * Last activity: [11 years, 4 months ago](https://wordpress.org/support/topic/google-server-crawl-errors-robot-txt-fetch-errors/#post-5721082)
 * Status: not resolved

## Topics

### Topics with no replies

### Non-support topics

### Resolved topics

### Unresolved topics

### All topics