Title: HTTP Response Code – Bots cannot crawl
Last modified: November 15, 2017

---

# HTTP Response Code – Bots cannot crawl

 *  [chippy818](https://wordpress.org/support/users/chippy818/)
 * (@chippy818)
 * [8 years, 6 months ago](https://wordpress.org/support/topic/http-response-code-bots-cannot-crawl/)
 * Hi, have a major issue that Google cannot even help me. For some reason my Ad
   on Google Adwords keep on getting disqualified. I called more that I can count
   with Google and every time they offer me a solution that did not work.
 * So the latest story is that they are saying my website is having issues where
   as Bots have a hard time crawling my website. So this was the reasoning why my
   Ad keeps getting Disqualified. All they can say is talk to my web developer and
   find out why? Well I am the web developer and I have no clue. Google has no clue.
 * Any help would be huge!
 * The page I need help with: _[[log in](https://login.wordpress.org/?redirect_to=https%3A%2F%2Fwordpress.org%2Fsupport%2Ftopic%2Fhttp-response-code-bots-cannot-crawl%2F%3Foutput_format%3Dmd&locale=en_US)
   to see the link]_

Viewing 2 replies - 1 through 2 (of 2 total)

 *  Moderator [Jan Dembowski](https://wordpress.org/support/users/jdembowski/)
 * (@jdembowski)
 * Forum Moderator and Brute Squad
 * [8 years, 6 months ago](https://wordpress.org/support/topic/http-response-code-bots-cannot-crawl/#post-9687154)
 * > Hi, have a major issue that Google cannot even help me. For some reason my 
   > Ad on Google Adwords keep on getting disqualified
 * We’re not Google either. What is Google webmaster tools telling you?
 * Also don’t put this in Requests and Feedback, I’ve move it to Fixing WordPress.
 *  [aCstudent](https://wordpress.org/support/users/acstudent/)
 * (@acstudent)
 * [8 years, 6 months ago](https://wordpress.org/support/topic/http-response-code-bots-cannot-crawl/#post-9687740)
 * [https://www.bostonmotorcars.net/robots.txt](https://www.bostonmotorcars.net/robots.txt)
   includes these lines:
 * > User-Agent: *
   >  Disallow:
 * That is likely blocking bots – at least well-behaved ones – from crawling your
   site.

Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘HTTP Response Code – Bots cannot crawl’ is closed to new replies.

 * In: [Fixing WordPress](https://wordpress.org/support/forum/how-to-and-troubleshooting/)
 * 2 replies
 * 3 participants
 * Last reply from: [aCstudent](https://wordpress.org/support/users/acstudent/)
 * Last activity: [8 years, 6 months ago](https://wordpress.org/support/topic/http-response-code-bots-cannot-crawl/#post-9687740)
 * Status: not resolved

## Topics

### Topics with no replies

### Non-support topics

### Resolved topics

### Unresolved topics

### All topics