leestroh
Forum Replies Created
Viewing 3 replies - 1 through 3 (of 3 total)
-
I think I may have discovered the “issue”.
This particular domain was setup in Godaddy with anonymous registration, so their DNS passed through a proxy. Removing this proxy and having the A record point directly to our server has the site still displaying as well as rate limiting enabled.
Not sure why this would cause an issue but I’m able to keep rate limiting on now.
SUre thing –
- Immediately block fake Google crawlers – enabled
- If anyone’s requests exceed – 240/minute then throttle
- If a crawler’s page views exceed – 240/minute then throttle
- If a crawler’s pages not found (404s) exceed – 120/minute then block it
- If a human’s page views exceed – 240/minute then throttle
- If a human’s pages not found (404s) exceed – 60/minute then throttle
- How long is an IP address blocked when it breaks a rule – 30 minutes
- This reply was modified 6 years, 7 months ago by leestroh.
Just sent that off, thank you for your reply!
Viewing 3 replies - 1 through 3 (of 3 total)