It was not rogue plugins in my case. It was a misguided red-redirect (pun intended)
This seems to be especially true if you install wordpress on godaddy. they install wordpress with domain.com as the root directory , not http://www.domain.com. so if you have a re-direct that points domain.com to http://www.domain.com, you could cause an infinite loop when you load the blog. Solution is to temporarily disable the re-direct, edit the root paths in wordpress and then put the re-direct back
For a detailed report on this look at my blog entry on my development blog