We ran into the same issue as we are currently load balancing 3 web servers and make all content changes on 1.
We created a page template that includes the code to manually empty the cache (found in the FAQs) and a new page in wordpress. Now we can load that page and the cache is cleared on that server.
Just make sure you include the url of that page in the list of pages NOT to be cached.
