I found that old entries in our server’s /etc/hosts file redirected traffic for the slow sites back out to our external IP address. This caused a massive slow-down. By removing them it fixed the slow wp-admin side. The rest of the site was never slow.