For anyone that needs an update:
The resolution is that we must be signed in to wordpress.com as well in order to see the comments window in our wp-admin dashboard.
I suppose I’d inadvertently signed out of wordpress.com and that’s what was causing this.