Hide my website with Cache Plugins

When a site has any page caching enabled, once a user enters the correct password to enter the site the un protected version is cached and served to all visitors, effectively breaking the functionality of this plugin.

Please can this be fixed asap?
Thanks!