I guess posting this thread saved me as I found the solution thanks to the following thread :
https://ww.wp.xz.cn/support/topic/redirect-loop-in-admin-after-deactivating-when-used-with-ssl-cert/
I added the following to wp-config.php and my access to wp-admin got granted again
$_SERVER[‘HTTPS’] = ‘on’;
define(‘FORCE_SSL_ADMIN’, true);
define(‘WP_HOME’, ‘https://www.yourdomain.com/’);
define(‘WP_SITEURL’, ‘https://www.yourdomain.com/’);