Turnstile stopped working

The plugin used to work fine, now I’ve found out that it basically does not prevent login attempts.

Only when I select to disable the submit button.

But if that option is not enabled, a user can attempt to login without authenticating with cloudflare turnstile