Ended up deactivating through WordPress admin, and then deleted via FTP.
Turns out serving the structured data in the head was an easy modification to the plugin. Would you be interested in adding this feature to your next release? I can send specific notes on modifying via pm/email.