I can’t remove the plugin

The plugin is not working, so I want to remove it after deactivation but I get the following message: “You cannot delete a plugin while it is active on the main site”