I think, with this plugin you can only add script to header or footer. Once added, you cannot use this plugin to modify or delete already added script. So, even after removing this plugin, the already added script remains in the page.
This is my assumption. If this is correct, can anyone enlighten, how we can modify or delete already added script?