Remove Category

I no longer want to use a category name (no blog posts are associated with it), but its still showing up in my Category widget as a category that can be selected. How can I permanently remove it so it no longer appears?