Adding Template to Existing Template

I noticed that WP has the default template theme which I like. I went to add a new Page and I noticed that over in the right column I have a dropdown that list a few more template choices.

I want to create a new template to that dropdown list but I don’t know how or what all is involved to achieve this.

Thanks.