Duplicate Comment Emails

Hi, I have to notifications setup, one for a new comment go to the post author and another to go to the comment author if someone replies. The issue I am having is that the author is also getting new comment notifications every time there is a reply.