Avatar Doesn’t Change

I use another plugin to use avatars instead of gravatars for some of my authors. But when I do that for some reason the avatar does not change in simple author box, instead it uses my gravatar instead of the authors picture. Is there anyway I can fix this?