Change error message output

Hi,

I see that the output for the error message is like this:
<p class="error">MESSAGE</p>

I would like to change this for my custom output, how can I do this, what function or hook should I use?

https://ww.wp.xz.cn/plugins/theme-my-login/