Hi vivedj,
I have the same thing, I can see my folder and have checked permissions through FTP yet when I try to login, I get a 403 error for my wp-admin page…
and, I run another blog on my site, in a different directory that I also upgraded to 2.5.1 and that one works perfectly !
not sure what to do now !