Page Load Time and Optimizations

I have a WordPress site with extremely varying load times. I’m wondering how much is due to my connection and the actual coding of the site, and how much is due to the hosting and sever.

I’m fairly new to this type of thing and am hoping to get a link to some resources about this or some tips to analyze the data I have.

Page load is approx 490k. Listed below is YSlow data (load time), and then server data:

No WP Super Cache, No Analytics, Logged In:

6.13  <!-- 125 queries. 2.455 seconds. -->
10.36 <!-- 125 queries. 23.619 seconds. -->
4.02  <!-- 123 queries. 7.344 seconds. -->
15.93 <!-- 125 queries. 9.356 seconds. -->
17.68 <!-- 123 queries. 6.147 seconds. -->
41.42 <!-- 123 queries. 10.473 seconds. -->

With WP Super Cache, No Analytics, Logged Out

3.58 <!-- 121 queries. 4.412 seconds. -->  <!-- Dynamic page generated in 4.237 seconds. -->
2.37 <!-- 123 queries. 1.711 seconds. -->  <!-- Dynamic page generated in 1.676 seconds. -->
2.68 <!-- 125 queries. 2.457 seconds. -->  <!-- Dynamic page generated in 2.401 seconds. -->

Some data seems really odd, like the load in the first set that YSlow claims took 4.02 seconds, but the database queries say 7.344.