So what’s wrong with using the Twenty Eleven theme?
I don’t mean as in a theme. I am developing my site and want to carry on using WordPress but I want to do it without the theme part. So I am currently using the method of including WordPress without the theme to get blog posts. However, this does mean I can’t use certain features as they are linked to the theme files which do not get included.
Then you’ll need to install a theme. Why not use something like Toolbox or Plaintext?