I too have exactly the same problem and, no, WordPress does not support non-standard http ports with SSL. So if you have another service on 80 and you want to install WordPress at that machine on 8080 and enable SSL you’re pretty much stuck with what you said: set siteurl to your https address and home to your http address.
