Making Complicated Headers

I’ve just started with WordPress and suspect I am beating my head against the wrong wall.

My goal is something like the top lines of Tribune Media from the showcase. I want to put up my name and logo in center, an English/Spanish toggle on the right, and an address and phone number below that.

I’ve been messing with the Themes, looking for something that gives me that sort of choice.

I’m also trying to work out what I need to edit in order to add these details. Style.css? Header.php? Something else?

I am pretty sure that if I knew where to write, I could manage the HTML and CSS to accomplish what I’m after.

Thank you.