Just found out I need to add a translation to at least one “normal” WP page so that language gets activated. Maybe there should be a hint to this as CMP is intended for unfinished sites or coming soon so it’s not natural to already have multilingual content…