I think I figured out what the problem is, more or less. It’s a conflict with the theme I’m using. When I switched to different theme, the Lightbox suddenly started working. Not really sure where the specific conflict in the theme code is, but at least it possibly isn’t something wrong with Lightbox or something I failed to do.