My bad. I realised it’s the twentyeleven’s image styling that screws it up. I tired it on a bare theme and it works just like it’s supposed to, so disregard everything above 😉 Thanks!
I now tried with uploading square photos (from Instagram) and it works fine. Didn’t realize the images had to be square. There’s a {left: -XXpx;} on some elements that’s messing with the positioning when using different sizes. What’s your suggestion? Using square photos, or adding custom sizes for the thumbnail used?
Checked both javascript console and wordpress log but no clues there. Should I provide the gallery with custom sizes of the images, shouldn’t be necessary right?