Passenger jet pushed back from gate before everyone is seated?

Maybe a bit of a mundane question but I was on LH447 from Denver to Frankfurt yesterday and the plane pushed back from the gate while at least half a dozen people were still in the aisle, loading their bags and finding their seats. I always assumed that