The stars came out in force for Olivier Rousteing's belated birthday bash in L.A.