Intervention over the banning of fans at the Aston Villa match was late and clumsy, MPs say.