Transportation Sean Duffy said his remarks on a recent SiriusXM show were taken out of context, and that he moved his wife's flight because of delays, not safety.