How Robust is Conditional Inference?