If "certain" means something like "all available evidence supports this belief; no available evidence opposes it," then once you are certain, the way you stay certain is to avoid collecting any more evidence.
In matters of life and death, that isn’t the right tactic—because your objective is truth, not certainty.
— David Friedman, in HPO