Approximation/Cauchy principle/Exercise

Discuss the Cauchy principle of approximation: If, applying a method of approximations, the approximations do not get much better anymore, thought the effort is increased, then the reason is probably that we are close to the truth. Consider mathematical and and non-mathematical examples and counter-examples.