See: Machine Learning Discipline, Computational Learning Theory, COLT, Probably Approximately Correct Learning, Generalization Error.