-
Bayes Optimal Classifier
The Bayes optimal classifier achieves minimal error across all possible classifiers. We give a proof of this and provide some numerical examples. -
Probably Approximately Correct (PAC)
In this post I explain some of the fundamentals of machine learning: PAC learnability, overfitting and generalisation bounds for classification problems. I show how these concepts work in detail for the problem of learning circumferences.