• Bayes Optimal Classifier

    The Bayes optimal classifier achieves minimal error across all possible classifiers. We give a proof of this and provide some numerical examples.
  • Probably Approximately Correct (PAC)

    In this post I explain some of the fundamentals of machine learning: PAC learnability, overfitting and generalisation bounds for classification problems. I show how these concepts work in detail for the problem of learning circumferences.