The Foundations of Statistical Learning
Pantelis Monogioudis
The supervised learning problem statement.
We will cover the value of information, the entropy of a probability distribution and the cross-entropy between two probability distributions.