Of Notes
Discriminative vs Generative Classification and Laplace Approximation
Problem
(a) (i) [10 marks] State briefly what is meant by discriminative and generative approaches to classification. List one benefit and one problem with each approach.
(ii) [25 marks] Consider the case of binary classification where we wish to determine if an input point
(iii) [25 marks] Assuming the class conditional density
(iv) [10 marks] Describe how using basis functions one might extend the above result to more complicated predictors for the class probabilities.
(b) Consider the following supervised learning problem: we are given some data
(i) [10 marks] Assuming that the labels
(ii) [20 marks] For the case of a zero mean Gaussian prior over