Homepage › Solution manuals › Kevin P. Murphy › Machine Learning: a Probabilistic Perspective › Exercise 24.5 - Gibbs sampling for robust linear regression with a Student t likelihood
Exercise 24.5 - Gibbs sampling for robust linear regression with a Student t likelihood
Answers
Recall that in robust linear regression, each sample is assigned an extra latente variable as the estimation of the noise. The complete likelihood is:
From which we can read that the conditional distribution for takes the form:
hence is again a Gamma distribution.
For the variance , its conditional posterior is:
which can be absorbed into the prior with an Inverse-Gamma form.
Finally, for the weight , the conditional posterior takes the Gaussian form, so using a Gaussian conjugate prior is sufficient for Gibbs sampling update.