Homepage Solution manuals Kevin P. Murphy Machine Learning: a Probabilistic Perspective Exercise 21.6 - Alternative derivation of the mean field updates for the Ising model

Exercise 21.6 - Alternative derivation of the mean field updates for the Ising model

Answers

The energy for the Ising model is given by:

E ( 𝐱 ) = i = 1 D j nbr i W 𝑖𝑗 x i x j i = 1 D L i ( x i ) ,

where the first term corresponds to the interaction field and the second to the external field. The variational free energy (VFE) is the expectation of the energy after replacing each x i with a Bernoulli random variable whose mean is μ i . The dependency of the VEF on μ i is:

μ i j nbr i W 𝑖𝑗 μ j 1 μ i 2 L i + μ i 1 2 L i ,

from which we can derive the posterior margin as well as the new mean, which are identical to (21.46)-(21.48). Thus the update (21.50) remains the same.

User profile picture
2021-03-24 13:42
Comments