Homepage › Solution manuals › Kevin P. Murphy › Machine Learning: a Probabilistic Perspective › Exercise 2.9 - Conditional independence
Exercise 2.9 - Conditional independence
Answers
For question (a), the antecedent means that , and we have
The antecedent can be translated to that , and ,
What we desire to obtain is , and ,
This is correct by having in the first equation taking values in solely. Since .
For question (b), we have the premises: , , and :
The desired result if ,
Let and be two disjoint events, and be another pair of disjoints, and none of is empty w.r.t. the underlying probability measure. Finally, let . One can then check that the equation above does not hold for this setting, hence the deduction in (b) is false.
(b) is intuitively false. A straightforward example is a cryptography example: group signature with three participants. The group signature is a protocol for encryption/verification that ensures a series of security requirements including:
- Anyone participant solely cannot pass the verification.
- Two participants can pass the verification.
For example, let Alice and Bob each hold half of the secret key denoted by and respectively, denotes the ciphertext, and denotes the plaintext. Good group encryption would meet both antecedents in (b) but fails the conclusion. An example of a naive group signature is to use a quadratic function as the secret key:
And provide two different points , from to Alice and Bob. Both antecedents in (b) are satisfied (by correctly translating the density) since the value of yields no information about . However, given both and then is a determinstic function of :
and the independence no longer holds. Note that a third participant is necessary to reveal the entire secret key . In practice, the calculation is usually done on an algebraic field/group, e.g. the elliptic curves, to deal with the problem with the density of which is usually not uniform in the real number field.