Homepage › Solution manuals › Kevin P. Murphy › Machine Learning: a Probabilistic Perspective › Exercise 2.17 - Expected value of the minimum
Exercise 2.17 - Expected value of the minimum
Answers
Let denote the location of the left most point, we have:
Therefore:
For the second equation, note that:
therefore
There are perhaps more intuitive solutions to this problem, for example, plotting the value of , and into one graph:
The height of the cyan pyramid at marks the value of , so the expectation of the statistics equals the average height, in this case also the volume of the pyramid, . One can also graphically compute the average distance between and from the following plot:
Since the average distance between and is , so is that between and . Moreover, we have , hence .
However, the graphical method, although entertaining and inspiring, should not be considered as a reliable option in proving probability properties. The dependency can complicate the underlying topology (e.g., the plane might have another geometry other than the Euclidean one, if and are not independent), resulting in confusions and fallacies.
For example, if is subject to a uniform distribution on while is uniformly distributed in . Then the pyramid in Fig. 1 is left with the region along the diagonal line in the - plane. This generalization is insignificant since it only changes the region where the integral shall be done.
Consider the case where and are independent random variables subject to truncated Gaussian centered at on . The plot for visualizing is the same as Fig. 1. However, to compute the expectation of , one cannot simply calculate the volume of the pyramid since the geometry of the - plane has changed.