Exercise 8.1

Answers

(a)
If there’s such a hyperplane that can tolerate noise radius greater than 1 2|x+ x|, we draw a line between two points, for (x+,+1), we can pick a point on the line that just pass the middle point between x+ and x and still within the radius (which is greater than 1 2|x+ x|) of x+. This point will have label + 1. However, it’s obviously also in the radius of x, so it shall have a label of 1 as well. It is impossible to classify such point. This thus contradicts the fact that a hyperplane exists to tolerate such a noise radius. Our assumption is wrong, there’s no such hyperplane that can tolerate noise radius greater than 1 2|x+ x|.
(b)
We can choose the hyperplane that perpendicular to the line between x+ and x and passes through the middle point. The two balls with radius of 1 2|x+ x| and centered at x+,x are separated by this hyperplane totally. The projection of any point in the ball of x+ on the norm of the hyperplane is positive.

Thus the hyperplane can tolerate such a noise radius.

User profile picture
2021-12-08 10:00
Comments