What rescaling the parameters does and does not change
symbolic▲▲△Let and replace by . Determine what happens to the decision boundary, the predicted labels, the functional margin, and the geometric margin. Then say which of the two margins can appear in a theorem and why.
Hint
Write each quantity out with the in place and see whether it cancels.
Solution
The boundary. The set equals , and since this is the same set as before. Unchanged.
The labels. for . Unchanged.
The functional margin. becomes
Scaled by . It can be made as large as one likes by taking large, without moving the boundary an inch.
The geometric margin. Both numerator and denominator scale:
Unchanged. The cancels exactly.
Which one can appear in a theorem. Only the geometric margin. A theorem whose hypothesis was “the functional margin is at least ” would be vacuous: given any separating hyperplane, multiply its parameters by and the hypothesis is satisfied, with no change to the classifier at all. The statement would constrain nothing.
This is why I.2.T1 is stated with a unit vector , and why the proof in I.2.B03 uses in its Cauchy–Schwarz step. Normalising is not tidiness; it is what makes the quantity a property of the data rather than of an arbitrary scaling.
A consequence worth carrying forward. Any quantity you plan to threshold, compare across models, or put in a bound must be checked for this kind of spurious freedom first. The same question recurs for attention scores in II.3 — where the answer is that removes a scale that would otherwise grow with width — and for logits in IV.8, where a temperature does exactly what does here.
One asymmetry. For the boundary is still unchanged but every label flips, since . So the invariance is to positive rescaling only, and the sign of carries the orientation — which side is which.