Md. Asif Uddin
    I.14.X05

    How fast a hexagon smooths, and why self-loops matter

    limit▲▲△

    Using the eigenvalues of I.14.X04, find how many graph-convolution layers bring the distance from the limit on a hexagon below one per cent of where it started. Then drop the self-loops, using D−1/2AD−1/2\mat D^{-1/2}\mat A\mat D^{-1/2}, and apply it repeatedly to the alternating signal (1,−1,1,−1,1,−1)(1,-1,1,-1,1,-1). What happens as the number of layers grows?

    Hint

    The distance shrinks by at most the largest eigenvalue below 11 in absolute value per layer. Without self-loops every degree is 22.

    Solution

    The eigenvalues other than 11 are 23\tfrac23, 23\tfrac23, 00, 00 and −13-\tfrac13, so ∣λ2∣=23|\lambda_2|=\tfrac23 and the distance after kk layers is at most (23)k(\tfrac23)^k times its start. (23)11=0.011561(\tfrac23)^{11}=0.011561 and (23)12=0.007707(\tfrac23)^{12}=0.007707, so 1212 layers suffice for any starting signal, and a signal with a component along the slowest mode needs that many.

    Without self-loops the operator is A/2\mat A/2, and its eigenvalues are cos⁡θ\cos\theta for θ=2πj/6\theta=2\pi j/6: 11, 12\tfrac12, 12\tfrac12, −12-\tfrac12, −12-\tfrac12 and −1-1. The eigenvalue −1-1 belongs to the alternating signal: each node’s two neighbours have the opposite sign, so the average is exactly the negative. The signal flips sign at every layer and never converges. The limit of I.14.T3 does not exist.

    The hexagon is bipartite, since its nodes split into alternate halves with every edge between them, and every bipartite graph has this eigenvalue. The self-loop mixes each node with itself. On a graph where every degree is rr it maps each eigenvalue λ\lambda of the plain operator to (rλ+1)/(r+1)(r\lambda+1)/(r+1), so −1-1 becomes (1−r)/(r+1)(1-r)/(r+1), which is −13-\tfrac13 here. On any connected graph it rules out −1-1.

    Draws on