Md. Asif Uddin
    I.14.X04

    No direction on a cycle

    symbolic▲▲△

    On a cycle of six nodes, write A^\hat{\mat A} and find its eigenvalues. Show that no polynomial in A^\hat{\mat A}, and hence no stack of linear graph convolutions with scalar weights, can compute the difference xi+1−xi−1x_{i+1}-x_{i-1} at every node.

    Hint

    A^\hat{\mat A} is a circulant matrix, and its eigenvectors are the discrete Fourier modes. For the second part, compare transposes.

    Solution

    Every node has degree 33 with its self-loop, so A^\hat{\mat A} has 13\tfrac13 on the diagonal and on the two neighbouring positions of each row, cyclically. On the Fourier mode xi=eiθix_i=e^{\mathrm i\theta i} with θ=2πj/6\theta=2\pi j/6 it acts as multiplication by

    e−iθ+1+eiθ3=1+2cos⁡θ3,\frac{e^{-\mathrm i\theta}+1+e^{\mathrm i\theta}}{3}=\frac{1+2\cos\theta}{3},

    so the eigenvalues are 11, 23\tfrac23, 23\tfrac23, 00, 00 and −13-\tfrac13. High frequencies are damped and the lowest kept: a low-pass filter.

    The difference operator D\mat D, with (Dx)i=xi+1−xi−1(\mat D\vec x)_i=x_{i+1}-x_{i-1}, satisfies DT=−D\mat D^{\mathsf T}=-\mat D: it is antisymmetric. Every power of the symmetric A^\hat{\mat A} is symmetric, so every polynomial ∑kckA^k\sum_kc_k\hat{\mat A}^k is symmetric. A matrix that is both symmetric and antisymmetric is zero, and D\mat D is not zero. So no polynomial in A^\hat{\mat A} equals D\mat D. ■\blacksquare

    A convolution of width three, as in I.11, computes D\mat D with weights (−1,0,1)(-1,0,1). The graph convolution cannot, because it has no way to tell the neighbour at i+1i+1 from the one at i−1i-1. Features that encode position around the cycle, which the bare graph does not supply, would be needed.

    Draws on