No direction on a cycle
symbolic▲▲△On a cycle of six nodes, write and find its eigenvalues. Show that no polynomial in , and hence no stack of linear graph convolutions with scalar weights, can compute the difference at every node.
Hint
is a circulant matrix, and its eigenvectors are the discrete Fourier modes. For the second part, compare transposes.
Solution
Every node has degree with its self-loop, so has on the diagonal and on the two neighbouring positions of each row, cyclically. On the Fourier mode with it acts as multiplication by
so the eigenvalues are , , , , and . High frequencies are damped and the lowest kept: a low-pass filter.
The difference operator , with , satisfies : it is antisymmetric. Every power of the symmetric is symmetric, so every polynomial is symmetric. A matrix that is both symmetric and antisymmetric is zero, and is not zero. So no polynomial in equals .
A convolution of width three, as in I.11, computes with weights . The graph convolution cannot, because it has no way to tell the neighbour at from the one at . Features that encode position around the cycle, which the bare graph does not supply, would be needed.