Arithmetic sequences of perfect squares are in 3-to-1 correspondence with Pythagorean triples over the Gaussians. The paper applies this correspondence to the magic square of squares puzzle to show that a solution would generates 24 arithmetic sequences of perfect squares, rather than the more obvious 8. Some attempts are made to visualize all this geometrically.