Wigner's puzzle: why does mathematics describe the physical world so well? Cases where mathematics developed for its own sake later turned out to describe reality — non-Euclidean geometry and general relativity, group theory and particle physics.
Predictions made from equations alone and later confirmed: the positron, the Higgs, gravitational waves.