To investigate the microscopic mechanism of erosion damage in hydraulic machinery, a qualitative study on the movement characteristics of cavitation bubbles near a single spherical particle was conducted using high-speed photography experiments, based on Weiss’s theorem and Kelvin impulse theory. The Kelvin impulse of cavitation bubbles was quantitatively analyzed with respect to important parameters such as the particle radius and cavitation bubble radius. The results indicate that the theoretical model of Kelvin impulse of cavitation bubbles can effectively predict the movement characteristics of cavitation bubbles under the influence of a single particle. The absolute value of the Kelvin impulse decreases with increasing dimensionless distance between the particle and the cavitation bubble. Compared with linear sinks, virtual point sources contribute more significantly to the Kelvin impulse of cavitation bubbles.