The source-free converted-wave (SFCW) reverse time migration is an alternative way to image the subsurface when the source information is missing or the overburden velocities are complex. However, it is challenging due to the lack of source-wavefield constraints. We have derived the SFCW imaging condition from the first gradients of waveform matching objective functions using a set of coupled P- and S-potential equations and small-perturbation approximations. We found that the images obtained from this SFCW imaging condition are second-order approximations to the shear-modulus perturbations. The images produced by the proposed imaging condition are free of the polarity reversal effects and have clear physical meanings. We also find that the acoustic wave equations can be used to back propagate the recorded P- and S-potentials, and the resulting images have the same kinematic accuracy and fewer unphysical mode-conversion artifacts than the SFCW images obtained by the elastic wave equations. Using multiple numerical examples, we determine the accuracy of our formulations, analyze the resolution and artifacts on the resulting images, and develop the limitations of the proposed method.