In this paper, the effects of ultrasonic wave on the removal of inorganic scaling and plugging in cores and the influence of the key wave field parameters, process parameters and core physical parameters on the plugging removal efficiency are systematically studied. The main dynamic mechanism of ultrasonic plugging removal is also systematically analyzed. Results show that the transducer frequency, transducer power, ultrasonic treatment time and initial permeability of core have great influence on the effect of ultrasonic scale removal. When the cumulative treatment time of ultrasonic wave exceeds 60 min, the recovery rate of core permeability tends to be stable. Best effect can be achieved when processing for 80-120 min cumulatively; the plugging removal effect is improved with the increase of ultrasonic transducer power and ultrasonic frequency, but the effect of plugging removal is not obvious with the further increasing of them. In addition, it is proved that the effect of removing calcium carbonate plug from near wellbore by hydrochloric acid solution is slightly better than that by ultrasonic treatment alone. Finally, the micro dynamic mechanism of removing inorganic scale plug by high-power ultrasonic treatment is discussed in view of ultrasonic inorganic scale body crushing, ultrasonic cavitation, ultrasonic friction, ultrasonic peristaltic transport operation and ultrasonic fracture-making and permeability-increasing effect.