With the gradual increase of the aging population in Chinese society, the incidence of knee osteoarthritis showed an increasing trend. However, there are very few practical solutions for it. As a novel neuromuscular training technique, whole-body vibration training has become a candidate for treating knee osteoarthritis. In this review, we firstly elaborated on the mode of action and influence factors of the whole-body vibration training. Next, we summarized its effects in knee osteoarthritis, including improving knee function and some uncertain muscle function and proprioception effects. Next, we also summarized its possible mechanisms, including improving bone microstructure, delaying articular cartilage degeneration, modulating inflammatory cells and inflammatory factors. Then, we summarized the clinical effectiveness of whole-body vibration training by analyzing some clinical randomized controlled trials. Finally, based on the above summary, we analyzed and listed the limitations of whole-body vibration training in treating knee osteoarthritis and found the shortcomings in the existing studies. This review provides ideas for the future application of whole-body vibration training in the treatment of knee osteoarthritis.