China is facing challenges in caring for older adults. This paper aimed to understand knowledge, attitude, and practice (KAP) regarding the quality of caregivers for the elderly in long-term care institutions in Zhejiang Province, and also to find related factors to improve the quality of caregivers. A cross-sectional survey was conducted from April to June 2016 in Zhejiang Province. In total, 84 caregivers were interviewed face-to-face with questionnaires on KAP towards elderly care. Multiple linear regression was used to find the related factors to KAP. A conceptual model was made to process path analysis among KAP and influencing factors using structural equation modeling. The study found that most caregivers in Zhejiang Province were middle-aged, female, and with a diploma below middle school. Many caregivers had not received any pre-employment training. Their salary was low although they undertook high-intensity work. Education and working years had a positive effect on knowledge and practice scores, and pre-employment training had a positive effect on knowledge and attitude scores. Knowledge and attitude regarding elderly care could positively affect elderly care practices. The quality of caregivers in Zhejiang Province was at a low level compared to developed countries. Continuous and regular elderly care training should be provided for caregivers to improve their elderly care knowledge and hence the quality of elderly care.