This paper proposes a sliding mode active disturbance rejection control scheme to deal with trajectory tracking control problems for the quadrotor unmanned aerial vehicle (UAV). Firstly, the differential signal of the reference trajectory can be obtained directly by using the tracking differentiator (TD), then the design processes of the controller can be simplified. Secondly, the estimated values of the UAV's velocities, angular velocities, total disturbance can be acquired by using extended state observer (ESO), and the total disturbance of the system can be compensated in the controller in real time, then the robustness and anti-interference capability of the system can be improved. Finally, the sliding mode controller based on TD and ESO is designed, the stability of the closed-loop system is proved by Lyapunov method. Simulation results show that the control scheme proposed in this paper can make the quadrotor track the desired trajectory quickly and accurately.