In this paper, a within-host HIV-1 infection model with virus-to-cell and direct cell-to-cell transmission and explicit age-since-infection structure for infected cells is investigated. It is shown that the model demonstrates a global threshold dynamics, fully described by the basic reproduction number. By analysing the corresponding characteristic equations, the local stability of an infection-free steady state and a chronic-infection steady state of the model is established. By using the persistence theory in infinite dimensional system, the uniform persistence of the system is established when the basic reproduction number is greater than unity. By means of suitable Lyapunov functionals and LaSalle's invariance principle, it is shown that if the basic reproduction number is less than unity, the infection-free steady state is globally asymptotically stable; if the basic reproduction number is greater than unity, the chronic-infection steady state is globally asymptotically stable. Numerical simulations are carried out to illustrate the feasibility of the theoretical results.