• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Multi-modal Pedestrian Trajectory Prediction based on Pedestrian Intention for Intelligent Vehicle


Abstract

The prediction of pedestrian trajectory is conducive to reducing traffic accidents and protecting pedestrian safety, which is crucial to the task of intelligent driving. The existing methods mainly use the past pedestrian trajectory to predict the future deterministic pedestrian trajectory, ignoring pedestrian intention and trajectory diversity. This paper proposes a multi-modal trajectory prediction model that introduces pedestrian intention. Unlike previous work, our model makes multi-modal goal-conditioned trajectory pedestrian prediction based on the past pedestrian trajectory and pedestrian intention. At the same time, we propose a novel Gate Recurrent Unit (GRU) to process intention information dynamically. Compared with traditional GRU, our GRU adds an intention unit and an intention gate, in which the intention unit is used to dynamically process pedestrian intention, and the intention gate is used to control the intensity of intention information. The experimental results on two first-person traffic datasets (JAAD and PIE) show that our model is superior to the most advanced methods (Improved by 30.4% on MSE0.5s and 9.8% on MSE1.5s for the PIE dataset; Improved by 15.8% on MSE0.5s and 13.5% on MSE1.5s for the JAAD dataset). Our multi-modal trajectory prediction model combines pedestrian intention that varies at each prediction time step and can more comprehensively consider the diversity of pedestrian trajectories. Our method, validated through experiments, proves to be highly effective in pedestrian trajectory prediction tasks, contributing to improving traffic safety and the reliability of intelligent driving systems.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Y. He, Y. Sun, Y. Cai, C. Yuan, J. Shen, L. Tian, "Multi-modal Pedestrian Trajectory Prediction based on Pedestrian Intention for Intelligent Vehicle," KSII Transactions on Internet and Information Systems, vol. 18, no. 6, pp. 1562-1582, 2024. DOI: 10.3837/tiis.2024.06.008.

[ACM Style]
Youguo He, Yizhi Sun, Yingfeng Cai, Chaochun Yuan, Jie Shen, and Liwei Tian. 2024. Multi-modal Pedestrian Trajectory Prediction based on Pedestrian Intention for Intelligent Vehicle. KSII Transactions on Internet and Information Systems, 18, 6, (2024), 1562-1582. DOI: 10.3837/tiis.2024.06.008.

[BibTeX Style]
@article{tiis:99351, title="Multi-modal Pedestrian Trajectory Prediction based on Pedestrian Intention for Intelligent Vehicle", author="Youguo He and Yizhi Sun and Yingfeng Cai and Chaochun Yuan and Jie Shen and Liwei Tian and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2024.06.008}, volume={18}, number={6}, year="2024", month={June}, pages={1562-1582}}