• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Convolutional GRU and Attention based Fall Detection Integrating with Human Body Keypoints and DensePose

Vol. 18, No. 9, September 30, 2024
10.3837/tiis.2024.09.016, Download Paper (Free):

Abstract

The integration of artificial intelligence technology with medicine has rapidly evolved, with increasing demands for quality of life. However, falls remain a significant risk leading to severe injuries and fatalities, especially among the elderly. Therefore, the development and application of computer vision-based fall detection technologies have become increasingly important. In this paper, firstly, the keypoint detection algorithm ViTPose++ is used to obtain the coordinates of human body keypoints from the camera images. Human skeletal feature maps are generated from this keypoint coordinate information. Meanwhile, human dense feature maps are produced based on the DensePose algorithm. Then, these two types of feature maps are confused as dual-channel inputs for the model. The convolutional gated recurrent unit is introduced to extract the frame-to-frame relevance in the process of falling. To further integrate features across three dimensions (spatio-temporal-channel), a dual-channel fall detection algorithm based on video streams is proposed by combining the Convolutional Block Attention Module (CBAM) with the ConvGRU. Finally, experiments on the public UR Fall Detection Dataset demonstrate that the improved ConvGRU-CBAM achieves an F1 score of 92.86% and an AUC of 95.34%.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Y. Zheng, C. Liao, R. Xiao, Q. He, "Convolutional GRU and Attention based Fall Detection Integrating with Human Body Keypoints and DensePose," KSII Transactions on Internet and Information Systems, vol. 18, no. 9, pp. 2782-2804, 2024. DOI: 10.3837/tiis.2024.09.016.

[ACM Style]
Yi Zheng, Cunyi Liao, Ruifeng Xiao, and Qiang He. 2024. Convolutional GRU and Attention based Fall Detection Integrating with Human Body Keypoints and DensePose. KSII Transactions on Internet and Information Systems, 18, 9, (2024), 2782-2804. DOI: 10.3837/tiis.2024.09.016.

[BibTeX Style]
@article{tiis:101214, title="Convolutional GRU and Attention based Fall Detection Integrating with Human Body Keypoints and DensePose", author="Yi Zheng and Cunyi Liao and Ruifeng Xiao and Qiang He and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2024.09.016}, volume={18}, number={9}, year="2024", month={September}, pages={2782-2804}}