Skip to Main content Skip to Navigation
Journal articles

Computer Vision Intelligent Approaches to Extract Human Pose and Its Activity from Image Sequences

Abstract : The purpose of this work is to develop computational intelligence models based on neural networks (NN), fuzzy models (FM), support vector machines (SVM) and long short-term memory networks (LSTM) to predict human pose and activity from image sequences, based on computer vision approaches to gather the required features. To obtain the human pose semantics (output classes), based on a set of 3D points that describe the human body model (the input variables of the predictive model), prediction models were obtained from the acquired data, for example, video images. In the same way, to predict the semantics of the atomic activities that compose an activity, based again in the human body model extracted at each video frame, prediction models were learned using LSTM networks. In both cases the best learned models were implemented in an application to test the systems. The SVM model obtained 95.97% of correct classification of the six different human poses tackled in this work, during tests in different situations from the training phase. The implemented LSTM learned model achieved an overall accuracy of 88%, during tests in different situations from the training phase. These results demonstrate the validity of both approaches to predict human pose and activity from image sequences. Moreover, the system is capable of obtaining the atomic activities and quantifying the time interval in which each activity takes place.
Complete list of metadatas

Cited literature [37 references]  Display  Hide  Download

https://hal.mines-ales.fr/hal-02449209
Contributor : Administrateur Imt - Mines Alès <>
Submitted on : Wednesday, January 22, 2020 - 4:58:25 PM
Last modification on : Sunday, February 16, 2020 - 1:03:39 AM

File

electronics-09-00159-v2.pdf
Publisher files allowed on an open archive

Identifiers

Collections

Citation

Paulo Gonçalves, Bernardo Lourenço, Samuel Santos, Rodolphe Barlogis, Alexandre Misson. Computer Vision Intelligent Approaches to Extract Human Pose and Its Activity from Image Sequences. Electronics, MDPI, 2020, 9 (1), pp.159. ⟨10.3390/electronics9010159⟩. ⟨hal-02449209⟩

Share

Metrics

Record views

34

Files downloads

41