Skip to Main content Skip to Navigation

Reconnaissance de gestes et actions pour la collaboration homme-robot sur chaîne de montage

Abstract : Collaborative robots are becoming more and more present in our everyday life. In particular, within the industrial environment, they emerge as one of the preferred solution to make assembly line in factories more flexible, cost-effective and to reduce the hardship of the operators’ work. However, to enable a smooth and efficient collaboration, robots should be able to understand their environment and in particular the actions of the humans around them.With this aim in mind, we decided to study technical gestures recognition. Specifically, we want the robot to be able to synchronize, adapt its speed and understand if something unexpected arises.We considered two use-cases, one dealing with copresence, the other with collaboration. They are both inspired by existing task on automotive assembly lines.First, for the co-presence use case, we evaluated the feasibility of technical gestures recognition using inertial sensors. We obtained a very good result (96% of correct recognition with one operator) which encouraged us to follow this idea.On the collaborative use-case, we decided to focus on non-intrusive sensors to minimize the disturbance for the operators and we chose to use a depth-camera. We filmed the operators with a top view to prevent most of the potential occultations.We introduce an algorithm that tracks the operator’s hands by calculating the geodesic distances between the points of the upper body and the top of the head.We also design and evaluate an approach based on discrete Hidden Markov Models (HMM) taking the hand positions as an input to recognize technical gestures. We propose a method to adapt our system to new operators and we embedded inertial sensors on tools to refine our results. We obtain the very good result of 90% of correct recognition in real time for 13 operators.Finally, we formalize and detail a complete methodology to realize technical gestures recognition on assembly lines.
Document type :
Complete list of metadata

Cited literature [142 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Tuesday, January 16, 2018 - 4:18:19 AM
Last modification on : Wednesday, November 17, 2021 - 12:31:04 PM


Version validated by the jury (STAR)


  • HAL Id : tel-01681291, version 2


Eva Coupeté. Reconnaissance de gestes et actions pour la collaboration homme-robot sur chaîne de montage. Interface homme-machine [cs.HC]. Université Paris sciences et lettres, 2016. Français. ⟨NNT : 2016PSLEM062⟩. ⟨tel-01681291v2⟩



Record views


Files downloads