Skip to Main content Skip to Navigation
Conference papers

Multimodal Gait Recognition Under Missing Modalities

Abstract : Multimodal systems for gait recognition have gained a lot of attention. However, there is a clear gap in the study of missing modalities, which represents real-life scenarios where sensors fail or data get corrupted. Here, we investigate how to handle missing modalities for gait recognition. We propose a single and flexible framework that uses a variable number of input modalities. For each modality, it consists of a branch and a binary unit indicating whether the modality is available; these are gated and merged together. Finally, it generates a single and compact 'multimodal' gait signature that encodes biometric information of the input. Our framework outperforms the state of the art on TUM-GAID and extensive experiments reveal its effectiveness for handling missing modalities even in the multiview setup of CASIA-B. The code is available online:
Complete list of metadata
Contributor : Vicky Kalogeiton Connect in order to contact the contributor
Submitted on : Friday, September 24, 2021 - 2:58:19 PM
Last modification on : Wednesday, August 31, 2022 - 11:39:04 AM


Explicit agreement for this submission




Ruben Delgado-Escano, Francisco M Castro, Nicolas Guil, Vicky Kalogeiton, Manuel J Marin-Jimenez. Multimodal Gait Recognition Under Missing Modalities. 2021 IEEE International Conference on Image Processing (ICIP), Sep 2021, Anchorage, Alaska (virtual), United States. ⟨10.1109/ICIP42928.2021.9506162⟩. ⟨hal-03353572⟩



Record views


Files downloads