DeepSmile: Anomaly Detection Software for Facial Movement Assessment - Université de Picardie Jules Verne Accéder directement au contenu
Article Dans Une Revue Diagnostics Année : 2023

DeepSmile: Anomaly Detection Software for Facial Movement Assessment


Facial movements are crucial for human interaction because they provide relevant information on verbal and non-verbal communication and social interactions. From a clinical point of view, the analysis of facial movements is important for diagnosis, follow-up, drug therapy, and surgical treatment. Current methods of assessing facial palsy are either (i) objective but inaccurate, (ii) subjective and, thus, depending on the clinician’s level of experience, or (iii) based on static data. To address the aforementioned problems, we implemented a deep learning algorithm to assess facial movements during smiling. Such a model was trained on a dataset that contains healthy smiles only following an anomaly detection strategy. Generally speaking, the degree of anomaly is computed by comparing the model’s suggested healthy smile with the person’s actual smile. The experimentation showed that the model successfully computed a high degree of anomaly when assessing the patients’ smiles. Furthermore, a graphical user interface was developed to test its practical usage in a clinical routine. In conclusion, we present a deep learning model, implemented on open-source software, designed to help clinicians to assess facial movements.

Dates et versions

hal-03958165 , version 1 (26-01-2023)



Eder Rodríguez Martínez, Olga Polezhaeva, Félix Marcellin, Émilien Colin, Lisa Boyaval, et al.. DeepSmile: Anomaly Detection Software for Facial Movement Assessment. Diagnostics, 2023, 13 (2), pp.254. ⟨10.3390/diagnostics13020254⟩. ⟨hal-03958165⟩


13 Consultations
0 Téléchargements



Gmail Facebook X LinkedIn More