Evaluation of New Computer Vision Methods to Characterize Depression Severity in Patients Hospitalized for Severe Depression.

Participation in the CALYPSO project will be offered to all patients with severe depression hospitalized in the adult psychiatry department of Lille CHU.

An initial visit will provide a standardized clinical assessment with: a medical history and history of the disease, a standardized structured Hamilton scale interview (scale with a score from 0 to 21; the higher the score, the more severe the depression) to assess the severity of depression, and a search for the different features of severe depression (melancholic, psychotic, anxious, catatonic, seasonal) using DSM-5 criteria (list of criteria to be validated to determine the type of clinical features). When assessing the severity of depression using the Hamilton scale interview, the patient will be seated in an armchair 2 to 3 meters from a camera on a tripod, positioned behind the clinician and enabling the entire interview to be recorded and, in particular, several observable and measurable psychiatric signs and symptoms, known as objective markers. From the video will be extracted face landmark and pose parameter using state-of-the-art open source software (Mediapipe) to analyze patients' emotional facial expressions and spatial movements. Moreover, a microphone will be used to capture the audio synchronously with the video. Speech will be automatically transcoded using state-of-the-art Automatic Speech Recognition system (DeepSpeech) to enable analysis of voice-related parameters (voice timbre, prosody, sound intensity). A recording of physical activity (3-axis accelerometer sensor; 32 Hz) and emotional reactivity (heart rate in beats per minute 1Hz; electrodermal activity 4 Hz; skin temperature in degrees 4 Hz; Empatica© bracelet) and brain activity (cerebral blood flow change index 10Hz; pulse rate in bpm 10Hz; 3-axis acceleration and angular velocity of the head 10Hz via functional Near-Infrared Spectroscopy (fNIRS) using a HOT-2000 wearable headset) will also be offered to the patient to complete the assessment. The Hamilton scale interview and recording of objective markers will be carried out weekly during the patient's hospitalization in an examination room specifically equipped for the project, on the second floor of the Fontan Hospital, in the psychiatry department of the Lille University hospital.

Longitudinal follow-up will be carried out with assessments at 3, 6 and 12 months after hospital discharge, including the Hamilton scale interview and recording of objective markers (i.e., emotional facial expressions, spatial movements, voice timbre, prosody, sound intensity, physical activity, heart rate, electrodermal activity, skin temperature).