Speech technologies for mental health: from corpora to use in real-life situations
Corpora
Corpora design and collection
I have designed two corpora (unfortunately not available for sharing due to legal restrictions) :
- The MSLTc: the Multiple Sleep Latency Test corpus has been recorded at the Sleep Department of the Bordeaux University Hospital (France). It contains the recording of 135 patients with complaints of hypersomnolence undergoing an MSLT (gold standard reference test in sleep medicine). Before each iteration of the MSLT, the patients are recorded reading out loud a text. More details are available in previous publications [Martin et al. 2020, Martin et al. 2021]
- The SOMVOICE corpus: this corpus has been recorded with healthy (screened) participants at the SANPSY lab. Similarly, each participant read out loud a text before the iterations of an MSLT. They undergo this procedure two times: after a normal night (control) and after a night of total sleep deprivation (randomized order). The analysis of this corpus in ongoing.
Critical analysis of corpora labels regarding mental health
Since all the speech-based machine learning models are trained on datasets, the way they are collected and labeled plays a strong role in the generalization of such algorithms.
- In collaboration with J.-L. Rouas (Univ. Bordeaux), I have recently written an article about the limitations of annotating speech corpora with diagnosis. Instead, I promote the labeling of speech corpora using symptoms.
- In collaboration with Pr. J.-A. Micoulaud-Franchi (Univ. Bordeaux), we have written an article about the importance of semiology in clinical reasoning in psychiatry and proposed a beautiful visualization (available here).
In the same vein, I am pursuing my work about psychiatric and sleep semiology [e.g. Martin et al. 2023, Martin et al. 2024] in collaboration with Pr. J.-A. Micoulaud-Franchi (project NUITs, funded by the SFRMS, in collaboration with HP2 — Grenoble, France).
Speech analysis
Under construction
Use in real-life situations
Under construction
