Context-Adaptive Multimodal Informatics for Psychiatric Discharge Planning

Screenshot 2024-04-03 at 8.43.09 AM

Determining when a patient is ready for discharge is an open problem, as currently 20% of those hospitalized for psychiatric illness will be hospitalized again within 30 days. To address this issue, we are working to identify behavioral biomarkers for severe mental illness in 400 inpatients hospitalized for psychosis at McLean. The Multisense project is a collaboration with Dr. with LP Morency‘s team at Carnegie Mellon University, where information is extracted from both audio and video of both clinician and patient during a series of semi-structured inpatient interviews. Multimodal analysis techniques are used both to predict clinical scale and discharge-readiness scores, as well as to visualize a summary of each interview and extract relevant interpretable features.

More