Systems and methods for mental health assessment
The present disclosure provides systems and methods for assessing a mental state of a subject in a single session or over multiple different sessions, using for example an automated module to present and/or formulate at least one query based in part on one or more target mental states to be assessed. The query may be configured to elicit at least one response from the subject. The query may be transmitted in an audio, visual, and/or textual format to the subject to elicit the response. Data comprising the response from the subject can be received. The data can be processed using one or more individual, joint, or fused models. One or more assessments of the mental state associated with the subject can be generated for the single session, for each of the multiple different sessions, or upon completion of one or more sessions of the multiple different sessions.
1. A system for identifying whether a subject is at risk of having a mental or physiological condition, comprising:
one or more computer processors; and
a memory comprising machine-executable instructions;
wherein, upon execution, the instructions cause the one or more computer processors to:
(a) obtain data from said subject, said data comprising speech data and optionally associated visual data;
(b) process said data using a plurality of machine learning models comprising a natural language processing (NLP) model and an acoustic model to generate an NLP output and an acoustic output, wherein said plurality of machine learning models comprises a neural network trained on labeled speech data collected from one or more other subjects, wherein said labeled speech data for each of said one or more other subjects is labeled as (i) having, to some level, said mental or physiological condition or (ii) not having said mental or physiological condition;
(c) fuse said NLP output and said acoustic output by (1) applying weights to said NLP output and said acoustic output to generate weighted outputs and (2) generating a composite output from said weighted outputs, wherein said NLP output and said acoustic output each comprise a plurality of outputs corresponding to a plurality of time segments of said speech data, and wherein said weights in (1) are temporally-based; and
(d) output an electronic report identifying whether said subject is at risk of having said mental or physiological condition, based at least on said composite output, which risk is quantified in a form of a score having a confidence level provided in said report.
2. The system of claim 1 , wherein said speech data in (a) is obtained by:
(i) transmitting at least one query in an audio or textual format to said subject, wherein said at least one query is configured to elicit at least one verbal response from said subject; and
(ii) receiving said speech data comprising said at least one verbal response from said subject in response to transmitting said at least one query.
3. The system of claim 2 , wherein said at least one query comprises a plurality of queries and said at least one response comprises a plurality of responses, wherein said plurality of queries is transmitted in a sequential manner to said subject and configured to systematically elicit said plurality of responses from said subject.
4. The system of claim 3 , wherein said plurality of queries is structured in a hierarchical manner such that each subsequent query of said plurality of queries is structured as a logical follow on to said subject's response to a preceding query, and is configured to assess or draw inferences on a plurality of aspects of said mental or physiological condition of said subject.
5. The system of claim 4 , wherein the instructions further cause the one or more computer processors to:
update said score and said confidence level based at least in part on a follow-on response from said subject to said subsequent query.
6. The system of claim 5 , wherein the instructions further cause the one or more computer processors to:
update or assign a clinical value to said updated score having said confidence level.
7. The system of claim 5 , wherein the instructions further cause the one or more computer processors to:
determine whether said confidence level meets a predetermined criterion; and
generate one or more additional queries to assess or draw inferences on said plurality of aspects of said mental or physiological condition of said subject.
8. The system of claim 7 , wherein the instructions further cause the one or more computer processors to:
transmit said one or more additional queries to said subject to elicit one or more additional verbal responses; and
determine whether said confidence level meets said predetermined criterion, based at least in part on said speech data comprising said one or more additional verbal responses.
9. The system of claim 8 , wherein the instructions further cause the one or more computer processors to:
continue to transmit said one or more additional queries to said subject to elicit said one or more additional verbal responses, until said confidence level is determined to meet said predetermined criterion.
10. The system of claim 2 , wherein said confidence level is based at least in part on a length and/or duration measure of said at least one verbal response.
11. The system of claim 2 , wherein said confidence level is based at least in part on an evaluated truthfulness of said at least one verbal response.
12. The system of claim 1 , wherein said confidence level is based at least in part on a quality measure of said speech data associated with metadata of said speech data, said subject, or a context of said speech data.
13. The system of claim 1 , wherein said confidence level is based at least in part on an acoustic, NLP, or speech-recognition confidence measure of said data.
14. The system of claim 3 , wherein the instructions further cause the one or more computer processors to:
assign a plurality of weights to said plurality of responses.
15. The system of claim 14 , wherein said plurality of weights are assigned based at least in part on a type of query configured to elicit each of said responses.
16. The system of claim 1 , wherein said plurality of machine learning models are provided as (i) one or more individual models, (ii) jointly as two or more separate models, and/or (iii) a fused model comprising a composite model that is an aggregate of two or more different models.
17. The system of claim 1 , wherein said processed data comprises one or more model outputs generated from said one or more models, and wherein said one or more model outputs comprise one or more of the following: an NLP output or an acoustic output.
18. The system of claim 1 , wherein said weights are based at least in part on confidence measures associated with each of said NLP output and said acoustic output.
19. The system of claim 17 , wherein said score is generated at least in part by fusing two or more of said model outputs.
20. The system of claim 19 , wherein said two or more of said model outputs comprise at least: (1) a first model output having a first confidence measure, and (2) a second model output having a second confidence measure, and wherein said confidence level of said score is generated at least in part by fusing said first confidence measure and said second confidence measure.
21. The system of claim 20 , wherein said first model output corresponds to said NLP output, and said second model output corresponds to said acoustic output.
22. The system of claim 20 , wherein said two or more of said model outputs further comprise at least (3) a third model output having a third confidence measure, and wherein said confidence level of said score is generated by fusing said first confidence measure, said second confidence measure, and said third confidence measure.
23. The system of claim 22 , wherein said first model output corresponds to said NLP output and said second model output corresponds to said acoustic output.
24. The system of claim 1 , wherein said electronic report is usable by a user to identify whether said subject is at risk of having said mental or physiological condition.
25. The system of claim 24 , wherein said score has a clinical value, wherein said user is a healthcare provider or entity, and wherein said electronic report comprising said score having said clinical value is usable by said healthcare provider or said entity to evaluate or provide care for said subject, when said subject is identified to be at risk of having said mental or physiological condition.
26. The system of claim 1 , wherein at least one of said plurality of machine learning models is a deep learning model.
27. The system of claim 1 , wherein applying weights to said NLP output and said acoustic output does not change a magnitude of said NLP output or said acoustic output.