IP Library › Granted Patent US 12,265,791
Granted Patent B2
US 12,265,791 · App. 18/597,409 · Granted Apr 1, 2025

Emergency workflow trigger

Inventors: Alison Darcy (San Francisco, CA); Jade Daniels (San Francisco, CA); Casey Sackett (San Francisco, CA)
Assignee: WOEBOT LABS, INC.
G06F40/289G06N20/00G16H10/20G16H20/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,265,791
App. No.
18/597,409
Filed
Mar 6, 2024
Granted
Apr 1, 2025
Kind
B2
Art Unit
3667
USPC
705/2
Abstract

Detection of crisis situations using multiple classifiers can enable fast and efficient processing of input phrases to determine if an abatement protocol should be executed. An input phrase can be passed through a pattern matching classifier and then through a trained machine learning classifier. If neither classifier identifies a crisis, the workflow can continue as usual. However, if a crisis is identified, confirmation of the crisis situation can be sought and used to further update one or both of the classifiers. If the crisis is confirmed, emergency information and crisis management tools can be presented to the user, among other mitigating actions. If the crisis is not confirmed, a prompt can be presented to the user to discuss the trigger phrase associated with the trigger signal.

Claims (62)

1. A method, comprising:

obtaining training data comprising training input phrases, each training input phrase being associated with a label indicative of whether the respective training input phrase is associated with a crisis situation;

training a machine learning classifier using the training input phrases and their respective labels;

receiving an input phrase;

applying the input phrase to a machine learning classifier to determine whether the input phrase triggers the machine learning classifier;

determining a crisis score using the input phrase;

accessing one or more historical crisis scores; and

executing an abatement protocol in response to determining that the input phrase triggers the trained machine learning classifier, wherein execution of the abatement protocol is further based on the crisis score and the one or more historical crisis scores.

2. The method of claim 1 , wherein the machine learning classifier is a transformer-based machine learning classifier initially trained using pre-training training data for a language prior to the training the machine learning classifier using the training input phrases.

3. The method of claim 1 , further comprising:

determining a crisis score trend using the crisis score and the one or more historical crisis scores; wherein execution of the abatement protocol is further based on the crisis score trend.

4. The method of claim 1 , further comprising:

obtaining additional training data, the additional training data including one or more additional input phrases previously supplied to the trained machine learning classifier, each of the one or more additional input phrases being associated with a respective label indicative of whether a user confirmed or denied a respective crisis situation after the respective additional input phrase triggered the trained machine learning classifier, and

further training the trained machine learning classifier based at least in part on the additional training data, wherein further training occurs prior to receiving the input phrase.

5. The method of claim 4 , wherein each of the additional input phrases was previously supplied to the trained machine learning classifier and triggered the trained machine learning classifier.

6. The method of claim 1 , wherein executing the abatement protocol includes i) accessing and presenting a text string containing emergency contact information, ii) accessing and presenting a link configured to begin initiation of an emergency contact connection upon actuation; iii) sending a signal to automatically begin initiation of an emergency contact connection; iv) initiating a patient health questionnaire protocol; v) generating a prompt for selecting a crisis management tool; vi) automatically initiating a crisis management tool; or vii) any combination of i-vi.

7. The method of claim 1 , wherein receiving the input phrase occurs via a text-based communication protocol, wherein executing the abatement protocol includes automatically initiating a crisis management tool via the text-based communication protocol, the crisis management tool including a workflow of prompts and/or comments for mitigating the crisis situation.

8. The method of claim 7 , wherein the crisis management tool, when initiated, facilitates:

providing, via the text-based communication protocol, a series of questions from a patient health questionnaire; and

receiving, via the text-based communication protocol, a response for each question of the series of questions.

9. A system, comprising:

one or more data processors; and

a non-transitory computer-readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform operations including:

obtaining training data comprising training input phrases, each training input phrase being associated with a label indicative of whether the respective training input phrase is associated with a crisis situation;

training a machine learning classifier using the training input phrases and their respective labels;

receiving an input phrase;

applying the input phrase to a machine learning classifier to determine whether the input phrase triggers the machine learning classifier;

determining a crisis score using the input phrase;

accessing one or more historical crisis scores; and

executing an abatement protocol in response to determining that the input phrase triggers the trained machine learning classifier, wherein execution of the abatement protocol is further based on the crisis score and the one or more historical crisis scores.

10. The system of claim 9 , wherein the machine learning classifier is a transformer-based machine learning classifier initially trained using pre-training training data for a language prior to the training the machine learning classifier using the training input phrases.

11. The system of claim 9 , wherein the operations further include:

determining a crisis score trend using the crisis score and the one or more historical crisis scores; wherein execution of the abatement protocol is further based on the crisis score trend.

12. The system of claim 9 , wherein the operations further include:

obtaining additional training data, the additional training data including one or more additional input phrases previously supplied to the trained machine learning classifier, each of the one or more additional input phrases being associated with a respective label indicative of whether a user confirmed or denied a respective crisis situation after the respective additional input phrase triggered the trained machine learning classifier, and

further training the trained machine learning classifier based at least in part on the additional training data, wherein further training occurs prior to receiving the input phrase.

13. The system of claim 12 , wherein each of the additional input phrases was previously supplied to the trained machine learning classifier and triggered the trained machine learning classifier.

14. The system of claim 9 , wherein executing the abatement protocol includes i) accessing and presenting a text string containing emergency contact information, ii) accessing and presenting a link configured to begin initiation of an emergency contact connection upon actuation; iii) sending a signal to automatically begin initiation of an emergency contact connection; iv) initiating a patient health questionnaire protocol; v) generating a prompt for selecting a crisis management tool; vi) automatically initiating a crisis management tool; or vii) any combination of i-vi.

15. The system of claim 9 , wherein receiving the input phrase occurs via a text-based communication protocol, wherein executing the abatement protocol includes automatically initiating a crisis management tool via the text-based communication protocol, the crisis management tool including a workflow of prompts and/or comments for mitigating the crisis situation.

16. The system of claim 15 , wherein the crisis management tool, when initiated, facilitates:

providing, via the text-based communication protocol, a series of questions from a patient health questionnaire; and

receiving, via the text-based communication protocol, a response for each question of the series of questions.

17. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause a data processing apparatus to perform operations including:

obtaining training data comprising training input phrases, each training input phrase being associated with a label indicative of whether the respective training input phrase is associated with a crisis situation;

training a machine learning classifier using of the training input phrases and their respective labels;

receiving an input phrase;

applying the input phrase to a machine learning classifier to determine whether the input phrase triggers the machine learning classifier;

determining a crisis score using the input phrase;

accessing one or more historical crisis scores; and

executing an abatement protocol in response to determining that the input phrase triggers the trained machine learning classifier, wherein execution of the abatement protocol is further based on the crisis score and the one or more historical crisis scores.

18. The computer-program product of claim 17 , wherein the machine learning classifier is a transformer-based machine learning classifier initially trained using pre-training training data for a language prior to the training the machine learning classifier using the training input phrases.

19. The computer-program product of claim 17 , wherein the operations further include:

determining a crisis score trend using the crisis score and the one or more historical crisis scores; wherein execution of the abatement protocol is further based on the crisis score trend.

20. The computer-program product of claim 17 , wherein the operations further include:

obtaining additional training data, the additional training data including one or more additional input phrases previously supplied to the trained machine learning classifier, each of the one or more additional input phrases being associated with a respective label indicative of whether a user confirmed or denied a respective crisis situation after the respective additional input phrase triggered the trained machine learning classifier, and

further training the trained machine learning classifier based at least in part on the additional training data, wherein further training occurs prior to receiving the input phrase.

21. The computer-program product of claim 20 , wherein each of the additional input phrases was previously supplied to the trained machine learning classifier and triggered the trained machine learning classifier.

22. The computer-program product of claim 17 , wherein executing the abatement protocol includes i) accessing and presenting a text string containing emergency contact information, ii) accessing and presenting a link configured to begin initiation of an emergency contact connection upon actuation; iii) sending a signal to automatically begin initiation of an emergency contact connection; iv) initiating a patient health questionnaire protocol; v) generating a prompt for selecting a crisis management tool; vi) automatically initiating a crisis management tool; or vii) any combination of i-vi.

23. The computer-program product of claim 17 , wherein receiving the input phrase occurs via a text-based communication protocol, wherein executing the abatement protocol includes automatically initiating a crisis management tool via the text-based communication protocol, the crisis management tool including a workflow of prompts and/or comments for mitigating the crisis situation.

24. The computer-program product of claim 23 , wherein the crisis management tool, when initiated, facilitates:

providing, via the text-based communication protocol, a series of questions from a patient health questionnaire; and

receiving, via the text-based communication protocol, a response for each question of the series of questions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2024
From: DARCY, ALISON; DANIELS, JADE; SACKETT, CASEY
To: WOEBOT LABS, INC.
Reel/Frame 067707/0452 →
Continuity (3)
Continuation 17364001 · Jun 30, 2021
Provisional Application 63120810 · Dec 3, 2020
Related Publication 20240370651A1 · Nov 7, 2024
References Cited (60)
US 5961332A · Joao · 1999 [cited by applicant]
US 8170609B2 · Hedtke et al. · 2012 [cited by applicant]
US 9390706B2 · Gustafson et al. · 2016 [cited by applicant]
US 9542386B2 · Andrade Silva et al. · 2017 [cited by applicant]
US 10025849B2 · Kim et al. · 2018 [cited by applicant]
US 10395552B2 · Clark et al. · 2019 [cited by applicant]
US 11501080B2 · D'Souza et al. · 2022 [cited by applicant]
US 11775774B2 · Darcy et al. · 2023 [cited by applicant]
US 11797825B2 · Hashimoto et al. · 2023 [cited by applicant]
US 11954437B2 · Darcy et al. · 2024 [cited by applicant]
US 11972212B2 · Sackett et al. · 2024 [cited by applicant]
US 20050131739A1 · Rabinowitz et al. · 2005 [cited by applicant]
US 20120173268A1 · Omidi · 2012 [cited by applicant]
US 20160300570A1 · Gustafson et al. · 2016 [cited by applicant]
US 20170193088A1 · Boguraev et al. · 2017 [cited by applicant]
US 20170262755A1 · Takeuchi et al. · 2017 [cited by applicant]
US 20170372029A1 · Saliman et al. · 2017 [cited by applicant]
US 20190042563A1 · Pestian et al. · 2019 [cited by applicant]
US 20190370412A1 · Hammontree et al. · 2019 [cited by applicant]
US 20200019642A1 · Dua et al. · 2020 [cited by applicant]
US 20200019863A1 · Dua et al. · 2020 [cited by applicant]
US 20200020247A1 · Simpson et al. · 2020 [cited by applicant]
US 20200118458A1 · Shriberg et al. · 2020 [cited by applicant]
US 20200214626A1 · Boyle · 2020 [cited by applicant]
US 20200227161A1 · Hanson et al. · 2020 [cited by applicant]
US 20210074406A1 · Eich et al. · 2021 [cited by applicant]
US 20210110895A1 · Shriberg et al. · 2021 [cited by applicant]
US 20210182496A1 · Shi et al. · 2021 [cited by applicant]
US 20210202065A1 · Cummins et al. · 2021 [cited by applicant]
US 20210391083A1 · Moturu et al. · 2021 [cited by applicant]
US 20220028541A1 · Paull et al. · 2022 [cited by applicant]
US 20220115115A1 · Paredes Castro · 2022 [cited by applicant]
US 20220269954A1 · Harris et al. · 2022 [cited by applicant]
US 20220318311A1 · Wang et al. · 2022 [cited by applicant]
US 20220327407A1 · Trischler et al. · 2022 [cited by applicant]
US 20220335219A1 · Sengupta et al. · 2022 [cited by applicant]
US 20230026871A1 · Darcy et al. · 2023 [cited by applicant]
US 20230059946A1 · Roy Chowdhury et al. · 2023 [cited by applicant]
US 20230215543A1 · Darcy et al. · 2023 [cited by applicant]
US 20230215544A1 · Darcy et al. · 2023 [cited by applicant]
US 20230394246A1 · Darcy et al. · 2023 [cited by applicant]
CN 102521220A · 2012 [cited by applicant]
EP 4009192A1 · 2022 [cited by applicant]
EP 4123498A1 · 2023 [cited by applicant]
EP 4207207A1 · 2023 [cited by applicant]
WO WO2019018280A1 · 2019 [cited by applicant]
WO WO2021236616A1 · 2021 [cited by applicant]
WO WO2022174161A1 · 2022 [cited by applicant]
Bickmore Timothy Wallace, “Relational Agents: Effecting Change through Human-Computer Relationships”, Jan. 31, 2003, retrieved from internet Dec. 15, 2014; 284 pp. [cited by applicant]
Crook Jordan, “911bot is a chat bot that could save your life”, TechCrunch, May 8, 2016, 9 pp. [cited by applicant]
Darcy, et al., “Evidence of Human-Level Bonds Established With a Digital Conversational Agent: Cross-sectional, Retrospective Observational Study”, JMIR Formative Research; vol. 5, No. 5, May 11, 2021, 7 pp. [cited by applicant]
jurafsky Daniel, et al., “Speech and Language Processing—An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition—Third Edition Draft” In: Speech and Language Processing—An Intro… [cited by applicant]
Pardeshi, et al., “A Survey on Different Algorithms used in Chatbot”, International Research Journal of Engineering and Technology (IRJET), vol. 07, Issue 5, May 2020, 7 pp. [cited by applicant]
URSU, “Every Chatbot Needs and Exit”, 7 pp. https://medium.com/the-chatbot-guru/chatbotexitsequence-7c45219e77a7, Nov. 22, 2019 (Year: 2019). [cited by applicant]
Woebot, Woebot Labs. (2018, Jan. 28). <https://woebot.io/> retrieved from Internet Archive Wayback Machine <https://web.archive.org/web/20180128215044/https://www.woebot.io/> on Sep. 29, 2023. (Year: 2018). [cited by applicant]
Yin Junjie, et al., “A Deep Learning Based Chatbot for Campus Psychological Therapy”, arxiv.org, Cornell University Library; Oct. 9, 2019, 31 pp. [cited by applicant]
Yoshioka, et al., “BERT-based ensemble methods with data augmentation for legal textual entailment in COLIEE statute law task”, Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law, … [cited by applicant]
Extended European Search Report for EP 21212394.7 dated Apr. 4, 2022. [cited by applicant]
Extended European Search Report for Application No. EP 22186577.7 dated Dec. 20, 2022; pp. 15. [cited by applicant]
Extended European Search Report for Application No. EP 22217098.7 dated Apr. 28, 2023; 10 pp. [cited by applicant]