IP Library Granted Patent US 10,957,428
Granted Patent B2
US 10,957,428 · App. 16/100,030 · Granted Mar 23, 2021

Automated clinical documentation system and method

Inventors: Donald E. Owen (Orlando, FL); Garret N. Erskine (Torrance, CA); Mehmet Mert Öz (Baden, AT)
Assignee: Nuance Communications, Inc.
G16H10/60A61B5/7405G06F3/16G06F16/637G06F16/904G06F21/6245G06F40/174G06F40/30G06F40/40G06K9/00288G06K9/00342G06K9/00369G06K9/00664G06K9/00771G06K9/6288G06K19/07762G06N3/006G06T7/00G10L15/08G10L17/00G10L21/0232G11B27/10G16B50/00G16H10/20G16H15/00G16H30/00G16H30/20G16H30/40G16H40/60G16H40/63G16H50/20G16H50/30G16H80/00H04L51/02H04N7/183H04R1/326H04R3/005G06T2207/10024G06T2207/10044G06T2207/10048G06T2207/10116G06T2207/10132G10L15/1815G10L15/22G10L15/265G10L2021/02082H04R1/406
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,957,428
App. No.
16/100,030
Granted
Mar 23, 2021
Kind
B2
Abstract

A method, computer program product, and computing system for automating a monitoring process is executed on a computing device and includes obtaining encounter information of a patient encounter. The encounter information is processed to determine if the encounter information is indicative of a potential medical situation. An inquiry is initiated concerning the potential medical situation.

Claims (64)

1. A computer-implemented method for automating a monitoring process, executed on a computing device, comprising:

obtaining encounter information of a patient encounter, wherein the encounter information of the patient encounter includes machine vision encounter information and audio encounter information, wherein obtaining encounter information of the patient encounter includes:

detecting and recognizing, via a machine vision system, one or more humanoid shapes, and

tracking, via the machine vision system, the one or more humanoid shapes during the patient encounter;

processing the machine vision encounter information and audio encounter information of the encounter information to determine if the encounter information is indicative of a potential medical situation, wherein processing the machine vision encounter information and audio encounter information of the encounter information includes identifying one or more portions of the encounter information that concern the potential medical situation and emphasizing, for a medical professional, the one or more portions of the encounter information that concern the potential medical situation; and

initiating an inquiry to the medical professional concerning the potential medical situation based upon, at least in part, the machine vision encounter information and audio encounter information of the encounter information, wherein initiating the inquiry to the medical professional includes prompting the medical professional about the potential medical situation, wherein the prompting about the potential medical situation is based upon, at least in part, the processing of the machine vision encounter information and audio encounter information of the encounter information.

2. The computer-implemented method of claim 1 wherein initiating the inquiry concerning the potential medical situation includes:

inquiring about the potential medical situation via a virtual assistant.

3. The computer-implemented method of claim 2 wherein inquiring about the potential medical situation via the virtual assistant includes:

verbally inquiring about the potential medical situation via the virtual assistant.

4. The computer-implemented method of claim 1 wherein initiating the inquiry concerning the potential medical situation includes:

providing a notification to the medical professional concerning the potential medical situation.

5. The computer-implemented method of claim 4 wherein providing the notification to the medical professional concerning the potential medical situation includes one or more of:

providing a private text-based notification to the medical professional concerning the potential medical situation; and

providing a private audio-based notification to the medical professional concerning the potential medical situation.

6. The computer-implemented method of claim 1 wherein the potential medical situation includes one or more of:

a potential medical condition;

a potential medication issue;

a potential home healthcare issue; and

a potential follow-up issue.

7. The computer-implemented method of claim 1 wherein obtaining encounter information of the patient encounter includes:

monitoring one or more trajectories associated with the one or more humanoid shapes.

8. The computer-implemented method of claim 7 wherein obtaining encounter information of the patient encounter includes:

steering one or more audio recording beams toward the one or more humanoid shapes to capture audio encounter information via an audio recording system based upon, at least in part, the one or more trajectories of the one or more humanoid shapes.

9. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

obtaining encounter information of a patient encounter, wherein the encounter information of the patient encounter includes machine vision encounter information and audio encounter information, wherein obtaining encounter information of the patient encounter includes:

detecting and recognizing, via a machine vision system, one or more humanoid shapes, and

tracking, via the machine vision system, the one or more humanoid shapes during the patient encounter;

processing the machine vision encounter information and audio encounter information of the encounter information to determine if the encounter information is indicative of a potential medical situation, wherein processing the machine vision encounter information and audio encounter information of the encounter information includes identifying one or more portions of the encounter information that concern the potential medical situation and emphasizing, for a medical professional, the one or more portions of the encounter information that concern the potential medical situation; and

initiating an inquiry to the medical professional concerning the potential medical situation based upon, at least in part, the machine vision encounter information and audio encounter information of the encounter information, wherein initiating the inquiry to the medical professional includes prompting the medical professional about the potential medical situation, wherein the prompting about the potential medical situation is based upon, at least in part, the processing of the machine vision encounter information and audio encounter information of the encounter information.

10. The computer program product of claim 9 wherein initiating the inquiry concerning the potential medical situation includes:

inquiring about the potential medical situation via a virtual assistant.

11. The computer program product of claim 10 wherein inquiring about the potential medical situation via the virtual assistant includes:

verbally inquiring about the potential medical situation via the virtual assistant.

12. The computer program product of claim 9 wherein initiating the inquiry concerning the potential medical situation includes:

providing a notification to the medical professional concerning the potential medical situation.

13. The computer program product of claim 12 wherein providing the notification to the medical professional concerning the potential medical situation includes one or more of:

providing a private text-based notification to the medical professional concerning the potential medical situation; and

providing a private audio-based notification to the medical professional concerning the potential medical situation.

14. The computer program product of claim 9 wherein the potential medical situation includes one or more of:

a potential medical condition;

a potential medication issue;

a potential home healthcare issue; and

a potential follow-up issue.

15. A computing system including a processor and memory configured to perform operations comprising:

obtaining encounter information of a patient encounter, wherein the encounter information of the patient encounter includes machine vision encounter information and audio encounter information, wherein obtaining encounter information of the patient encounter includes:

detecting and recognizing, via a machine vision system, one or more humanoid shapes, and

tracking, via the machine vision system, the one or more humanoid shapes during the patient encounter;

processing the machine vision encounter information and audio encounter information of the encounter information to determine if the encounter information is indicative of a potential medical situation, wherein processing the machine vision encounter information and audio encounter information of the encounter information includes identifying one or more portions of the encounter information that concern the potential medical situation and emphasizing, for a medical professional, the one or more portions of the encounter information that concern the potential medical situation; and

initiating an inquiry to the medical professional concerning the potential medical situation based upon, at least in part, the machine vision encounter information and audio encounter information of the encounter information, wherein initiating the inquiry to the medical professional includes prompting the medical professional about the potential medical situation, wherein the prompting about the potential medical situation is based upon, at least in part, the processing of the machine vision encounter information and audio encounter information of the encounter information.

16. The computing system of claim 15 wherein initiating the inquiry concerning the potential medical situation includes:

inquiring about the potential medical situation via a virtual assistant.

17. The computing system of claim 16 wherein inquiring about the potential medical situation via the virtual assistant includes:

verbally inquiring about the potential medical situation via the virtual assistant.

18. The computing system of claim 15 wherein initiating the inquiry concerning the potential medical situation includes:

providing a notification to the medical professional concerning the potential medical situation.

19. The computing system of claim 18 wherein providing the notification to the medical professional concerning the potential medical situation includes one or more of:

providing a private text-based notification to the medical professional concerning the potential medical situation; and

providing a private audio-based notification to the medical professional concerning the potential medical situation.

20. The computing system of claim 15 wherein the potential medical situation includes one or more of:

a potential medical condition;

a potential medication issue;

a potential home healthcare issue; and

a potential follow-up issue.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2018
From: OWEN, DONALD E; ERSKINE, GARRET N; ÖZ, MEHMET MERT
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 046857/0374 →