IP Library Granted Patent US 11,227,679
Granted Patent B2
US 11,227,679 · App. 16/442,247 · Granted Jan 18, 2022

Ambient clinical intelligence system and method

Inventors: Donald E. Owen (Orlando, FL); Guido Remi Marcel Gallopyn (Newburyport, MA); Paul Joseph Vozila (Arlington, MA); Mehmet Mert Öz (Baden, AT); Matthieu Hebert (Beauharnois, CA)
Assignee: NUANCE COMMUNICATIONS, INC.
G16H15/00G06K9/00718G10L15/26G16H10/60G16H40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,227,679
App. No.
16/442,247
Granted
Jan 18, 2022
Kind
B2
Abstract

A method, computer program product, and computing system for obtaining encounter information during a patient encounter; processing the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event; and deriving information for the detected physical event.

Claims (57)

1. A computer-implemented method, executed on a computing device, comprising:

obtaining encounter information during a patient encounter, wherein the encounter information includes machine vision encounter information and audio encounter information;

processing the machine vision encounter information and the audio encounter information of the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event, wherein the detected physical event is associable with a verbal component identified in the audio encounter information and the physical event identified in the machine vision encounter information, wherein the detected physical event is identified, at least in part, by comparing the machine vision encounter information to a physical events datasource; and

deriving information for the detected physical event, wherein the information derived for the detected physical event includes the machine vision encounter information and the audio encounter information, and wherein deriving information for the detected physical event includes:

generating a text-based description of the detected physical event identified in the machine vision encounter information and the physical events datasource;

generating a text-based transcription of the verbal component identified in the audio encounter information associated with the detected physical event; and

annotating a medical record to include the text-based description of the detected physical event identified in the machine vision encounter information and the text-based transcription of the verbal component identified in the audio encounter information associated with the detected physical event.

2. The computer-implemented method of claim 1 wherein obtaining encounter information during a patient encounter includes:

utilizing a machine vision system to obtain machine vision encounter information during the patient encounter.

3. The computer-implemented method of claim 1 wherein deriving information for the detected physical event includes:

associating the detected physical event with a defined procedure; and

memorializing the execution of the defined procedure.

4. The computer-implemented method of claim 1 wherein deriving information for the detected physical event includes:

determining the appropriateness of the detected physical event.

5. The computer-implemented method of claim 4 wherein determining the appropriateness of the detected physical event includes one or more of:

determining whether the detected physical event violates any professional rules;

determining whether the detected physical event violates any civil rules; and

determining whether the detected physical event violates any criminal laws.

6. The computer-implemented method of claim 1 wherein the detected physical event includes the use of a physical device.

7. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

obtaining encounter information during a patient encounter, wherein the encounter information includes machine vision encounter information and audio encounter information;

processing the machine vision encounter information and the audio encounter information of the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event, wherein the detected physical event is associable with a verbal component identified in the audio encounter information and the physical event identified in the machine vision encounter information, wherein the detected physical event is identified, at least in part, by comparing the machine vision encounter information to a physical events datasource; and

deriving information for the detected physical event, wherein the information derived for the detected physical event includes the machine vision encounter information and the audio encounter information, and wherein deriving information for the detected physical event includes:

generating a text-based description of the detected physical event identified in the machine vision encounter information and the physical events datasource;

generating a text-based transcription of the verbal component identified in the audio encounter information associated with the detected physical event; and

annotating a medical record to include the text-based description of the detected physical event identified in the machine vision encounter information and the text-based transcription of the verbal component identified in the audio encounter information associated with the detected physical event.

8. The computer program product of claim 7 wherein obtaining encounter information during a patient encounter includes:

utilizing a machine vision system to obtain machine vision encounter information during the patient encounter.

9. The computer program product of claim 7 wherein deriving information for the detected physical event includes:

associating the detected physical event with a defined procedure; and

memorializing the execution of the defined procedure.

10. The computer program product of claim 9 wherein deriving information for the detected physical event includes:

determining the appropriateness of the detected physical event.

11. The computer program product of claim 10 wherein determining the appropriateness of the detected physical event includes one or more of:

determining whether the detected physical event violates any professional rules;

determining whether the detected physical event violates any civil rules; and

determining whether the detected physical event violates any criminal laws.

12. The computer program product of claim 7 wherein the detected physical event includes the use of a physical device.

13. A computing system including a processor and memory configured to perform operations comprising:

obtaining encounter information during a patient encounter, wherein the encounter information includes machine vision encounter information and audio encounter information;

processing the machine vision encounter information and the audio encounter information of the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event, wherein the detected physical event is associable with a verbal component identified in the audio encounter information and the physical event identified in the machine vision encounter information, wherein the detected physical event is identified, at least in part, by comparing the machine vision encounter information to a physical events datasource; and

deriving information for the detected physical event, wherein the information derived for the detected physical event includes the machine vision encounter information and the audio encounter information, and wherein deriving information for the detected physical event includes:

generating a text-based description of the detected physical event identified in the machine vision encounter information and the physical events datasource;

generating a text-based transcription of the verbal component identified in the audio encounter information associated with the detected physical event; and

annotating a medical record to include the text-based description of the detected physical event identified in the machine vision encounter information and the text-based transcription of the verbal component identified in the audio encounter information associated with the detected physical event.

14. The computing system of claim 13 wherein obtaining encounter information during a patient encounter includes:

utilizing a machine vision system to obtain machine vision encounter information during the patient encounter.

15. The computing system of claim 13 wherein deriving information for the detected physical event includes:

associating the detected physical event with a defined procedure; and

memorializing the execution of the defined procedure.

16. The computing system of claim 13 wherein deriving information for the detected physical event includes:

determining the appropriateness of the detected physical event.

17. The computing system of claim 16 wherein determining the appropriateness of the detected physical event includes one or more of:

determining whether the detected physical event violates any professional rules;

determining whether the detected physical event violates any civil rules; and

determining whether the detected physical event violates any criminal laws.

18. The computing system of claim 13 wherein the detected physical event includes the use of a physical device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065531/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2019
From: VOZILA, PAUL JOSEPH; ÖZ, MEHMET MERT; HEBERT, MATTHIEU; GALLOPYN, GUIDO REMI MARCEL; OWEN, DONALD E
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 050368/0160 →