IP Library Granted Patent US 11,996,176
Granted Patent B2
US 11,996,176 · App. 17/577,419 · Granted May 28, 2024

Ambient clinical intelligence system and method

Inventors: Donald E. Owen (Orlando, FL); Guido Remi Marcel Gallopyn (Newburyport, MA); Paul Joseph Vozila (Arlington, MA); Mehmet Mert Öz (Baden, AT); Matthieu Hebert (Beauharnois, CA)
Assignee: Microsoft Technology Licensing, LLC
G16H15/00G06V20/41G10L15/26G16H10/60G16H40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,996,176
App. No.
17/577,419
Granted
May 28, 2024
Kind
B2
Abstract

A method, computer program product, and computing system for obtaining encounter information during a patient encounter; processing the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event; and deriving information for the detected physical event.

Claims (48)

1. A computer-implemented method, executed on a computing device, comprising:

obtaining encounter information during a patient encounter, wherein the encounter information includes machine vision encounter information and audio encounter information;

processing the machine vision encounter information and the audio encounter information of the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event, wherein the detected physical event is associable with a verbal component identified in the audio encounter information and the physical event identified in the machine vision encounter information, wherein the detected physical event is identified, at least in part, by comparing the machine vision encounter information to a physical events datasource; and

deriving information for the detected physical event by generating a text-based description of the detected physical event and annotating a medical record to include the text-based description of the detected physical event, wherein the information derived for the detected physical event includes the machine vision encounter information and the audio encounter information, wherein deriving the information for the detected physical event includes:

monitoring a status of a patient over a period of time by comparing numeric values of the information derived for the detected physical event in the annotated medical record to previous numeric values of the information derived for the detected physical event in the annotated medical record, and

determining the appropriateness of the detected physical event based upon, at least in part, the text-based description of the detected physical event.

2. The computer-implemented method of claim 1 wherein obtaining encounter information during a patient encounter includes:

utilizing a machine vision system to obtain machine vision encounter information during the patient encounter.

3. The computer-implemented method of claim 1 wherein deriving information for the detected physical event includes:

associating the detected physical event with a defined procedure; and

memorializing the execution of the defined procedure.

4. The computer-implemented method of claim 1 wherein determining the appropriateness of the detected physical event includes one or more of:

determining whether the detected physical event violates any professional rules;

determining whether the detected physical event violates any civil rules; and

determining whether the detected physical event violates any criminal laws.

5. The computer-implemented method of claim 1 wherein the detected physical event includes the use of a physical device.

6. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

obtaining encounter information during a patient encounter, wherein the encounter information includes machine vision encounter information and audio encounter information;

processing the machine vision encounter information and the audio encounter information of the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event, wherein the detected physical event is associable with a verbal component identified in the audio encounter information and the physical event identified in the machine vision encounter information, wherein the detected physical event is identified, at least in part, by comparing the machine vision encounter information to a physical events datasource; and

deriving information for the detected physical event by generating a text-based description of the detected physical event and annotating a medical record to include the text-based description of the detected physical event, wherein the information derived for the detected physical event includes the machine vision encounter information and the audio encounter information, wherein deriving the information for the detected physical event includes:

monitoring a status of a patient over a period of time by comparing numeric values of the information derived for the detected physical event in the annotated medical record to previous numeric values of the information derived for the detected physical event in the annotated medical record, and

determining the appropriateness of the detected physical event based upon, at least in part, the text-based description of the detected physical event.

7. The computer program product of claim 6 wherein obtaining encounter information during a patient encounter includes:

utilizing a machine vision system to obtain machine vision encounter information during the patient encounter.

8. The computer program product of claim 6 wherein deriving information for the detected physical event includes:

associating the detected physical event with a defined procedure; and

memorializing the execution of the defined procedure.

9. The computer program product of claim 6 wherein determining the appropriateness of the detected physical event includes one or more of:

determining whether the detected physical event violates any professional rules;

determining whether the detected physical event violates any civil rules; and

determining whether the detected physical event violates any criminal laws.

10. The computer program product of claim 6 wherein the detected physical event includes the use of a physical device.

11. A computing system including a processor and memory configured to perform operations comprising:

obtaining encounter information during a patient encounter, wherein the encounter information includes machine vision encounter information and audio encounter information;

processing the machine vision encounter information and the audio encounter information of the encounter information to detect the execution of a physical event during the patient encounter, thus defining a detected physical event, wherein the detected physical event is associable with a verbal component identified in the audio encounter information and the physical event identified in the machine vision encounter information, wherein the detected physical event is identified, at least in part, by comparing the machine vision encounter information to a physical events datasource; and

deriving information for the detected physical event by generating a text-based description of the detected physical event and annotating a medical record to include the text-based description of the detected physical event, wherein the information derived for the detected physical event includes the machine vision encounter information and the audio encounter information, wherein deriving the information for the detected physical event includes:

monitoring a status of a patient over a period of time by comparing numeric values of the information derived for the detected physical event in the annotated medical record to previous numeric values of the information derived for the detected physical event in the annotated medical record, and

determining the appropriateness of the detected physical event based upon, at least in part, the text-based description of the detected physical event.

12. The computing system of claim 11 wherein obtaining encounter information during a patient encounter includes:

utilizing a machine vision system to obtain machine vision encounter information during the patient encounter.

13. The computing system of claim 11 wherein deriving information for the detected physical event includes:

associating the detected physical event with a defined procedure; and

memorializing the execution of the defined procedure.

14. The computing system of claim 11 wherein determining the appropriateness of the detected physical event includes one or more of:

determining whether the detected physical event violates any professional rules;

determining whether the detected physical event violates any civil rules; and

determining whether the detected physical event violates any criminal laws.

15. The computing system of claim 11 wherein the detected physical event includes the use of a physical device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065531/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2023
From: VOZILA, PAUL JOSEPH; OZ, MEHMET MERT; HEBERT, MATTHIEU; GALLOPYN, GUIDO REMI MARCEL; OWENS, DONALD E.
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 065041/0216 →