IP Library Granted Patent US 10,978,187
Granted Patent B2
US 10,978,187 · App. 16/058,856 · Granted Apr 13, 2021

Automated clinical documentation system and method

Inventors: Donald E. Owen (Orlando, FL); Dushyant Sharma (Woburn, MA); Daniel Paulino Almendro Barreda (London, GB); Patrick A. Naylor (Reading, GB)
Assignee: Nuance Communications, Inc.
G16H10/60A61B5/7405G06F3/16G06F16/637G06F16/904G06F21/6245G06F40/174G06F40/30G06F40/40G06K9/00221G06K9/00288G06K9/00342G06K9/00369G06K9/00664G06K9/00771G06K9/6288G06K19/07762G06N3/006G06T7/00G10L15/08G10L17/00G10L21/0232G11B27/10G16B50/00G16H10/20G16H15/00G16H30/00G16H30/20G16H30/40G16H40/20G16H40/60G16H40/63G16H50/20G16H50/30G16H80/00H04L51/02H04L51/20H04N7/183H04R1/326H04R3/005H04R3/12G06T2207/10024G06T2207/10044G06T2207/10048G06T2207/10116G06T2207/10132G10L15/1815G10L15/22G10L15/26G10L2021/02082H04N7/181H04R1/406H04R3/02H04R2420/07H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,978,187
App. No.
16/058,856
Granted
Apr 13, 2021
Kind
B2
Abstract

A mixed-media ACD device is configured to monitor one or more encounter participants of a patient encounter and includes a machine vision system configured to obtain machine vision encounter information concerning the patient encounter. An audio recording system is configured to obtain audio encounter information concerning the patient encounter, wherein the audio recording system includes a plurality of discrete audio acquisition devices.

Claims (65)

1. A mixed-media automated clinical documentation (ACD) device, configured to monitor one or more encounter participants of a patient encounter, comprising:

a machine vision system configured to obtain machine vision encounter information concerning the patient encounter, wherein the machine vision encounter information includes identification of one or more locations of one or more encounter participants of the patient encounter and a trajectory of the one or more encounter participants of the patient encounter; and

an audio recording system configured to obtain audio encounter information concerning the patient encounter, wherein the audio recording system includes a plurality of discrete audio acquisition devices, wherein the mixed-media ACD device is configured to form one or more audio recording beams via the discrete audio acquisition devices included within the audio recording system, and wherein the mixed-media ACD device is further configured to steer the one or more audio recording beams toward the one or more encounter participants of the patient encounter based, at least in part, upon the one or more locations of the one or more encounter participants and the trajectory of the one or more encounter participants identified by the machine vision encounter information.

2. The mixed-media ACD device of claim 1 wherein the machine vision system includes one or more of:

an RGB imaging system;

an infrared imaging system;

an ultraviolet imaging system;

a laser imaging system;

an X-ray imaging system;

a SONAR imaging system;

a RADAR imaging system; and

a thermal imaging system.

3. The mixed-media ACD device of claim 1 wherein the audio recording system includes:

a directional microphone array that includes a plurality of discrete microphone assemblies.

4. The mixed-media ACD device of claim 1 wherein:

the machine vision system is configured to provide the machine vision encounter information to a compute system; and

the audio recording system is configured to provide the audio encounter information to the compute system.

5. The mixed-media ACD device of claim 4 wherein the compute system is included within the mixed-media ACD device.

6. The mixed-media ACD device of claim 4 wherein the compute system is external to the mixed-media ACD device.

7. The mixed-media ACD device of claim 4 wherein the compute system is configured to access one or more datasources.

8. The mixed-media ACD device of claim 7 wherein the one or more datasources include one or more of:

one or more voice prints;

one or more face prints;

one or more utterance identifiers;

one or more wearable token identifiers; and

one or more interaction identifiers.

9. The mixed-media ACD device of claim 1 wherein the mixed-media ACD device is configured to monitor a monitored space in a clinical environment.

10. A mixed-media automated clinical documentation (ACD) device, configured to monitor one or more encounter participants of a patient encounter, comprising:

a machine vision system configured to obtain machine vision encounter information concerning the patient encounter, wherein the machine vision encounter information includes identification of one or more locations of one or more encounter participants of the patient encounter and a trajectory of the one or more encounter participants of the patient encounter; and

an audio recording system configured to obtain audio encounter information concerning the patient encounter, wherein the audio recording system includes a plurality of discrete audio acquisition devices;

wherein the mixed-media ACD device is configured to:

form one or more audio recording beams via the discrete audio acquisition devices included within the audio recording system, and

steer the one or more audio recording beams toward the one or more encounter participants of the patient encounter based, at least in part, upon the one or more locations of the one or more encounter participants and the trajectory of the one or more encounter participants identified by the machine vision encounter information.

11. The mixed-media ACD device of claim 10 wherein:

the machine vision system is configured to provide the machine vision encounter information to a compute system; and

the audio recording system is configured to provide the audio encounter information to the compute system.

12. The mixed-media ACD device of claim 11 wherein the compute system is configured to access one or more datasources.

13. The mixed-media ACD device of claim 12 wherein the one or more datasources include one or more of:

one or more voice prints;

one or more face prints;

one or more utterance identifiers;

one or more wearable token identifiers; and

one or more interaction identifiers.

14. A mixed-media automated clinical documentation (ACD) device, configured to monitor one or more encounter participants of a patient encounter, comprising:

a machine vision system configured to obtain machine vision encounter information concerning the patient encounter and provide the machine vision encounter information to a compute system, wherein the machine vision encounter information includes identification of one or more locations of one or more encounter participants of the patient encounter and a trajectory of the one or more encounter participants of the patient encounter; and

an audio recording system configured to obtain audio encounter information concerning the patient encounter and provide the audio encounter information to the compute system, wherein the audio recording system includes a plurality of discrete audio acquisition devices;

wherein the mixed-media ACD device is configured to:

form one or more audio recording beams via the discrete audio acquisition devices included within the audio recording system, and

steer the one or more audio recording beams toward the one or more encounter participants of the patient encounter based, at least in part, upon the one or more locations of the one or more encounter participants and the trajectory of the one or more encounter participants identified by the machine vision encounter information.

15. The mixed-media ACD device of claim 14 wherein the machine vision system includes one or more of:

an RGB imaging system;

an infrared imaging system;

an ultraviolet imaging system;

a laser imaging system;

an X-ray imaging system;

a SONAR imaging system;

a RADAR imaging system; and

a thermal imaging system.

16. The mixed-media ACD device of claim 14 wherein the compute system is configured to access one or more datasources.

17. The mixed-media ACD device of claim 16 wherein the one or more datasources include one or more of:

one or more voice prints;

one or more face prints;

one or more utterance identifiers;

one or more wearable token identifiers; and

one or more interaction identifiers.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2018
From: OWEN, DONALD E; SHARMA, DUSHYANT; ALMENDRO BARREDA, DANIEL PAULINO; NAYLOR, PATRICK A
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 047767/0647 →
Continuity (3)
Provisional Application 62543762 · Aug 10, 2017
Provisional Application 62638809 · Mar 5, 2018
Related Publication 20190051377A1 · Feb 14, 2019