IP Library Granted Patent US 11,482,308
Granted Patent B2
US 11,482,308 · App. 16/058,829 · Granted Oct 25, 2022

Automated clinical documentation system and method

Inventors: Donald E. Owen (Orlando, FL); Uwe Helmut Jost (Groton, MA); Daniel Paulino Almendro Barreda (London, GB); Dushyant Sharma (Woburn, MA)
Assignee: NUANCE COMMUNICATIONS, INC.
G16H10/60A61B5/7405G06F3/16G06F16/637G06F16/685G06F16/904G06F21/6245G06F40/174G06F40/30G06F40/40G06K9/6288G06K19/07762G06N3/006G06T7/00G06V20/10G06V20/52G06V40/103G06V40/16G06V40/172G06V40/23G10L15/08G10L17/00G10L21/0232G11B27/10G16B50/00G16H10/20G16H15/00G16H30/00G16H30/20G16H30/40G16H40/20G16H40/60G16H40/63G16H50/20G16H50/30G16H80/00G16Y20/00H04L51/02H04L51/222H04N7/183H04R1/326H04R3/005H04R3/12G06T2207/10024G06T2207/10044G06T2207/10048G06T2207/10116G06T2207/10132G10L15/1815G10L15/22G10L15/26G10L2021/02082H04N7/181H04R1/406H04R3/02H04R2420/07H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,482,308
App. No.
16/058,829
Granted
Oct 25, 2022
Kind
B2
Abstract

A modular ACD system is configured to automate clinical documentation and includes a machine vision system configured to obtain machine vision encounter information concerning a patient encounter. An audio recording system is configured to obtain audio encounter information concerning the patient encounter. A compute system is configured to receive the machine vision encounter information and the audio encounter information.

Claims (72)

1. A modular automated clinical documentation (ACD) system, configured to automate clinical documentation, comprising:

a machine vision system configured to obtain machine vision encounter information concerning a patient encounter;

an audio recording system configured to obtain audio encounter information concerning the patient encounter, wherein the audio recording system includes a plurality of discrete audio acquisition devices;

a compute system configured to receive the machine vision encounter information and the audio encounter information; and

at least one of a virtual assistant utilized in a check-in area of a physical monitored space to audibly prompt a patient of the patient encounter to provide at least a portion of the audio encounter information and the machine vision encounter information during a pre-visit portion of the patient encounter, and the virtual assistant utilized in a check-out area of the physical monitored space to audibly prompt the patient to provide at least at least a second portion of the audio encounter information and the machine vision encounter information during a post-visit portion of the patient encounter;

wherein the modular ACD system is configured to:

identify humanoid shapes in the physical monitored space from the machine vision encounter information obtained via the machine vision system, wherein at least one of the humanoid shapes is the patient;

determine that a new humanoid shape has been identified in the physical monitored space from the machine vision encounter information obtained via the machine vision system;

monitor a trajectory of movement of the patient and a trajectory of movement of the new humanoid shape in the physical monitored space simultaneously from the machine vision encounter information obtained via the machine vision system;

form one or more audio recording beams via the discrete audio acquisition devices included within the audio recording system; and

steer a first audio recording beam of the one or more audio recording beams toward the patient and steer a second audio recording beam of the one or more audio recording beams toward the new humanoid shape based, at least in part, upon the trajectory of the patient and the trajectory of the new humanoid shape in the physical monitored space.

2. The modular ACD system of claim 1 wherein the audio recording system includes:

a directional microphone array that includes a plurality of discrete microphone assemblies.

3. The modular ACD system of claim 1 wherein the machine vision system includes one or more of:

an RGB imaging system;

an infrared imaging system;

an ultraviolet imaging system;

a laser imaging system;

an X-ray imaging system;

a SONAR imaging system;

a RADAR imaging system; and

a thermal imaging system.

4. The modular ACD system of claim 1 wherein the compute system is configured to access one or more datasources.

5. The modular ACD system of claim 4 wherein the one or more datasources include one or more of:

one or more voice prints;

one or more face prints;

one or more utterance identifiers;

one or more wearable token identifiers; and

one or more interaction identifiers.

6. The modular ACD system of claim 1 wherein the modular ACD system is configured to monitor the physical monitored space in a clinical environment.

7. The modular ACD system of claim 1 wherein the machine vision system includes a plurality of discrete machine vision systems.

8. The modular ACD system of claim 1 wherein the audio recording system includes a plurality of discrete audio recording systems.

9. The modular ACD system of claim 1 wherein the compute system includes a plurality of discrete compute systems.

10. A modular automated clinical documentation (ACD) system, configured to automate clinical documentation, comprising:

a machine vision system configured to obtain machine vision encounter information concerning a patient encounter;

an audio recording system configured to obtain audio encounter information concerning the patient encounter, wherein the audio recording system includes a plurality of discrete audio acquisition devices;

a compute system configured to receive the machine vision encounter information and the audio encounter information, wherein the compute system is configured to access one or more datasources; and

at least one of a virtual assistant utilized in a check-in area of a physical monitored space to audibly prompt a patient of the patient encounter to provide at least a portion of the audio encounter information and the machine vision encounter information during a pre-visit portion of the patient encounter, and the virtual assistant utilized in a check-out area of the physical monitored space to audibly prompt the patient to provide at least at least a second portion of the audio encounter information and the machine vision encounter information during a post-visit portion of the patient encounter;

wherein the modular ACD system is configured to:

identify humanoid shapes in the physical monitored space from the machine vision encounter information obtained via the machine vision system, wherein at least one of the humanoid shapes is the patient;

determine that a new humanoid shape has been identified in the physical monitored space from the machine vision encounter information obtained via the machine vision system;

monitor a trajectory of movement of the patient and a trajectory of movement of the new humanoid shape in the physical monitored space simultaneously from the machine vision encounter information obtained via the machine vision system;

form one or more audio recording beams via the discrete audio acquisition devices included within the audio recording system; and

steer a first audio recording beam of the one or more audio recording beams toward the patient and steer a second audio recording beam of the one or more audio recording beams toward the new humanoid shape based, at least in part, upon the trajectory of the patient and the trajectory of the new humanoid shape in the physical monitored space.

11. The modular ACD system of claim 10 wherein the one or more datasources include one or more of:

one or more voice prints;

one or more face prints;

one or more utterance identifiers;

one or more wearable token identifiers; and

one or more interaction identifiers.

12. A modular automated clinical documentation (ACD) system, configured to automate clinical documentation, comprising:

a machine vision system configured to obtain machine vision encounter information concerning a patient encounter;

an audio recording system configured to obtain audio encounter information concerning the patient encounter, wherein the audio recording system includes a plurality of discrete audio acquisition devices;

a compute system configured to receive the machine vision encounter information and the audio encounter information, wherein the compute system is configured to access one or more datasources; and

at least one of a virtual assistant utilized in a check-in area of a physical monitored space to audibly prompt a patient of the patient encounter to provide at least a portion of the audio encounter information and the machine vision encounter information during a pre-visit portion of the patient encounter, and the virtual assistant utilized in a check-out area of the physical monitored space to audibly prompt the patient to provide at least at least a second portion of the audio encounter information and the machine vision encounter information during a post-visit portion of the patient encounter;

wherein the modular ACD system is configured to:

monitor, via the machine vision system and the audio recording system, a monitored space in a clinical environment,

identify humanoid shapes in the physical monitored space from the machine vision encounter information obtained via the machine vision system, wherein at least one of the humanoid shapes is the patient,

determine that a new humanoid shape has been identified in the physical monitored space from the machine vision encounter information obtained via the machine vision system,

monitor a trajectory of movement of the patient and a trajectory of movement of the new humanoid shape in the physical monitored space simultaneously from the machine vision encounter information obtained via the machine vision system,

form one or more audio recording beams via the discrete audio acquisition devices included within the audio recording system, and

steer a first audio recording beam of the one or more audio recording beams toward the patient and steer a second audio recording beam of the one or more audio recording beams toward the new humanoid shape based, at least in part, upon the trajectory of the patient and the trajectory of the new humanoid shape in the physical monitored space.

13. The modular ACD system of claim 12 wherein the machine vision system includes one or more of:

an RGB imaging system;

an infrared imaging system;

an ultraviolet imaging system;

a laser imaging system;

an X-ray imaging system;

a SONAR imaging system;

a RADAR imaging system; and

a thermal imaging system.

14. The modular ACD system of claim 1 wherein the audio recording system is configured to utilize null-steering precoding to compensate for signal delays when receiving signals via the plurality of discrete audio acquisition devices.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2018
From: OWEN, DONALD E; JOST, UWE HELMUT; BARREDA, DANIEL PAULINO ALMENDRO; SHARMA, DUSHYANT
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 047093/0974 →
Continuity (3)
Provisional Application 62543762 · Aug 10, 2017
Provisional Application 62638809 · Mar 5, 2018
Related Publication 20190051394A1 · Feb 14, 2019