IP Library Granted Patent US 11,074,996
Granted Patent B2
US 11,074,996 · App. 16/058,871 · Granted Jul 27, 2021

Automated clinical documentation system and method

Inventors: Guido Remi Marcel Gallopyn (Newburyport, MA); Dushyant Sharma (Woburn, MA); Uwe Helmut Jost (Groton, MA); Donald E. Owen (Orlando, FL); Patrick A. Naylor (Reading, GB); Amr Nour-Eldin (Toronto, CA); Daniel Paulino Almendro Barreda (London, GB)
Assignee: Nuance Communications, Inc.
G16H10/60A61B5/7405G06F3/16G06F16/637G06F16/904G06F21/6245G06F40/174G06F40/30G06F40/40G06K9/00221G06K9/00288G06K9/00342G06K9/00369G06K9/00664G06K9/00771G06K9/6288G06K19/07762G06N3/006G06T7/00G10L15/08G10L17/00G10L21/0232G11B27/10G16B50/00G16H10/20G16H15/00G16H30/00G16H30/20G16H30/40G16H40/20G16H40/60G16H40/63G16H50/20G16H50/30G16H80/00H04L51/02H04L51/20H04N7/183H04R1/326H04R3/005H04R3/12G06T2207/10024G06T2207/10044G06T2207/10048G06T2207/10116G06T2207/10132G10L15/1815G10L15/22G10L15/26G10L2021/02082H04N7/181H04R1/406H04R3/02H04R2420/07H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,074,996
App. No.
16/058,871
Granted
Jul 27, 2021
Kind
B2
Abstract

A method, computer program product, and computing system for source separation is executed on a computing device and includes obtaining encounter information of a patient encounter, wherein the encounter information includes first audio encounter information obtained from a first encounter participant and at least a second audio encounter information obtained from at least a second encounter participant. The first audio encounter information and the at least a second audio encounter information are processed to eliminate audio interference between the first audio encounter information and the at least a second audio encounter information.

Claims (52)

1. A computer-implemented method for source separation, executed on a computing device, comprising:

obtaining encounter information of a patient encounter, wherein the encounter information includes first audio encounter information and first machine vision encounter information obtained from a first encounter participant and at least a second audio encounter information and at least a second machine vision encounter information obtained from at least a second encounter participant; and

processing the first audio encounter information, first multidimensional data that includes image and tensor data of the first machine vision encounter information, the at least a second audio encounter information, and second multidimensional data that includes image and tensor data of the at least a second machine vision encounter information to eliminate audio interference between the first audio encounter information and the at least a second audio encounter information, wherein eliminating the audio interference between the first audio encounter information and the at least a second audio encounter information includes identifying, from the encounter information of a patient encounter, source signals of the first audio encounter information and the at least a second audio encounter information that are probabilistically one of minimally correlated and maximally independent based upon, at least in part, the first multidimensional data and the second multidimensional data, and wherein a time dimension is not included when identifying the source signals to eliminate the audio interference.

2. The computer-implemented method of claim 1 wherein obtaining encounter information of the patient encounter includes:

steering a first audio recording beam toward the first encounter participant; and

steering at least a second audio recording beam toward the at least a second encounter participant.

3. The computer-implemented method of claim 1 wherein processing the first audio encounter information and the at least a second audio encounter information to eliminate audio interference includes:

executing an echo cancellation process on the first audio encounter information and the at least a second audio encounter information.

4. The computer-implemented method of claim 1 wherein processing the first audio encounter information and the at least a second audio encounter information to eliminate audio interference includes:

executing a blind source process on the first audio encounter information and the at least a second audio encounter information.

5. The computer-implemented method of claim 1 wherein the audio interference between the first audio encounter information and the at least a second audio encounter information includes:

crosstalk between the first audio encounter information and the at least a second audio encounter information, wherein the crosstalk includes active listening in the audio interference that is eliminated between the first audio encounter information and the at least a second audio encounter information.

6. The computer-implemented method of claim 1 further comprising:

processing the encounter information to generate an encounter transcript.

7. The computer-implemented method of claim 6 further comprising:

processing at least a portion of the encounter transcript to populate at least a portion of a medical record associated with the patient encounter.

8. The computer-implemented method of claim 1 wherein the at least one constraint includes a structural constraint.

9. The computer-implemented method of claim 1 wherein the audio interference between the first audio encounter information and the at least a second audio encounter information that is eliminated by imposing the at least one constraint includes one of:

the at least a second audio encounter information eliminated from the first audio encounter information obtained by a first audio recording beam pointing to the first encounter participant; and

the first audio encounter information eliminated from the at least a second audio encounter information obtained by a second audio recording beam pointing to the at least a second encounter participant.

10. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

obtaining encounter information of a patient encounter, wherein the encounter information includes first audio encounter information and first machine vision encounter information obtained from a first encounter participant and at least a second audio encounter information and at least a second machine vision encounter information obtained from at least a second encounter participant; and

processing the first audio encounter information, first multidimensional data that includes image and tensor data of the first machine vision encounter information, the at least a second audio encounter information, and second multidimensional data that includes image and tensor data of the at least a second machine vision encounter information to eliminate audio interference between the first audio encounter information and the at least a second audio encounter information, wherein eliminating the audio interference between the first audio encounter information and the at least a second audio encounter information includes identifying, from the encounter information of a patient encounter, source signals of the first audio encounter information and the at least a second audio encounter information that are probabilistically one of minimally correlated and maximally independent based upon, at least in part, the first multidimensional data and the second multidimensional data, and wherein a time dimension is not included when identifying the source signals to eliminate the audio interference.

11. The computer program product of claim 10 wherein obtaining encounter information of the patient encounter includes:

steering a first audio recording beam toward the first encounter participant; and

steering at least a second audio recording beam toward the at least a second encounter participant.

12. The computer program product of claim 10 wherein processing the first audio encounter information and the at least a second audio encounter information to eliminate audio interference includes:

executing an echo cancellation process on the first audio encounter information and the at least a second audio encounter information.

13. The computer program product of claim 10 wherein processing the first audio encounter information and the at least a second audio encounter information to eliminate audio interference includes:

executing a blind source process on the first audio encounter information and the at least a second audio encounter information.

14. The computer program product of claim 10 wherein the audio interference between the first audio encounter information and the at least a second audio encounter information includes:

crosstalk between the first audio encounter information and the at least a second audio encounter information, wherein the crosstalk includes active listening in the audio interference that is eliminated between the first audio encounter information and the at least a second audio encounter information.

15. The computer program product of claim 10 further comprising:

processing the encounter information to generate an encounter transcript.

16. The computer program product of claim 15 further comprising:

processing at least a portion of the encounter transcript to populate at least a portion of a medical record associated with the patient encounter.

17. A computing system including a processor and memory configured to perform operations comprising:

obtaining encounter information of a patient encounter, wherein the encounter information includes first audio encounter information and first machine vision encounter information obtained from a first encounter participant and at least a second audio encounter information and at least a second machine vision encounter information obtained from at least a second encounter participant; and

processing the first audio encounter information, first multidimensional data that includes image and tensor data of the first machine vision encounter information, the at least a second audio encounter information, and second multidimensional data that includes image and tensor data of the at least a second machine vision encounter information to eliminate audio interference between the first audio encounter information and the at least a second audio encounter information, wherein eliminating the audio interference between the first audio encounter information and the at least a second audio encounter information includes identifying, from the encounter information of a patient encounter, source signals of the first audio encounter information and the at least a second audio encounter information that are probabilistically one of minimally correlated and maximally independent based upon, at least in part, the first multidimensional data and the second multidimensional data, and wherein a time dimension is not included when identifying the source signals to eliminate the audio interference.

18. The computing system of claim 17 wherein obtaining encounter information of the patient encounter includes:

steering a first audio recording beam toward the first encounter participant; and

steering at least a second audio recording beam toward the at least a second encounter participant.

19. The computing system of claim 17 wherein processing the first audio encounter information and the at least a second audio encounter information to eliminate audio interference includes:

executing an echo cancellation process on the first audio encounter information and the at least a second audio encounter information.

20. The computing system of claim 17 wherein processing the first audio encounter information and the at least a second audio encounter information to eliminate audio interference includes:

executing a blind source process on the first audio encounter information and the at least a second audio encounter information.

21. The computing system of claim 17 wherein the audio interference between the first audio encounter information and the at least a second audio encounter information includes:

crosstalk between the first audio encounter information and the at least a second audio encounter information, wherein the crosstalk includes active listening in the audio interference that is eliminated between the first audio encounter information and the at least a second audio encounter information.

22. The computing system of claim 17 further comprising:

processing the encounter information to generate an encounter transcript.

23. The computing system of claim 22 further comprising:

processing at least a portion of the encounter transcript to populate at least a portion of a medical record associated with the patient encounter.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2018
From: GALLOPYN, GUIDO REMI MARCEL; SHARMA, DUSHYANT; JOST, UWE HELMUT; OWEN, DONALD E; NAYLOR, PATRICK A; NOUR-ELDIN, AMR; ALMENDRO BARREDA, DANIEL PAULINO
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 047770/0984 →