IP Library Granted Patent US 11,250,382
Granted Patent B2
US 11,250,382 · App. 16/192,358 · Granted Feb 15, 2022

Automated clinical documentation system and method

Inventors: Dushyant Sharma (Woburn, MA); Patrick A. Naylor (Reading, GB); Uwe Helmut Jost (Groton, MA)
Assignee: NUANCE COMMUNICATIONS, INC.
G06Q10/10G06F3/165G06F40/117G06F40/30G06T7/20G10L15/22G10L15/26G10L15/30G10L25/45G10L25/51G16H10/20G16H10/40G16H10/60G16H15/00G16H50/70H04R1/406H04R3/005G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,250,382
App. No.
16/192,358
Granted
Feb 15, 2022
Kind
B2
Abstract

A method, computer program product, and computing system for initially aligning two or more audio signals to address coarse temporal misalignment between the two or more audio signals. The two or more audio signals are detected by two or more audio detection systems within a monitored space. The two or more audio signals are subsequently realigned to address ongoing temporal signal drift between the two or more audio signals.

Claims (57)

1. A computer-implemented method executed on a computer comprising:

initially aligning two or more audio signals to address coarse temporal misalignment between the two or more audio signals, wherein the two or more audio signals are detected by two or more audio detection systems within a monitored space, wherein initially aligning two or more audio signals to address coarse temporal misalignment between the two or more audio signals includes:

generating an audio alignment signal within the monitored space, wherein the audio alignment signal is a separate signal included within the two or more audio signals, and wherein the audio alignment signal included within the two or more audio signals includes at least one of a white noise burst, a pink noise burst, a swept sine burst, and a defined tone,

detecting the audio alignment signal on the two or more audio detection systems within the monitored space, and

aligning the audio alignment signal included within the two or more audio signals; and

subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals, wherein subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals includes:

detecting a first voice active region within a first of the two or more audio signals from a first participant by a first of the two or more audio detection systems;

detecting a corresponding voice active region within a second of the two or more audio signals from a second participant by a second of the two or more audio detection systems, wherein the first participant and the second participant are different participants; and

aligning the first voice active region within the first of the two or more audio signals from the first participant detected by the first of the two or more audio detection systems with the corresponding voice active region within the second of the two or more audio signals from the second participant detected by the second of the two or more audio detection systems to address ongoing temporal signal drift between the two or more audio signals.

2. The computer-implemented method of claim 1 wherein the two or more audio detection systems includes:

a body worn audio detection system positioned within the monitored space.

3. The computer-implemented method of claim 1 wherein the two or more audio detection systems includes:

a fixed-location audio detection system positioned within the monitored space.

4. The computer-implemented method of claim 1 wherein the ongoing temporal signal drift between the two or more audio signals includes one or more of:

time-of-flight delays due to geographic movement of at least one of the two or more audio detection systems within the monitored space;

processor loading of at least one of the two or more audio detection systems within the monitored space; and

processor drift of at least one of the two or more audio detection systems within the monitored space.

5. The computer-implemented method of claim 1 wherein subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals includes:

repeatedly realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals.

6. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

initially aligning two or more audio signals to address coarse temporal misalignment between the two or more audio signals, wherein the two or more audio signals are detected by two or more audio detection systems within a monitored space, wherein initially aligning two or more audio signals to address coarse temporal misalignment between the two or more audio signals includes:

generating an audio alignment signal within the monitored space, wherein the audio alignment signal is a separate signal included within the two or more audio signals, and wherein the audio alignment signal included within the two or more audio signals includes at least one of a white noise burst, a pink noise burst, a swept sine burst, and a defined tone,

detecting the audio alignment signal on the two or more audio detection systems within the monitored space, and

aligning the audio alignment signal included within the two or more audio signals; and

subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals, wherein subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals includes:

detecting a first voice active region within a first of the two or more audio signals from a first participant by a first of the two or more audio detection systems;

detecting a corresponding voice active region within a second of the two or more audio signals from a second participant by a second of the two or more audio detection systems, wherein the first participant and the second participant are different participants; and

aligning the first voice active region within the first of the two or more audio signals from the first participant detected by the first of the two or more audio detection systems with the corresponding voice active region within the second of the two or more audio signals from the second participant detected by the second of the two or more audio detection systems to address ongoing temporal signal drift between the two or more audio signals.

7. The computer program product of claim 6 wherein the two or more audio detection systems includes:

a body worn audio detection system positioned within the monitored space.

8. The computer program product of claim 6 wherein the two or more audio detection systems includes:

a fixed-location audio detection system positioned within the monitored space.

9. The computer-implemented method of claim 6 wherein the ongoing temporal signal drift between the two or more audio signals includes one or more of:

time-of-flight delays due to geographic movement of at least one of the two or more audio detection systems within the monitored space;

processor loading of at least one of the two or more audio detection systems within the monitored space; and

processor drift of at least one of the two or more audio detection systems within the monitored space.

10. The computer program product of claim 6 wherein subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals includes:

repeatedly realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals.

11. A computing system including a processor and memory configured to perform operations comprising:

initially aligning two or more audio signals to address coarse temporal misalignment between the two or more audio signals, wherein the two or more audio signals are detected by two or more audio detection systems within a monitored space, wherein initially aligning two or more audio signals to address coarse temporal misalignment between the two or more audio signals includes:

generating an audio alignment signal within the monitored space, wherein the audio alignment signal is a separate signal included within the two or more audio signals, and wherein the audio alignment signal included within the two or more audio signals includes at least one of a white noise burst, a pink noise burst, a swept sine burst, and a defined tone,

detecting the audio alignment signal on the two or more audio detection systems within the monitored space, and

aligning the audio alignment signal included within the two or more audio signals; and

subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals, wherein subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals includes:

detecting a first voice active region within a first of the two or more audio signals from a first participant by a first of the two or more audio detection systems;

detecting a corresponding voice active region within a second of the two or more audio signals from a second participant by a second of the two or more audio detection systems, wherein the first participant and the second participant are different participants; and

aligning the first voice active region within the first of the two or more audio signals from the first participant detected by the first of the two or more audio detection systems with the corresponding voice active region within the second of the two or more audio signals from the second participant detected by the second of the two or more audio detection systems to address ongoing temporal signal drift between the two or more audio signals.

12. The computing system of claim 11 wherein the two or more audio detection systems includes:

a body worn audio detection system positioned within the monitored space.

13. The computing system of claim 11 wherein the two or more audio detection systems includes:

a fixed-location audio detection system positioned within the monitored space.

14. The computing system of claim 11 wherein the ongoing temporal signal drift between the two or more audio signals includes one or more of:

time-of-flight delays due to geographic movement of at least one of the two or more audio detection systems within the monitored space;

processor loading of at least one of the two or more audio detection systems within the monitored space; and

processor drift of at least one of the two or more audio detection systems within the monitored space.

15. The computing system of claim 11 wherein subsequently realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals includes:

repeatedly realigning the two or more audio signals to address ongoing temporal signal drift between the two or more audio signals.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2019
From: SHARMA, DUSHYANT; NAYLOR, PATRICK A; JOST, UWE HELMUT
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 048122/0762 →
Continuity (2)
Provisional Application 62638809 · Mar 5, 2018
Related Publication 20190272145A1 · Sep 5, 2019