IP Library Granted Patent US 11,257,576
Granted Patent B2
US 11,257,576 · App. 16/773,447 · Granted Feb 22, 2022

Automated clinical documentation system and method

Inventors: Donald E. Owen (Orlando, FL); Daniel Paulino Almendro Barreda (London, GB); Dushyant Sharma (Woburn, MA)
Assignee: NUANCE COMMUNICATIONS, INC.
G16H10/60A61B5/7405G06F3/16G06F16/637G06F16/685G06F16/904G06F21/6245G06F40/174G06F40/30G06F40/40G06K9/00221G06K9/00288G06K9/00342G06K9/00369G06K9/00664G06K9/00771G06K9/6288G06K19/07762G06N3/006G06T7/00G10L15/08G10L17/00G10L21/0232G11B27/10G16B50/00G16H10/20G16H15/00G16H30/00G16H30/20G16H30/40G16H40/20G16H40/60G16H40/63G16H50/20G16H50/30G16H80/00G16Y20/00H04L51/02H04L51/20H04N7/183H04R1/326H04R3/005H04R3/12G06T2207/10024G06T2207/10044G06T2207/10048G06T2207/10116G06T2207/10132G10L15/1815G10L15/22G10L15/26G10L2021/02082H04N7/181H04R1/406H04R3/02H04R2420/07H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,257,576
App. No.
16/773,447
Granted
Feb 22, 2022
Kind
B2
Abstract

A method, computer program product, and computing system for tracking encounter participants is executed on a computing device and includes obtaining encounter information of a patient encounter, wherein the encounter information includes machine vision encounter information obtained via one or more machine vision systems. The machine vision encounter information is processed to identify one or more humanoid shapes.

Claims (69)

1. A computer-implemented method for tracking encounter participants, executed on a computing device, comprising:

obtaining encounter information of a patient encounter, wherein the encounter information includes machine vision encounter information obtained via one or more machine vision systems;

processing the machine vision encounter information to recognize one or more humanoid shapes within a monitored space, wherein processing the machine vision encounter information includes identifying trajectories of a first humanoid shape of the one or more humanoid shapes, and recognizing a second humanoid shape within the monitored space;

obtaining audio encounter information of the encounter information for at least one of the first and second humanoid shapes from an audio recording system based upon, at least in part, the trajectories of the first humanoid shape of the one or more humanoid shapes;

processing the encounter information to generate at least a portion of an encounter transcript; and

processing at least the portion of the encounter transcript to populate at least a portion of a medical record associated with the patient encounter.

2. The computer-implemented method of claim 1 wherein processing the machine vision encounter information to identify one or more humanoid shapes includes:

tracking the movement of the one or more humanoid shapes within a monitored space.

3. The computer-implemented method of claim 2 wherein tracking the movement of the one or more humanoid shapes within the monitored space includes:

adding the second humanoid shape to the one or more humanoid shapes when the second humanoid shape enters the monitored space.

4. The computer-implemented method of claim 2 wherein tracking the movement of the one or more humanoid shapes within the monitored space includes:

removing an existing humanoid shape from the one or more humanoid shapes when the existing humanoid shape leaves the monitored space.

5. The computer-implemented method of claim 1 further comprising:

steering one or more audio recording beams toward the one or more humanoid shapes to capture the audio encounter information, wherein the audio encounter information is included within the encounter information.

6. The computer-implemented method of claim 1 wherein the one or more machine vision systems includes one or more of:

an RGB imaging system;

an infrared imaging system;

an ultraviolet imaging system;

a laser imaging system;

an X-ray imaging system;

a SONAR imaging system;

a RADAR imaging system; and

a thermal imaging system.

7. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

obtaining encounter information of a patient encounter, wherein the encounter information includes machine vision encounter information obtained via one or more machine vision systems;

processing the machine vision encounter information to recognize one or more humanoid shapes within a monitored space, wherein processing the machine vision encounter information includes identifying trajectories of a first humanoid shape of the one or more humanoid shapes, and recognizing a second humanoid shape within the monitored space;

obtaining audio encounter information of the encounter information for at least one of the first and second humanoid shapes from an audio recording system based upon, at least in part, the trajectories of the first humanoid shape of the one or more humanoid shapes;

processing the encounter information to generate at least a portion of an encounter transcript; and

processing at least the portion of the encounter transcript to populate at least a portion of a medical record associated with the patient encounter.

8. The computer program product of claim 7 wherein processing the machine vision encounter information to identify one or more humanoid shapes includes:

tracking the movement of the one or more humanoid shapes within a monitored space.

9. The computer program product of claim 8 wherein tracking the movement of the one or more humanoid shapes within the monitored space includes:

adding the second humanoid shape to the one or more humanoid shapes when the second humanoid shape enters the monitored space.

10. The computer program product of claim 8 wherein tracking the movement of the one or more humanoid shapes within the monitored space includes:

removing an existing humanoid shape from the one or more humanoid shapes when the existing humanoid shape leaves the monitored space.

11. The computer program product of claim 7 further comprising:

steering one or more audio recording beams toward the one or more humanoid shapes to capture the audio encounter information, wherein the audio encounter information is included within the encounter information.

12. The computer program product of claim 7 wherein the one or more machine vision systems includes one or more of:

an RGB imaging system;

an infrared imaging system;

an ultraviolet imaging system;

a laser imaging system;

an X-ray imaging system;

a SONAR imaging system;

a RADAR imaging system; and

a thermal imaging system.

13. A computing system including a processor and memory configured to perform operations comprising:

obtaining encounter information of a patient encounter, wherein the encounter information includes machine vision encounter information obtained via one or more machine vision systems;

processing the machine vision encounter information to recognize one or more humanoid shapes within a monitored space, wherein processing the machine vision encounter information includes identifying trajectories of a first humanoid shape of the one or more humanoid shapes, and recognizing a second humanoid shape within the monitored space;

obtaining audio encounter information of the encounter information for at least one of the first and second humanoid shapes from an audio recording system based upon, at least in part, the trajectories of the first humanoid shape of the one or more humanoid shapes;

processing the encounter information to generate at least a portion of an encounter transcript; and

processing at least the portion of the encounter transcript to populate at least a portion of a medical record associated with the patient encounter.

14. The computing system of claim 13 wherein processing the machine vision encounter information to identify one or more humanoid shapes includes:

tracking the movement of the one or more humanoid shapes within a monitored space.

15. The computing system of claim 14 wherein tracking the movement of the one or more humanoid shapes within the monitored space includes:

adding the second humanoid shape to the one or more humanoid shapes when the second humanoid shape enters the monitored space.

16. The computing system of claim 14 wherein tracking the movement of the one or more humanoid shapes within the monitored space includes:

removing an existing humanoid shape from the one or more humanoid shapes when the existing humanoid shape leaves the monitored space.

17. The computing system of claim 13 further comprising:

steering one or more audio recording beams toward the one or more humanoid shapes to capture the audio encounter information, wherein the audio encounter information is included within the encounter information.

18. The computing system of claim 13 wherein the one or more machine vision systems includes one or more of:

an RGB imaging system;

an infrared imaging system;

an ultraviolet imaging system;

a laser imaging system;

an X-ray imaging system;

a SONAR imaging system;

a RADAR imaging system; and

a thermal imaging system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2020
From: OWEN, DONALD E.; ALMENDRO BARREDA, DANIEL PAULINO; SHARMA, DUSHYANT
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 051633/0790 →