IP Library Granted Patent US 10,510,348
Granted Patent B1
US 10,510,348 · App. 16/145,572 · Granted Dec 17, 2019

Smart medical room optimization of speech recognition systems

Inventors: Andrew J. Lavery (Austin, TX); Kenney Ng (Arlington, MA); Michael A. Picheny (White Plains, NY); Paul C. Tang (Los Altos, CA)
Assignee: International Business Machines Corporation
G10L15/265G10L15/22G16H10/60G16H80/00G10L2015/228
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,510,348
App. No.
16/145,572
Granted
Dec 17, 2019
Kind
B1
Abstract

A method, computer system, and a computer program product for optimizing speech recognition in a smart medical room. The present invention may include receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices. The present invention may also include accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter. The present invention may further include selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment, wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room.

Claims (102)

1. A method for optimizing speech recognition in a smart medical room, the method comprising:

receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices;

accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter; and

selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment,

wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room,

wherein the one or more speech domain models are trained with one or more feedback from the clinician based on the medical encounter and from a continuous feedback display in the smart medical room,

wherein the one or more feedback from the clinician is based on an optional notification to the clinician to confirm the one or more speech models in use.

2. The method of claim 1 in which the medical encounter includes at least one clinician and a patient.

3. The method of claim 2 , further comprising:

identifying the at least one clinician is located in the smart medical room by utilizing an active badge device and one or more cameras; and

detecting a proximity of the identified at least one clinician to the patient by utilizing the one or more cameras.

4. The method of claim 2 , further comprising:

determining that the patient is present in the smart medical room by utilizing one or more cameras and one or more biometric devices; and

confirming the identity of the patient in the smart medical room by utilizing one or more cameras and one or more biometric devices.

5. The method of claim 4 in which the one or more biometric devices utilized to confirm the identity of the patient in the smart medical room is selected from the group consisting of:

(i) a finger print recognition device,

(ii) a facial recognition device,

(iii) a voice pattern recognition device,

(iv) an iris recognition device,

(v) a retinal recognition device,

(vi) a hand geometry recognition device,

(vii) a palm print recognition device, and

(viii) a walking gait recognition device.

6. The method of claim 1 in which the plurality of medical equipment is selected from the group consisting of:

(i) a smart prescription clipboard,

(ii) an examination bed,

(iii) an examination chair,

(iv) a stethoscope,

(v) a blood pressure cuff,

(vi) a weight scale,

(vii) an otoscope,

(viii) a syringe,

(ix) a drug infusion device,

(x) an ophthalmology device, and

(xi) a medical imaging device.

7. The method of claim 1 , wherein selecting, from the database, the one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment, further comprises:

detecting a change in the use of at least one medical device associated with the plurality of medical equipment; and

triggering a switch of a current speech domain model utilized during the medical encounter.

8. The method of claim 1 , further comprising:

determining the received piece of verbal data is selected from the group consisting of:

(i) a key word, and

(ii) a phrase; and

triggering a switch of a current speech domain model utilized during the medical encounter.

9. A computer system for optimizing speech recognition in a smart medical room, comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:

receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices;

accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter; and

selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment,

wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room,

wherein the one or more speech domain models are trained with one or more feedback from the clinician based on the medical encounter and from a continuous feedback display in the smart medical room,

wherein the one or more feedback from the clinician is based on an optional notification to the clinician to confirm the one or more speech models in use.

10. The computer system of claim 9 in which the medical encounter includes at least one clinician and a patient.

11. The computer system of claim 10 , further comprising:

identifying the at least one clinician is located in the smart medical room by utilizing an active badge device and one or more cameras; and

detecting a proximity of the identified at least one clinician to the patient by utilizing the one or more cameras.

12. The computer system of claim 10 , further comprising:

determining that the patient is present in the smart medical room by utilizing one or more cameras and one or more biometric devices; and

confirming the identity of the patient in the smart medical room by utilizing one or more cameras and one or more biometric devices.

13. The computer system of claim 12 in which the one or more biometric devices utilized to confirm the identity of the patient in the smart medical room is selected from the group consisting of:

(i) a finger print recognition device,

(ii) a facial recognition device,

(iii) a voice pattern recognition device,

(iv) an iris recognition device,

(v) a retinal recognition device,

(vi) a hand geometry recognition device,

(vii) a palm print recognition device, and

(viii) a walking gait recognition device.

14. The computer system of claim 9 in which the plurality of medical equipment is selected from the group consisting of:

(i) a smart prescription clipboard,

(ii) an examination bed,

(iii) an examination chair,

(iv) a stethoscope,

(v) a blood pressure cuff,

(vi) a weight scale,

(vii) an otoscope,

(viii) a syringe,

(ix) a drug infusion device,

(x) an ophthalmology device, and

(xi) a medical imaging device.

15. The computer system of claim 9 , wherein selecting, from the database, the one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment, further comprises:

detecting a change in the use of at least one medical device associated with the plurality of medical equipment; and

triggering a switch of a current speech domain model utilized during the medical encounter.

16. The computer system of claim 9 , further comprising:

determining the received piece of verbal data is selected from the group consisting of:

(i) a key word, and

(ii) a phrase; and

triggering a switch of a current speech domain model utilized during the medical encounter.

17. A computer program product for optimizing speech recognition in a smart medical room, comprising:

one or more non-transitory computer-readable storage media and program instructions stored on at least one of the one or more tangible storage media, the program instructions executable by a processor to cause the processor to perform a method comprising:

receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices;

accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter; and

selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment,

wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room,

wherein the one or more speech domain models are trained with one or more feedback from the clinician based on the medical encounter and from a continuous feedback display in the smart medical room,

wherein the one or more feedback from the clinician is based on an optional notification to the clinician to confirm the one or more speech models in use.

18. The computer program product of claim 17 in which the medical encounter includes at least one clinician and a patient.

19. The computer program product of claim 18 , further comprising:

identifying the at least one clinician is located in the smart medical room by utilizing an active badge device and one or more cameras; and

detecting a proximity of the identified at least one clinician to the patient by utilizing the one or more cameras.

20. The computer program product of claim 18 , further comprising:

determining that the patient is present in the smart medical room by utilizing one or more cameras and one or more biometric devices; and

confirming the identity of the patient in the smart medical room by utilizing one or more cameras and one or more biometric devices.

Assignments (3)
SECURITY INTEREST Recorded Oct 1, 2025
From: MERATIVE US L.P.; MERGE HEALTHCARE INCORPORATED
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 072808/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: MERATIVE US L.P.
Reel/Frame 061496/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2018
From: LAVERY, ANDREW J.; NG, KENNEY; PICHENY, MICHAEL A.; TANG, PAUL C.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 047004/0355 →
Cited By (1)
US 12,633,407