IP Library › Granted Patent US 10,719,222
Granted Patent B2
US 10,719,222 · App. 15/988,657 · Granted Jul 21, 2020

Method and system for generating transcripts of patient-healthcare provider conversations

Inventors: Melissa Strader (San Jose, CA); William Ito (Mountain View, CA); Christopher Co (Saratoga, CA); Katherine Chou (Palo Alto, CA); Alvin Rajkomar (Mountain View, CA); Rebecca Rolfe (Menlo Park, CA)
Assignee: Google LLC
G06F3/04855G06F40/289G06F40/30G10L15/26G10L15/265G16H10/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,719,222
App. No.
15/988,657
Filed
May 24, 2018
Granted
Jul 21, 2020
Kind
B2
Examiner
VU, TOAN H
Art Unit
2141
USPC
715/716
Abstract

A method and workstation for generating a transcript of a conversation between a patient and a healthcare practitioner is disclosed. A workstation is provided with a tool for rendering of an audio recording of the conversation and generating a display of a transcript of the audio recording using a speech-to-text engine, thereby enabling inspection of the accuracy of conversion of speech to text. A tool is provided for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling. There is a highlighting in the transcript of words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts. Additionally, there is provided a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording.

Claims (64)

1. A method for generating a transcript of a conversation between a patient and a healthcare practitioner, comprising:

providing on a workstation a rendering of an audio recording of the conversation and generating a display of a transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

providing a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

using a trained machine learning model to automatically recognize in the transcript or in the recording words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts and highlighting such recognized words or phrases spoken by the patient in the transcript;

providing a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording; and

further comprising the step of displaying a note simultaneously with the display of the transcript and populating the note with the highlighted words or phrases in substantial real time with the rendering of the audio.

2. The method of claim 1 , wherein the transcript supplement tools include at least one of the following:

a) a display of smart suggestions for words or phrases and a tool for editing, approving, rejecting or providing feedback on the suggestions;

b) a display of suggested corrected medical terminology;

c) a display of an indication of confidence level in suggested words or phrases.

3. A method for generating a transcript of a conversation between a patient and a healthcare practitioner, comprising:

providing on a workstation a rendering of an audio recording of the conversation and generating a display of a transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

providing a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

highlighting in the transcript words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts;

providing a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording;

displaying a note simultaneously with the display of the transcript and populating the note with the highlighted words or phrases in substantial real time with the rendering of the audio; and wherein the method further comprises the step of minimizing the transcript and viewing the note only, and wherein the note is generated in substantial real time with the rendering of the audio.

4. A method for generating a transcript of a conversation between a patient and a healthcare practitioner, comprising:

providing on a workstation a rendering of an audio recording of the conversation and generating a display of a transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

providing a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

highlighting in the transcript words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts;

providing a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording;

displaying a note simultaneously with the display of the transcript and populating the note with the highlighted words or phrases in substantial real time with the rendering of the audio; and wherein highlighted words or phrase are placed into appropriate categories or classifications in the note.

5. A method for generating a transcript of a conversation between a patient and a healthcare practitioner, comprising:

providing on a workstation a rendering of an audio recording of the conversation and generating a display of a transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

providing a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

highlighting in the transcript words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts;

providing a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording;

displaying a note simultaneously with the display of the transcript and populating the note with the highlighted words or phrases in substantial real time with the rendering of the audio; and providing supplementary information for symptoms including labels for phrases required for billing.

6. The method of claim 1 , further comprising linking words or phrases in the note to relevant parts of the transcript from which the words or phrases in the note originated.

7. The method of claim 1 , further comprising the step of providing tools to edit the transcript.

8. A workstation displaying a transcript of a conversation between a patient and a healthcare practitioner, comprising:

a tool for a rendering of an audio recording of the conversation and generating a display of the transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

a machine learning model trained to automatically recognize in the recording or in the transcript words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts and wherein the display of the transcript includes a highlighting of such recognized words or phrases spoken by the patient; and

a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording;

wherein the workstation includes a display of a note simultaneously with the display of the transcript, the note populated with the highlighted words or phrases in substantial real time with the rendering of the audio.

9. The workstation of claim 8 , wherein the transcript supplement tools include at least one of the following:

a) a display of smart suggestions for words or phrases and a tool for editing, approving, rejecting or providing feedback on the suggestions;

b) a display of suggested corrected medical terminology;

c) a display of an indication of confidence level in suggested words or phrases.

10. The workstation of claim 8 , wherein the workstation is further configured to display a note simultaneously with the display of the transcript and wherein the note is populated with the highlighted words or phrases in substantial real time with the rendering of the audio.

11. A workstation displaying a transcript of a conversation between a patient and a healthcare practitioner, comprising:

a tool for a rendering of an audio recording of the conversation and generating a display of the transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

wherein the display of the transcript includes a highlighting of words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts; and

a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording;

wherein the workstation is further configured to display a note simultaneously with the display of the transcript and wherein the note is populated with the highlighted words or phrases in substantial real time with the rendering of the audio; and

wherein the workstation further includes a tool for minimizing the transcript and viewing the note only, and wherein the note is generated in substantial real time with the rendering of the audio.

12. A workstation displaying a transcript of a conversation between a patient and a healthcare practitioner, comprising:

a tool for a rendering of an audio recording of the conversation and generating a display of the transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

wherein the display of the transcript includes a highlighting of words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts; and

a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording;

wherein the workstation is further configured to display a note simultaneously with the display of the transcript and wherein the note is populated with the highlighted words or phrases in substantial real time with the rendering of the audio; and

wherein highlighted words or phrase are placed into appropriate categories or classifications in the note such as symptoms, medications, etc.

13. A workstation displaying a transcript of a conversation between a patient and a healthcare practitioner, comprising:

a tool for a rendering of an audio recording of the conversation and generating a display of the transcript of the audio recording using a speech-to-text engine in substantial real time with the rendering of the audio recording, thereby enabling inspection of the accuracy of conversion of speech to text;

a tool for scrolling through the transcript and rendering the portion of the audio according to the position of the scrolling;

wherein the display of the transcript includes a highlighting of words or phrases spoken by the patient relating to symptoms, medications or other medically relevant concepts; and

a set of transcript supplement tools enabling editing of specific portions of the transcript based on the content of the corresponding portion of audio recording;

wherein the workstation is further configured to display a note simultaneously with the display of the transcript and wherein the note is populated with the highlighted words or phrases in substantial real time with the rendering of the audio; and

wherein the note includes supplementary information for symptoms including labels for phrases required for billing.

14. The workstation of claim 10 , wherein words or phrases in the note are linked to relevant parts of the transcript from which the words or phrases in the note originated.

15. The workstation of claim 8 , further comprising tools to edit the transcript.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2018
From: STRADER, MELISSA; ITO, WILLIAM; CO, CHRISTOPHER; CHOU, KATHERINE; RAJKOMAR, ALVIN; ROLFE, REBECCA
To: GOOGLE LLC
Reel/Frame 045959/0270 →
Continuity (2)
Provisional Application 62575725 · Oct 23, 2017
Related Publication 20190121532A1 · Apr 25, 2019