IP Library Granted Patent US 9,785,753
Granted Patent B2
US 9,785,753 · App. 15/397,634 · Granted Oct 10, 2017

Methods and apparatus for generating clinical reports

Inventor: Mariana Casella dos Santos (Gent, BE)
Assignee: Nuance Communications, Inc.
G06F19/3487G06F19/322G06F19/3406G10L15/183G10L15/265
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,785,753
App. No.
15/397,634
Granted
Oct 10, 2017
Kind
B2
Abstract

Techniques for documenting a clinical procedure involve transcribing audio data comprising audio of one or more clinical personnel speaking while performing the clinical procedure. Examples of applicable clinical procedures include sterile procedures such as surgical procedures, as well as non-sterile procedures such as those conventionally involving a core code reporter. The transcribed audio data may be analyzed to identify relevant information for documenting the clinical procedure, and a text report including the relevant information documenting the clinical procedure may be automatically generated.

Claims (37)

1. A method comprising:

transcribing audio data comprising audio of one or more clinical personnel speaking while performing a sterile procedure, the audio data comprising audio of a first clinician speaking to one or more other clinical personnel while performing the sterile procedure, wherein transcribing the audio data comprises performing automatic speech recognition (ASR) on the audio data using a speech recognition model trained to recognize speech of the first clinician;

analyzing the transcribed audio data, including the transcribed audio of the first clinician speaking to the one or more other clinical personnel while performing the sterile procedure, using at least one processor, to identify relevant information for documenting the sterile procedure; and

automatically generating a text report including the identified relevant information documenting the sterile procedure;

wherein identifying the relevant information comprises detecting within the transcribed audio data a present-tense narration by the first clinician stating to the other clinical personnel that the first clinician is currently performing a particular step of the sterile procedure;

wherein automatically generating the text report comprises automatically transforming the present-tense narration into a non-present-tense text portion in the report, stating that the particular step of the sterile procedure was performed.

2. The method of claim 1 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an instrument used in performing the sterile procedure, wherein the analyzing comprises automatically determining from the transcribed audio data a step of the sterile procedure performed using the instrument, and wherein generating the text report comprises automatically generating text stating that the determined step of the sterile procedure was performed.

3. The method of claim 1 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an action being performed during the sterile procedure, wherein the analyzing comprises automatically determining whether the action is part of a step of the sterile procedure that is relevant for documenting the sterile procedure, and wherein generating the text report comprises, in response to determining that the action is part of a step of the sterile procedure that is relevant for documenting the sterile procedure, automatically generating text stating that the relevant step was performed.

4. The method of claim 1 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an event occurring during the sterile procedure, wherein the analyzing comprises automatically determining whether the event indicates that a patient suffered a complication of the sterile procedure, and wherein generating the text report comprises, in response to determining that the event indicates that the patient suffered a complication of the sterile procedure, automatically generating text stating that the event occurred as a complication.

5. The method of claim 1 , wherein the sterile procedure is performed on a patient, wherein the audio data comprises audio of the one or more clinical personnel orally identifying one or more observations of a condition of the patient during the sterile procedure, wherein the analyzing comprises automatically determining whether the observed condition of the patient indicates that the patient suffered a complication of the sterile procedure, and wherein generating the text report comprises, in response to determining that the observed condition indicates that the patient suffered a complication of the sterile procedure, automatically generating text stating that the condition was observed as a complication.

6. The method of claim 1 , wherein the sterile procedure is performed on a patient, wherein the audio data comprises audio of the one or more clinical personnel orally identifying one or more substances administered to the patient in connection with the sterile procedure, and wherein generating the text report comprises automatically generating text stating that the one or more substances were administered.

7. Apparatus comprising:

at least one processor; and

at least one storage medium storing processor-executable instructions that, when executed by the at least one processor, perform a method comprising:

transcribing audio data comprising audio of one or more clinical personnel speaking while performing a sterile procedure, the audio data comprising audio of a first clinician speaking to one or more other clinical personnel while performing the sterile procedure, wherein transcribing the audio data comprises performing automatic speech recognition (ASR) on the audio data using a speech recognition model trained to recognize speech of the first clinician;

analyzing the transcribed audio data, including the transcribed audio of the first clinician speaking to the one or more other clinical personnel while performing the sterile procedure, to identify relevant information for documenting the sterile procedure; and

automatically generating a text report including the identified relevant information documenting the sterile procedure;

wherein identifying the relevant information comprises detecting within the transcribed audio data a present-tense narration by the first clinician stating to the other clinical personnel that the first clinician is currently performing a particular step of the sterile procedure;

wherein automatically generating the text report comprises automatically transforming the present-tense narration into a non-present-tense text portion in the report, stating that the particular step of the sterile procedure was performed.

8. The apparatus of claim 7 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an instrument used in performing the sterile procedure, wherein the analyzing comprises automatically determining from the transcribed audio data a step of the sterile procedure performed using the instrument, and wherein generating the text report comprises automatically generating text stating that the determined step of the sterile procedure was performed.

9. The apparatus of claim 7 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an action being performed during the sterile procedure, wherein the analyzing comprises automatically determining whether the action is part of a step of the sterile procedure that is relevant for documenting the sterile procedure, and wherein generating the text report comprises, in response to determining that the action is part of a step of the sterile procedure that is relevant for documenting the sterile procedure, automatically generating text stating that the relevant step was performed.

10. The apparatus of claim 7 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an event occurring during the sterile procedure, wherein the analyzing comprises automatically determining whether the event indicates that a patient suffered a complication of the sterile procedure, and wherein generating the text report comprises, in response to determining that the event indicates that the patient suffered a complication of the sterile procedure, automatically generating text stating that the event occurred as a complication.

11. The apparatus of claim 7 , wherein the sterile procedure is performed on a patient, wherein the audio data comprises audio of the one or more clinical personnel orally identifying one or more observations of a condition of the patient during the sterile procedure, wherein the analyzing comprises automatically determining whether the observed condition of the patient indicates that the patient suffered a complication of the sterile procedure, and wherein generating the text report comprises, in response to determining that the observed condition indicates that the patient suffered a complication of the sterile procedure, automatically generating text stating that the condition was observed as a complication.

12. The apparatus of claim 7 , wherein the sterile procedure is performed on a patient, wherein the audio data comprises audio of the one or more clinical personnel orally identifying one or more substances administered to the patient in connection with the sterile procedure, and wherein generating the text report comprises automatically generating text stating that the one or more substances were administered.

13. The apparatus of claim 7 , wherein the analyzing comprises identifying the relevant information based at least in part on patient monitoring data recorded using monitoring equipment during the sterile procedure.

14. At least one non-transitory computer-readable storage medium encoded with computer-executable instructions that, when executed, perform a method comprising:

transcribing audio data comprising audio of one or more clinical personnel speaking while performing a sterile procedure, the audio data comprising audio of a first clinician speaking to one or more other clinical personnel while performing the sterile procedure, wherein transcribing the audio data comprises performing automatic speech recognition (ASR) on the audio data using a speech recognition model trained to recognize speech of the first clinician;

analyzing the transcribed audio data, including the transcribed audio of the first clinician speaking to the one or more other clinical personnel while performing the sterile procedure, to identify relevant information for documenting the sterile procedure; and

automatically generating a text report including the identified relevant information documenting the sterile procedure;

wherein identifying the relevant information comprises detecting within the transcribed audio data a present-tense narration by the first clinician stating to the other clinical personnel that the first clinician is currently performing a particular step of the sterile procedure;

wherein automatically generating the text report comprises automatically transforming the present-tense narration into a non-present-tense text portion in the report, stating that the particular step of the sterile procedure was performed.

15. The at least one non-transitory computer-readable storage medium of claim 14 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an instrument used in performing the sterile procedure, wherein the analyzing comprises automatically determining from the transcribed audio data a step of the sterile procedure performed using the instrument, and wherein generating the text report comprises automatically generating text stating that the determined step of the sterile procedure was performed.

16. The at least one non-transitory computer-readable storage medium of claim 14 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an action being performed during the sterile procedure, wherein the analyzing comprises automatically determining whether the action is part of a step of the sterile procedure that is relevant for documenting the sterile procedure, and wherein generating the text report comprises, in response to determining that the action is part of a step of the sterile procedure that is relevant for documenting the sterile procedure, automatically generating text stating that the relevant step was performed.

17. The at least one non-transitory computer-readable storage medium of claim 14 , wherein the audio data comprises audio of the one or more clinical personnel orally identifying an event occurring during the sterile procedure, wherein the analyzing comprises automatically determining whether the event indicates that a patient suffered a complication of the sterile procedure, and wherein generating the text report comprises, in response to determining that the event indicates that the patient suffered a complication of the sterile procedure, automatically generating text stating that the event occurred as a complication.

18. The at least one non-transitory computer-readable storage medium of claim 14 , wherein the sterile procedure is performed on a patient, wherein the audio data comprises audio of the one or more clinical personnel orally identifying one or more observations of a condition of the patient during the sterile procedure, wherein the analyzing comprises automatically determining whether the observed condition of the patient indicates that the patient suffered a complication of the sterile procedure, and wherein generating the text report comprises, in response to determining that the observed condition indicates that the patient suffered a complication of the sterile procedure, automatically generating text stating that the condition was observed as a complication.

19. The at least one non-transitory computer-readable storage medium of claim 14 , wherein the sterile procedure is performed on a patient, wherein the audio data comprises audio of the one or more clinical personnel orally identifying one or more substances administered to the patient in connection with the sterile procedure, and wherein generating the text report comprises automatically generating text stating that the one or more substances were administered.

20. The at least one non-transitory computer-readable storage medium of claim 14 , wherein the analyzing comprises identifying the relevant information based at least in part on patient monitoring data recorded using monitoring equipment during the sterile procedure.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065530/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2017
From: CASELLA DOS SANTOS, MARIANA
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 041119/0368 →
Continuity (2)
Continuation 13415606 · Mar 8, 2012
Related Publication 20170116392A1 · Apr 27, 2017