IP Library Granted Patent US 10,691,407
Granted Patent B2
US 10,691,407 · App. 15/840,586 · Granted Jun 23, 2020

Methods and systems for analyzing speech during a call and automatically modifying, during the call, a call center referral interface

Inventors: Julie Keunhee Yoo (Boston, MA); Graham Stewart Gardner (Sudbury, MA); Vinay Seth Mohta (Newton, MA); Jakov Kucan (Cambridge, MA)
Assignee: Kyruus, Inc.
G06F3/167G10L15/02G10L15/22G10L15/26G10L25/63G10L25/66G16H40/20G16H80/00A61B5/0002G10L15/1815G10L2015/088H04M3/5183
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,691,407
App. No.
15/840,586
Granted
Jun 23, 2020
Kind
B2
Abstract

A method for analyzing speech generated during a call to generate a potential referral and automatically modifying, during the call, a user interface displaying data associated with the analyzed speech, includes analyzing, by an analysis engine, during a call by a patient to a call center operator, data generated during the call, the data received from a second computing device. The method includes identifying patient data associated with the patient. The method includes determining at least one requirement of the patient based upon the identified patient data and the analysis. The method includes generating a potential referral to a physician for the patient, the physician having a profile that satisfies the determined at least one requirement. The method includes modifying a user interface displayed to the call center, during the call, the modification to the display including addition of an identification of the potential referral.

Claims (32)

1. A method for analyzing speech generated during a call to generate a potential referral and automatically modifying, during the call, a user interface displaying, to a call center operator generating a referral to a physician for a patient, data associated with the analyzed speech, the method comprising:

receiving, during a call by a patient to a call center operator, by an analysis engine executing on a first computing device, from a second computing device executing a speech-to-text converter, data generated during a call by a patient to a call center operator by converting audio data to text data, the call center operator generating a referral to a physician for the patient;

analyzing, by the analysis engine, the received data generated during the call, wherein analyzing further comprises:

analyzing at least one acoustic feature of the patient speech during the call, the at least one acoustic feature identified in the received data, and

identifying at least one keyword within the received data;

identifying, by the analysis engine, patient data stored in an electronic medical record associated with the patient, responsive to the analysis of the identified at least one keyword;

determining, by the analysis engine, at least one requirement of the patient based upon the identified patient data and the analysis of the at least one acoustic feature and of the identified at least one keyword;

generating, during the call by the patient to the call center operator, by the analysis engine, a potential referral to a physician for the patient, the physician having a profile that satisfies the determined at least one requirement, based on the analysis of the at least one acoustic feature and of the identified at least one keyword; and

modifying, by a presentation engine executing on the second computing device, a user interface displayed to the call center operator, during the call by the patient to the call center operator, the modification to the user interface including addition to the user interface of an identification of the potential referral; and

modifying, by the presentation engine, the user interface displayed to the call center operator, during the call by the patient to the call center operator, the modification to the display including addition to the user interface of an identification of feedback to the call center operator regarding an emotional state of the patient, based on the analysis of the acoustic feature and of the identified at least one keyword.

2. The method of claim 1 , wherein analyzing further comprises identifying, by the analysis engine, sentiment data including an identification of a sentiment expressed by the patient.

3. The method of claim 1 , wherein analyzing further comprises identifying, by the analysis engine, an emotional state of the patient.

4. The method of claim 3 , wherein determining the at least one requirement of the patient includes determining a level of urgency of a patient need based upon the identified emotional state of the patient.

5. The method of claim 3 , wherein modifying further comprises modifying the user interface, during the call, to include feedback to the agent regarding the patient emotion.

6. The method of claim 1 , wherein analyzing further comprises identifying, by the analysis engine, at least one personality trait of the patient.

7. The method of claim 6 , wherein determining the at least one requirement of the patient further comprises determining a characteristic of a physician with a complementary personality trait to the identified at least one personality trait of the patient.

8. The method of claim 1 , wherein identifying further comprises identifying, by the analysis engine, within a record accessible to the call center, the patient data.

9. The method of claim 1 , wherein identifying further comprises identifying, by the analysis engine, an electronic medical record associated with the patient.

10. The method of claim 1 , wherein determining further comprises matching, by the analysis engine, a key word identified within the received data to a term within a taxonomy system accessible to the first computing device.

11. The method of claim 1 further comprising determining, by the analysis engine, before generating the potential referral, that the profile satisfies a clinical effectiveness requirement.

12. The method of claim 1 further comprising:

determining that the physician is not available;

generating, by the analysis engine, a second potential referral to a second physician for the patient, the physician having a profile that satisfies the determined requirement; and

providing, by the presentation engine, to the call center, the second potential referral during the call.

13. A system for analyzing speech generated during a call to generate a potential referral and automatically modifying, during the call, a user interface displaying, to a call center operator generating a referral to a physician for a patient, data associated with the analyzed speech, the system comprising:

an analysis engine executing on a first computing device and:

(i) receiving, during a call by a patient to a call center operator, from a second computing device executing a speech-to-text converter, data generated during a call by a patient to a call center operator by converting audio data to text data, the call center operator generating a referral to a physician for the patient,

(ii) analyzing, the received data generated during the call, wherein analyzing further comprises analyzing at least one acoustic feature of the patient speech during the call, the at least one acoustic feature identified in the received data and identifying at least one keyword within the received data,

(iii) identifying patient data stored in an electronic medical record associated with the patient, responsive to the analysis of the identified at least one keyword,

(iv) determining at least one requirement of the patient based upon the identified patient data and the analysis analysis of the at least one acoustic feature and of the identified at least one keyword,

(v) generating, during the call by the patient to the call center operator, a potential referral to a physician for the patient, the physician having a profile that satisfies the determined at least one requirement, based on the analysis of the at least one acoustic feature and of the identified at least one keyword; and

a presentation engine executing on the second computing device and (i) modifying a user interface displayed to the call center operator, during the call by the patient to the call center operator, the modification to the user interface including addition to the user interface of an identification of the potential referral and (ii) modifying the user interface displayed to the call center operator, during the call by the patient to the call center operator, the modification to the display including addition to the user interface of an identification of feedback to the call center operator regarding an emotional state of the patient, based on the analysis of the acoustic feature and of the identified at least one keyword.

Assignments (4)
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT OF PATENTS AT REEL 70089, FRAME 0160 Recorded Oct 29, 2025
From: FIRST-CITIZENS BANK & TRUST COMPANY, AS ADMINISTRATIVE AGENT
To: KYRUUS, INC.; EPION HEALTH, INC.; HEALTHSPARQ, INC.
Reel/Frame 073417/0907 →
MEMORANDUM OF SECURITY INTEREST IN PATENTS Recorded Oct 21, 2025
From: KYRUUS, INC.
To: ANTARES CAPITAL LP
Reel/Frame 073144/0115 →
SECURITY INTEREST Recorded Feb 3, 2025
From: KYRUUS, INC.; HEALTHSPARQ, INC.; EPION HEALTH, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 070089/0160 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2018
From: YOO, JULIE KEUNHEE; GARDNER, GRAHAM STEWART; MOHTA, VINAY SETH; KUCAN, JAKOV
To: KYRUUS, INC.
Reel/Frame 044684/0729 →
Continuity (2)
Provisional Application 62433882 · Dec 14, 2016
Related Publication 20180165062A1 · Jun 14, 2018
Cited By (2)
US 12,223,511 US 12,293,834