IP Library Granted Patent US 8,560,321
Granted Patent B1
US 8,560,321 · App. 12/985,174 · Granted Oct 15, 2013

Automated speech recognition system for natural language understanding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,560,321
App. No.
12/985,174
Granted
Oct 15, 2013
Kind
B1
Abstract

An interactive response system directs input to a software-based router, which is able to intelligently respond to the input by drawing on a combination of human agents, advanced speech recognition and expert systems. The system utilizes human “intent analysts” for purposes of interpreting customer utterance. Automated speech recognition subsystems are trained by coupling utterances with IA-selected meanings for those utterances, using non-real time systems to develop the training information for the automated speech recognition subsystems.

Claims (36)

1. A system for processing an interaction with a person, comprising:

a routing processor configured to receive data representing an utterance from the person;

an automated recognition processor in communication with the routing processor and configured to receive therefrom the data, the automated recognition processor producing responsive to the data an output substantially in real time corresponding to a determination of an intent of the person;

an analyst user interface device in communication with the routing processor, configured to present to a human analyst the utterance in perceptible form and to accept intent input from the human analyst; and

a training subsystem in communication with the routing processor, the automated recognition processor, and the intent input and producing in response training information for the automated recognition processor.

2. The system of claim 1 , wherein the training subsystem comprises a second automated recognition processor not operating in real-time.

3. The system of claim 1 , wherein the routing processor is configured to selectively use the automated recognition processor responsive to a quality of operation of the automated recognition processor.

4. The system of claim 1 , further comprising a second analyst user interface device in communication with the routing processor, configured to present to a second human analyst the utterance in perceptible form and to accept second intent input from the second human analyst, wherein the intent input is selectively processed by the training subsystem responsive to the intent input matching the second intent input.

5. The system of claim 1 , wherein the training subsystem comprises a plurality of non real-time ASRs, the training information being generated selectively upon concurrence of the non real-time ASRs.

6. The system of claim 1 , wherein the training information comprises a statistical model corresponding to the utterance.

7. A computer-implemented method for operating an interactive response system comprising:

receiving data representing an utterance from a person;

using a processor, automatically presenting the utterance in perceptible form to an intent analyst through an analyst user interface;

accepting intent input from intent analyst through the analyst user interface, where the intent input characterizes the intent analyst's interpretation of the person's intent expressed in the utterance;

providing the data and the intent input to a training subsystem;

accepting from the training subsystem training information generated responsive to the data and the intent input; and

sending the training information to a real-time recognition processor in order to improve performance thereof.

8. The computer-implemented method of claim 7 , further comprising accepting intent input from a second intent analyst, wherein said providing is done responsive to intent input from the intent analyst matching intent input from the second intent analyst.

9. The computer-implemented method of claim 7 , wherein the training information is not generated in real-time by the training subsystem.

10. The computer-implemented method of claim 7 , further comprising sending a second utterance to the real-time recognition processor responsive to performance of the real-time recognition processor exceeding a threshold quality level.

11. The computer-implemented method of claim 7 , further comprising automatically presenting the utterance in perceptible form to a second analyst and accepting second intent input from the second analyst, wherein the intent input is selectively provided to the training subsystem responsive to the intent input matching the second intent input.

12. The computer-implemented method of claim 7 , wherein the training subsystem comprises a plurality of non real-time ASRs, the training information being generated selectively upon concurrence of the non real-time ASRs.

13. The computer-implemented method of claim 7 , wherein the training information comprises a statistical model corresponding to the utterance.

14. A system for managing interactions with a person, comprising non-transitory computer storage media storing programming instructions executable by at least one processor to:

receive data representing an utterance from a person;

automatically present the utterance in perceptible form to an intent analyst through an analyst user interface;

accept intent input from intent analyst through the analyst user interface, where the intent input characterizes the intent analyst's interpretation of the person's intent expressed in the utterance;

provide the data and the intent input to a training subsystem;

accept from the training subsystem training information generated responsive to the data and the intent input; and

send the training information to a real-time recognition processor in order to improve performance thereof.

15. The system of claim 14 , wherein the instructions further comprise instructions to accept intent input from a second intent analyst, wherein said instructions to provide are responsive to intent input from the intent analyst matching intent input from the second intent analyst.

16. The system of claim 14 , wherein the training information is not generated in real-time by the training subsystem.

17. The system of claim 14 , wherein the instructions further comprise instructions to send a second utterance to the real-time recognition processor responsive to performance of the real-time recognition processor exceeding a threshold quality level.

18. The system of claim 14 , wherein the instructions further comprise instructions to automatically present the utterance in perceptible form to a second analyst and accept second intent input from the second analyst, wherein the intent input is selectively provided to the training subsystem responsive to the intent input matching the second intent input.

19. The system of claim 14 , wherein the training subsystem comprises a plurality of non real-time ASRs, the training information being generated selectively upon concurrence of the non real-time ASRs.

20. The system of claim 14 , wherein the training information comprises a statistical model corresponding to the utterance.

Assignments (19)
RELEASE OF SECURITY INTEREST Recorded Sep 4, 2025
From: RUNWAY GROWTH FINANCE CORP., AS AGENT
To: INTERACTIONS CORPORATION; INTERACTIONS LLC
Reel/Frame 072802/0931 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 060445 FRAME: 0733. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 1, 2023
From: INTERACTIONS LLC; INTERACTIONS CORPORATION
To: RUNWAY GROWTH FINANCE CORP.
Reel/Frame 062919/0063 →
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY RECORDED AT REEL/FRAME: 036100/0925 Recorded Jul 1, 2022
From: SILICON VALLEY BANK
To: INTERACTIONS LLC
Reel/Frame 060559/0576 →
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY RECORDED AT REEL/FRAME: 043039/0808 Recorded Jun 30, 2022
From: SILICON VALLEY BANK
To: INTERACTIONS LLC
Reel/Frame 060557/0636 →
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY RECORDED AT 036099/0682 Recorded Jun 30, 2022
From: SILICON VALLEY BANK
To: INTERACTIONS LLC
Reel/Frame 060544/0445 →
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY RECORDED AT REEL/FRAME: 049387/0687 Recorded Jun 30, 2022
From: SILICON VALLEY BANK
To: INTERACTIONS LLC
Reel/Frame 060557/0919 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 27, 2022
From: INTERACTIONS LLC; INTERACTIONS CORPORATION
To: RUNWAY GROWTH FINANCE CORP.
Reel/Frame 060445/0733 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY Recorded May 23, 2022
From: ORIX GROWTH CAPITAL, LLC
To: INTERACTIONS CORPORATION; INTERACTIONS LLC
Reel/Frame 061749/0825 →
RELEASE OF SECURITY INTEREST Recorded May 18, 2020
From: BEARCUB ACQUISITIONS LLC
To: ARES VENTURE FINANCE, L.P.
Reel/Frame 052693/0866 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 5, 2019
From: INTERACTIONS CORPORATION
To: SILICON VALLEY BANK
Reel/Frame 049387/0687 →
ASSIGNMENT OF IP SECURITY AGREEMENT Recorded Nov 17, 2017
From: ARES VENTURE FINANCE, L.P.
To: BEARCUB ACQUISITIONS LLC
Reel/Frame 044481/0034 →
AMENDED AND RESTATED INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 29, 2017
From: INTERACTIONS LLC
To: SILICON VALLEY BANK
Reel/Frame 043039/0808 →
CORRECTIVE ASSIGNMENT TO CORRECT THE CHANGE PATENT 7146987 TO 7149687 PREVIOUSLY RECORDED ON REEL 036009 FRAME 0349. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 17, 2015
From: INTERACTIONS LLC
To: ARES VENTURE FINANCE, L.P.
Reel/Frame 037134/0712 →
SECURITY AGREEMENT Recorded Jul 13, 2015
From: INTERACTIONS LLC
To: SILICON VALLEY BANK
Reel/Frame 036099/0682 →
FIRST AMENDMENT TO INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 13, 2015
From: INTERACTIONS LLC
To: SILICON VALLEY BANK
Reel/Frame 036100/0925 →
SECURITY INTEREST Recorded Jun 23, 2015
From: INTERACTIONS LLC
To: ARES VENTURE FINANCE, L.P.
Reel/Frame 036009/0349 →
SECURITY INTEREST Recorded Dec 19, 2014
From: INTERACTIONS LLC
To: ORIX VENTURES, LLC
Reel/Frame 034677/0768 →
MERGER Recorded Dec 16, 2014
From: INTERACTIONS CORPORATION
To: INTERACTIONS LLC
Reel/Frame 034514/0066 →
SECURITY INTEREST Recorded Jun 27, 2014
From: INTERACTIONS CORPORATION
To: ORIX VENTURES, LLC
Reel/Frame 033247/0219 →