IP Library Granted Patent US 8,024,422
Granted Patent B2
US 8,024,422 · App. 12/062,144 · Granted Sep 20, 2011

Web-based speech recognition with scripting and semantic objects

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,024,422
App. No.
12/062,144
Granted
Sep 20, 2011
Kind
B2
Abstract

The present invention is a system and method for creating and implementing transactional speech applications (SAs) using Web technologies, without reliance on server-side standard or custom services. A transactional speech application may be any application that requires interpretation of speech in conjunction with a speech recognition (SR) system, such as, for example, consumer survey systems. A speech application in accordance with the present invention is represented within a Web page, as an application script that interprets semantic objects according to a context. Any commonly known scripting language can be used to write the application script, such as JavaScript (or ECMAScript), PerlScript, and VBscript. The present invention is “Web-based” to the extent that it implements Web technologies, but it need not include or access the World Wide Web.

Claims (86)

1. A speech application system, comprising:

A. a speech recognition (SR) system including a server and configured to receive an audio input and generate a context free semantic object representing a plurality of valid interpretations of said audio input;

B. a set of speech application scripts, loaded at the SR system and configured to control said SR system, said set of application scripts defining a context;

C. a semantic data evaluator, configured to receive said context free semantic object and said context and, as a function thereof, to generate a linguistic result corresponding to said audio input, and to return said linguistic result to said set of application scripts; and

D. a set of reusable object oriented interfaces local to the SR system, said interfaces configured to interface said one or more of said set of application scripts with said SR system.

2. The system of claim 1 , wherein one or more of said set of application scripts is implemented on an extended HTML Web page.

3. The system of claim 1 , wherein one or more of said interfaces are objects exposed via scripting facilities.

4. The system of claim 1 , wherein said application script includes programming code written in a language chosen from a group of scripting languages comprising:

(1) JavaScript;

(2) PerlScript;

(3) VBscript; and

(4) ECMAScript.

5. The system of claim 1 , wherein said context free semantic object is represented as a semantic tree instance.

6. The system of claim 1 , wherein said context free semantic object is represented in a semantic object.

7. The system of claim 1 , wherein said audio input is received from a device chosen from a group comprising:

A. a telephone;

B. a cellular telephone;

C. a personal computer;

D. an application server;

E. an audio receiver; and

F. VolP client.

8. The system of claim 1 , wherein said audio input is received via a network comprised of one or more wire or wireless networks from a group comprising:

A. a telephone network;

B. a cellular telephone network;

C. a LAN;

D. a WAN;

E. a virtual private network;

F. the Internet; and

G. the Web.

9. The system of claim 1 , wherein said plurality of valid interpretations of said audio input includes all valid interpretations of said audio input within said context.

10. The system of claim 1 , wherein speech application is chosen from a group of interactive speech applications comprising:

A. consumer survey applications;

B. Web access applications;

C. educational applications, including health education applications and computer-based lesson applications and testing applications;

D. screening applications, including patient screening applications and consumer screening applications;

E. health risk assessment applications;

F. monitoring applications, including heath data monitoring applications and consumer preference monitoring applications;

G. compliance applications, including applications that generate notifications of compliance related activities, including notifications regarding health or product maintenance;

H. test results applications, including applications that provide at least one of lab test results, standardized tests results, consumer product test results, and maintenance results; and

I. linking applications, including applications that link two or more of the applications in parts A through H.

11. A speech application system comprising:

first computer and second computer;

A. a speech recognition (SR) system hosted on said first computer and configured to receive an audio input from an input device and to generate one or more context free semantic objects representing a plurality of valid interpretations of said audio input;

B. a Web page loaded on said first computer, from said second computer, said Web page including an application script comprising a set of speech application functionality and configured to interact with said input device via said SR system, wherein said speech application is configured to conduct speech application sessions without accessing said second computer, and wherein the application script is configured to control the SR system;

C. a set of reusable object oriented interfaces local to said first computer, said interfaces including:

(1) one or more interface objects configured to facilitate access by said application script to standard services of said first computer; and

(2) an interface configured to facilitate access to and control of said SR system by said application script; and

D. a semantic object evaluator, configured to generate from said context free semantic objects, as a function of said context, a single interpretation of said audio input and to return said single interpretation to said application script.

12. The system of claim 11 , wherein speech application is chosen from a group of interactive speech applications comprising:

A. consumer survey applications;

B. Web access applications;

C. educational applications, including health education applications and computer-based lesson applications and testing applications;

D. screening applications, including patient screening applications and consumer screening applications;

E. health risk assessment applications;

F. monitoring applications, including heath data monitoring applications and consumer preference monitoring applications;

G. compliance applications, including applications that generate notifications of compliance related activities, including notifications regarding health or product maintenance;

H. test results applications, including applications that provide at least one of lab test results, standardized tests results, consumer product test results, and maintenance results; and

I. linking applications, including applications that link two or more of the applications in parts A through H.

13. The system of claim 11 , wherein said set of reusable objet oriented interfaces and said semantic object evaluator are objects exposed via ActiveX facilities.

14. A non-transitory machine-readable storage medium; and executable program instructions embodied in the machine readable storage medium that when executed by a processor of a programmable computing device configures the programmable computing device to execute a speech application script included within a Web page, and configured to interact with a SR system hosted on a first computer and configured to receive an audio input and to generate one or more semantic objects representing a plurality of valid interpretations of said audio input, said first computer also including a plurality of interfaces objects and a semantic object evaluator configured to generate from said one or more semantic objects a single interpretation of said audio input as a function of a context, said speech application script comprising:

A. a context definition;

B. a link to said semantic object evaluator;

C. a link to said SR system, via an interface object, from said plurality of interface objects;

D. a set of control functionality comprising:

(1) a session manager configured to generate user prompts and to determine a next action as a function of said single interpretation;

(2) a SR system controller, configured to control said SR system; and

(3) a communication manager, configured to manage interaction with said input device via said SR system,

wherein said speech application script is loaded on said first computer from a second computer and said speech application is configured to conduct speech application sessions without accessing said second computer.

15. The non-transitory machine-readable storage medium of claim 14 , wherein said interface objects are objects exposed via scripting facilities.

16. The non-transitory machine-readable storage medium of claim 14 , wherein said speech application script is a speech application chosen from a group of interactive speech applications comprising:

A. consumer survey applications;

B. Web access applications;

C. educational applications, including health education applications and computer-based lesson applications and testing applications;

D. screening applications, including patient screening applications and consumer screening applications;

E. health risk assessment applications;

F. monitoring applications, including heath data monitoring applications and consumer preference monitoring applications;

G. compliance applications, including applications that generate notifications of compliance related activities, including notifications regarding health or product maintenance;

H. test results applications, including applications that provide at least one of lab test results, standardized tests results, consumer product test results, and maintenance results; and

I. linking applications, including applications that link two or more of the applications in parts A through H.

17. A method of performing a speech application session, wherein a SR system is hosted on a first computer and includes a means to receive an audio input, said method comprising:

A. receiving said audio input by said SR system;

B. loading a Web page including an application script on said first computer, said application script including a set of functionality configured to manage a speech application session and control said SR system, without accessing functionality from a second computer;

C. establishing a set of standard interfaces between said SR system and said application script, including establishing a semantic evaluator;

D. in response to tasking by said application script, generating by said SR system one or more context free semantic objects representing all possible interpretations of said audio input;

E. in response to receiving a context defined by said application script, determining by said semantic evaluator a single semantic interpretation from said one or more context free semantic objects; and

F. determining a next action by said application script as a function of said single semantic interpretation.

Assignments (8)
RELEASE OF PATENT SECURITY INTERESTS Recorded May 7, 2024
From: JPMORGAN CHASE BANK, N.A.
To: MEDICONNECT.NET, INC. (NKA COTIVITI, INC.); COTIVITI, LLC (NKA COTIVITI, INC.); COTIVITI CORPORATION (NKA COTIVITI, INC.); ELIZA CORPORATION (NKA COTIVITI, INC.)
Reel/Frame 067331/0036 →
SECURITY INTEREST Recorded Jun 7, 2021
From: ELIZA CORPORATION
To: ALTER DOMUS (US) LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 056450/0001 →
SECURITY AGREEMENT Recorded May 28, 2021
From: ELIZA CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056422/0209 →
RELEASE OF SECURITY INTEREST Recorded Apr 2, 2021
From: CITIBANK, N.A.
To: ELIZA CORPORATION
Reel/Frame 055812/0290 →
SECURITY INTEREST Recorded May 19, 2017
From: ELIZA CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042441/0573 →
RELEASE OF SECURITY INTEREST Recorded Apr 26, 2017
From: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
To: ELIZA CORPORATION; ELIZA HOLDING CORP.; ELIZALIVE, INC.
Reel/Frame 042150/0300 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 028374 FRAME: 0586. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT. Recorded Mar 27, 2017
From: ELIZA CORPORATION; ELIZA HOLDING CORP.; ELIZALIVE, INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 042098/0746 →
SECURITY AGREEMENT Recorded Jun 14, 2012
From: ELIZA CORPORATION; ELIZA HOLDING CORP.; ELIZALIVE, INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 028374/0586 →