IP Library Granted Patent US 8,145,489
Granted Patent B2
US 8,145,489 · App. 12/847,564 · Granted Mar 27, 2012

System and method for selecting and presenting advertisements based on natural language processing of voice-based input

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,145,489
App. No.
12/847,564
Granted
Mar 27, 2012
Kind
B2
Abstract

A system and method for selecting and presenting advertisements based on natural language processing of voice-based inputs is provided. A user utterance may be received at an input device, and a conversational, natural language processor may identify a request from the utterance. At least one advertisement may be selected and presented to the user based on the identified request. The advertisement may be presented as a natural language response, thereby creating a conversational feel to the presentation of advertisements. The request and the user's subsequent interaction with the advertisement may be tracked to build user statistical profiles, thus enhancing subsequent selection and presentation of advertisements.

Claims (44)

1. A method for selecting and presenting advertisements in response to processing natural language utterances, comprising:

recognizing, at a server, one or more words or phrases in a natural language utterance that contains a request, wherein the server includes a speech recognition engine that recognizes the one or more words or phrases in the natural language utterance;

interpreting the recognized words or phrases at a conversational language processor coupled to the server and the speech recognition engine to establish a context associated with the natural language utterance;

delivering an advertisement in the established context associated with the natural language utterance from the server to an electronic device in communication with the server, wherein the advertisement relates to one or more of the recognized words or phrases, an action associated with the request, a personalized cognitive model derived from an interaction pattern associated with a specific user, a generalized cognitive model derived from an interaction pattern associated with a plurality of users, or an environmental model derived from environmental conditions or surroundings associated with the specific user;

tracking, at the server, an interaction pattern associated with the advertisement delivered to the electronic device;

updating, at the server, the personalized cognitive model, the generalized cognitive model, and the environmental model based on the tracked interaction pattern associated with the advertisement;

building, at the server, long-term shared knowledge and short-term shared knowledge from the updated personalized cognitive model, the updated generalized cognitive model, and the updated environmental model; and

interpreting a subsequent natural language utterance at the conversational language processor using the long-term shared knowledge and the short-term shared knowledge.

2. The method of claim 1 , wherein the updated personalized cognitive model, the updated generalized cognitive model, and the updated environmental model provide statistical profiles to select one or more subsequent advertisements in response to the subsequent natural language utterance.

3. The method of claim 2 , wherein the statistical profiles identify one or more affinities between the advertisement delivered to the electronic device and one or more of the recognized words or phrases, the action associated with the request, the updated personalized cognitive model, the updated generalized cognitive model, or the updated environmental model.

4. The method of claim 1 , wherein the tracked interaction pattern associated with the advertisement includes information associated with a subsequent request in which the electronic device interacts with the advertisement.

5. The method of claim 4 , wherein the subsequent request in which the electronic device interacts with the advertisement includes the electronic device initiating a task or initiating a query relating to the advertisement.

6. The method of claim 1 further comprising using, at the conversational language processor, the tracked interaction pattern associated with the advertisement to resolve the request in response to determining that the natural language utterance includes incomplete or ambiguous information.

7. The method of claim 1 , wherein the speech recognition engine recognizes the one or more words or phrases in the natural language utterance using a plurality of dictionary and phrase entries that are dynamically updated based on a history of a current dialog and one or more prior dialogs.

8. The method of claim 7 , wherein the plurality of dictionary and phrase entries are further dynamically updated based on one or more dynamic fuzzy set probabilities or prior probabilities derived from the history of the current dialog and the prior dialogs.

9. A system to select and present advertisements in response to natural language utterances, comprising:

a speech recognition engine configured to recognize one or more words or phrases in a natural language utterance that contains a request;

a conversational language processor configured to interpret the recognized words or phrases to establish a context associated with the natural language utterance; and

a server associated with the speech recognition engine and the conversational language processor, wherein the server is configured to:

deliver an advertisement in the established context associated with the natural language utterance to an electronic device in communication with the server, wherein the advertisement relates to one or more of the recognized words or phrases, an action associated with the request contained in the utterance, a personalized cognitive model derived from an interaction pattern associated with a specific user, a generalized cognitive model derived from an interaction pattern associated with a plurality of users, or an environmental model derived from environmental conditions or surroundings associated with the specific user;

track an interaction pattern associated with the advertisement delivered to the electronic device;

update the personalized cognitive model, the generalized cognitive model, and the environmental model based on the tracked interaction pattern associated with the advertisement; and

build long-term shared knowledge and, short-term shared knowledge from the updated personalized cognitive model, the updated generalized cognitive model, and the updated environmental model, wherein the conversational language processor is further configured to use the long-term shared knowledge and the short-term shared knowledge to interpret a subsequent natural language utterance.

10. The system of claim 9 , wherein the updated personalized cognitive model, the updated generalized cognitive model, and the updated environmental model provide statistical profiles to select one or more subsequent advertisements in response to the subsequent natural language utterance.

11. The system of claim 10 , wherein the statistical profiles identify one or more affinities between the advertisement delivered to the electronic device and one or more of the recognized words or phrases, the action associated with the request, the updated personalized cognitive model, the updated generalized cognitive model, or the updated environmental model.

12. The system of claim 9 , wherein the tracked interaction pattern associated with the advertisement includes information associated with a subsequent request in which the electronic device interacts with the advertisement.

13. The system of claim 12 , wherein the subsequent request in which the electronic device interacts with the advertisement includes a task that the electronic device initiated or a query that the electronic device initiated in relation to the advertisement.

14. The system of claim 9 wherein the conversational language processor is further configured to use the tracked interaction pattern associated with the advertisement to resolve the request in response to the natural language utterance including incomplete or ambiguous information.

15. The system of claim 9 wherein the speech recognition engine is configured to use a plurality of dictionary and phrase entries that are dynamically updated based on a history of a current dialog and one or more prior dialogs to recognize the one or more words or phrases in the natural language utterance.

16. The system of claim 15 wherein the plurality of dictionary and phrase entries are further dynamically updated based on one or more dynamic fuzzy set probabilities or prior probabilities derived from the history of the current dialog and the prior dialogs.

17. A method for selecting and presenting advertisements in response to processing natural language utterances, comprising:

recognizing, at a speech recognition engine that executes on a server, one or more words or phrases in a natural language utterance;

interpreting the one or more recognized words or phrases at a conversational language processor that executes on the server to establish a context associated with the natural language utterance;

delivering an advertisement in the established context associated with the natural language utterance from the server to an electronic device in communication with the server;

tracking, at the server, an interaction pattern associated with the advertisement delivered to the electronic device;

updating, at the server, one or more models based on the tracked interaction pattern associated with the advertisement, wherein the one or more updated models include updated information associated with a specific user, updated information associated with a plurality of users, and updated information relating to environmental conditions or surroundings associated with the specific user; and

interpreting a subsequent natural language utterance at the conversational language processor using long-term shared knowledge and short-term shared knowledge derived from the updated information associated with the one or more updated models.

18. A system to select and present advertisements in response to natural language utterances, comprising:

a speech recognition engine configured to recognize one or more words or phrases in a natural language utterance;

a conversational language processor configured to interpret the one or more recognized words or phrases to establish a context associated with the natural language utterance; and

a server associated with the speech recognition engine and the conversational language processor, wherein the server is configured to:

deliver an advertisement in the established context associated with the natural language utterance to an electronic device in communication with the server;

track an interaction pattern associated with the advertisement delivered to the electronic device; and

update, based on the tracked interaction pattern associated with the advertisement, one or more models to include updated information associated with a specific user, updated information associated with a plurality of users, and updated information relating to environmental conditions or surroundings associated with the specific user, wherein the conversational language processor is further configured to use long-term shared knowledge and short-term shared knowledge derived from the updated information associated with the one or more updated models to interpret a subsequent natural language utterance.

Assignments (10)
SECURITY INTEREST Recorded Apr 8, 2025
From: VB ASSETS, LLC
To: CONTINGENCY CAPITAL FUND A LP
Reel/Frame 070767/0583 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR'S NAME AND ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 051581 FRAME: 0216. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNOR'S INTEREST.. Recorded Sep 22, 2020
From: VOICEBOX TECHNOLOGIES CORPORATION
To: VB ASSETS, LLC
Reel/Frame 053851/0873 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2020
From: VB ASSETTS LLC
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 051581/0216 →
RELEASE OF SECURITY INTEREST Recorded Jun 13, 2019
From: DELPHI ASSET MANAGEMENT CORPORATION
To: VB ASSETS, LLC
Reel/Frame 049459/0596 →
SECURITY INTEREST Recorded Apr 12, 2019
From: VB ASSETS, LLC
To: DELPHI ASSET MANAGEMENT CORPORATION
Reel/Frame 048872/0831 →
NUNC PRO TUNC ASSIGNMENT Recorded Jul 25, 2018
From: VOICEBOX TECHNOLOGIES CORPORATION
To: VB ASSETS, LLC
Reel/Frame 046456/0128 →
RELEASE OF SECURITY INTEREST Recorded Apr 5, 2018
From: ORIX GROWTH CAPITAL, LLC
To: VOICEBOX TECHNOLOGIES CORPORATION
Reel/Frame 045581/0630 →
SECURITY INTEREST Recorded Dec 22, 2017
From: VOICEBOX TECHNOLOGIES CORPORATION
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 044949/0948 →
MERGER Recorded Apr 7, 2014
From: VOICEBOX TECHNOLOGIES, INC.
To: VOICEBOX TECHNOLOGIES CORPORATION
Reel/Frame 032620/0956 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2010
From: FREEMAN, TOM; KENNEWICK, MIKE
To: VOICEBOX TECHNOLOGIES, INC.
Reel/Frame 024769/0349 →