IP Library Granted Patent US 11,055,739
Granted Patent B2
US 11,055,739 · App. 16/867,032 · Granted Jul 6, 2021

Using environment and user data to deliver advertisements targeted to user interests, e.g. based on a single command

Inventors: Sundar Balasubramanian (Seattle, WA); Michael McSherry (Seattle, WA); Eric Jun Fu (Bellevue, WA); Daniel Hendrick (Bellevue, WA); Deepankar Katyal (Seattle, WA); David J. Kay (Seattle, WA)
Assignee: Nuance Communications, Inc.
G06Q30/0255G06Q30/0257G06Q30/0261G06Q30/0267G06Q30/0269G10L13/033G10L15/20H04L67/2847
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,055,739
App. No.
16/867,032
Granted
Jul 6, 2021
Kind
B2
Abstract

A system and an associated method for responding to a user's voice inquiry are disclosed. The system accepts the voice inquiry and obtains personal data regarding the user. The system then identifies potential subjects of interest in the voice inquiry from media content currently provided to the user through a device which has captured the voice inquiry, media content present in or capturing the user's surroundings, or media content previously provided to the user as responses to previous voice inquiries by the user. Next, the system determines at least one subject of interest based on at least one of the personal data and the user's previous voice inquiries. The system then presents a response related to the determined subject of interest to the user's voice inquiry.

Claims (39)

1. A method of processing audio information, comprising:

receiving a user's voice inquiry from an electronic device;

determining at least one interest element related to the voice inquiry from:

media content currently provided to the user by the electronic device,

media content from the user's environment, wherein the media content from the user's environment includes background sounds present in the user's environment, and

media content previously provided to the user as responses to previous voice inquiries by the user; and

generating a response related to the determined interest element to the user's voice inquiry.

2. The method of claim 1 , wherein the electronic device is selected from one of a television, a radio, a gaming console, a laptop, a tablet, a convertible laptop, a cellular phone, a wearable device, and a kiosk, and wherein presenting the response related to the determined interest element includes presenting the response via the electronic device.

3. The method of claim 1 ,

wherein the media content includes media content from at least one of a movie, a television program, a radio show, a song, a video, a game, and an advertisement.

4. The method of claim 1 , further comprising determining the media content representing the user's environment based on information related to the user's location.

5. The method of claim 1 , further comprising:

obtaining personal data related to the user; and

determining the at least one interest element based, at least in part, on the obtained personal data.

6. The method of claim 1 , wherein the media content from the user's environment further includes scenes.

7. An audio processing system, comprising one or more processors configured to:

receive a user's voice inquiry from an electronic device;

determine at least one interest element related to the voice inquiry from:

media content currently provided to the user by the electronic device,

media content from the user's environment, wherein the media content from the user's environment includes background sounds present in the user's environment, and

media content previously provided to the user as responses to previous voice inquiries by the user; and

generate a response related to the determined interest element to the user's voice inquiry.

8. The system of claim 7 , wherein:

the at least one electronic device is selected from one of a television, a radio, a gaming console, a laptop, a tablet, a convertible laptop, a cellular phone, a wearable device, a dashboard, and a kiosk, and

the one or more processors is configured to present the response on the device.

9. The system of claim 7 , wherein the media content includes at least one of media content from a movie, a television program, a radio show, a song, a video, a game, and an advertisement.

10. The system of claim 7 , wherein the one or more processors is further configured to determine the media content from the user's environment based on information on a current time or a current location of the user.

11. The system of claim 7 , wherein the one or more processors is further configured to:

obtain personal data related to the user; and

determine the at least one interest element based, at least in part, on the personal data.

12. The system of claim 11 , wherein the obtained personal data indicates the user's identity, habits, preferences, and/or moods.

13. The system of claim 11 , wherein the one or more processors is configured to present the response based on the obtained personal data.

14. The system of claim 7 , wherein the one or more processors is further configured to output the response via the electronic device.

15. The system of claim 14 , wherein when the at least one interest element is determined from media content currently provided to the user on the electronic device, the one or more processors is further configured to:

output the response in association with the media content currently provided to the user on the electronic device.

16. The method of claim 5 , wherein the personal data indicates at least one of the user's identity and preferences.

17. The method of claim 1 , further comprising outputting the response via the electronic device.

18. The method of claim 17 , wherein when the at least one interest element is determined from media content currently provided to the user on the electronic device, the method further comprising:

outputting the response in association with the media content currently provided to the user on the electronic device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065552/0934 →
EMPLOYEE AGREEMENT Recorded May 14, 2020
From: BALASUBRAMANIAN, SUNDAR; MCSHERRY, MICHAEL; HENDRICK, DANIEL; KATYAL, DEEPANKAR; KAY, DAVID J.; FU, ERIC
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 053375/0474 →
Continuity (3)
Division 14447414 · Jul 30, 2014
Continuation 14316663 · Jun 26, 2014
Related Publication 20200334712A1 · Oct 22, 2020
Cited By (2)
US 12,488,795 US 12,574,582