IP Library Granted Patent US 11,776,043
Granted Patent B2
US 11,776,043 · App. 17/390,717 · Granted Oct 3, 2023

Buying products within video content by voice command

Inventors: Filip Verley, IV (Mountain View, CA); Stuart Ross Hobbie (Mountain View, CA)
Assignee: GOOGLE LLC
G06Q30/0633G06Q20/40145G10L17/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,776,043
App. No.
17/390,717
Granted
Oct 3, 2023
Kind
B2
Abstract

A user registers for an account with an account management system, configures account settings to permit the account management system to receive user computing device data from a user computing device associated with the user, and logs into the account via the user computing device. The account management system receives a user voice purchase command and determines a purchase command context based on the received user computing device data. The account management system identifies a product that the user desires to purchase based on the purchase command context and directs the user computing device web browser to a merchant website to set up a transaction for the identified product.

Claims (56)

1. A computer-implemented method to identify products based on contexts of voice commands, comprising:

by an account management computing system:

receiving, from a computing device, a voice purchase command input detected by a microphone of the computing device at a first time;

receiving, from the computing device, one or more operating state data describing an internal operating state of the computing device during a first predefined time period prior to the first time, the internal operating state identifying content received from a server different from the account management computing system via a network that is displayed via a display device of the computing device or an internet address of a website accessed by the computing device;

identifying purchase command context data comprising one or more of the operating state data and one or more input data by comparing the operating state data and the one or more input data to the voice purchase command;

identifying, based on the purchase command context data, an annotated media file comprising one or more product annotations that identifies one or more products and one or more times at which the one or more products are presented within the annotated media file;

identifying, from the one or more product annotations, a product corresponding to a particular product annotation based on comparing the one or more product annotations and the purchase command context data; and

transmitting an offer associated with the identified product to the computing device to display on the computing device.

2. The method of claim 1 , comprising:

receiving, from the computing device, one or more input data comprising one or more of a sound input and a video input captured by the computing device at a second time during a second predefined time period that begins prior to the first time.

3. The method of claim 2 , wherein the second time after the first time, the one or more input data different from the content received from the server.

4. The method of claim 2 , comprising:

the one or more input data received from a source different from the account management computing system.

5. The method of claim 1 , comprising, by the account management computing system:

in response to receiving the voice purchase command, retrieving a voice signature associated with the computing device; and

determining that the voice purchase command is valid based on the voice signature, wherein the offer is transmitted to the computing device in response to determining that the voice purchase command is valid.

6. The method of claim 5 , wherein the voice signature comprises one or more of a passphrase or physical quality that is unique to a voice.

7. The method of claim 1 , wherein the one or more operating state data further comprises display data, the display data comprising one or more of a video, an audio file, a text file, a webpage, or an application displayed on the computing device.

8. The method of claim 1 , comprising:

retrieving, by the account management computing system, one or more stored product annotations from the annotated media file based on the identified purchase command context data.

9. The method of claim 1 , comprising:

conducting, via the computing device, a transaction with a merchant computing system to purchase the identified product associated with the transmitted offer.

10. A computer program product to identify products based on contexts of voice commands, comprising:

a non-transitory computer-readable medium having computer-readable program instructions embodied thereon that when executed by a computer cause the computer to:

receive, from a computing device, a voice purchase command input detected by a microphone of the computing device at a first time;

receive, from the computing device, one or more operating state data describing an internal operating state of the computing device during a first predefined time period prior to the first time, the internal operating state identifying content received from a server via a network that is displayed via a display device of the computing device or an internet address of a website accessed by the computing device;

identify purchase command context data comprising one or more of the operating state data and the one or more input data by comparing the received operating state data and the one or more input data to the received voice purchase command;

identify, based on the purchase command context data, an annotated media file comprising one or more product annotations that identifies one or more products and one or more times at which the one or more products are presented within the annotated media file;

identify a product for the voice purchase command based on comparing the one or more product annotations to the purchase command context data; and

transmit an offer associated with the identified product to the computing device to display on the computing device.

11. The computer program product of claim 10 , the non-transitory computer-readable medium further having computer-readable program instructions embodied thereon that when executed by the computer cause the computer to:

receive, from the computing device, the one or more input data comprising one or more of a sound input and a video input captured by the computing device during a second predefined time period prior to the first time, wherein identifying the purchase command context data further comprises comparing the received one or more operating state data and the received one or more input data to the voice purchase command, the purchase command context data further comprising the one or more input data.

12. The computer program product of claim 10 , the non-transitory computer-readable medium further having computer-readable program instructions embodied thereon that when executed by the computer cause the computer to:

retrieve, in response to receiving the voice purchase command, a voice signature associated with the computing device; and

determine that the voice purchase command is valid based on the voice signature, wherein the offer is transmitted to the computing device in response to determining that the voice purchase command is valid.

13. The computer program product of claim 10 , wherein the voice signature comprises one or more of a passphrase or physical quality unique to a voice.

14. The computer program product of claim 10 , comprising:

conducting, via the computing device, a transaction with a merchant computing system to purchase the identified product associated with the transmitted offer.

15. A system to identify products based on contexts of voice commands, comprising:

a storage device; and

a processor communicatively coupled to the storage device, wherein the processor executes application code instructions that are stored in the storage device to cause the system to:

receive, from a computing device, a voice purchase command input detected by a microphone of the computing device at a first time;

receive, from the computing device, one or more operating state data that describe an internal operating state of the computing device during a first predefined time period prior to the first time, the internal operating state identifying content received from a server via a network that is displayed via a display device of the computing device or an internet address of a website accessed by the computing device;

identify purchase command context data comprising one or more of the input data and the one or more operating state data by comparing the input data to the voice purchase command;

identify, based on the purchase command context data, an annotated media file comprising one or more product annotations that identifies one or more products and one or more times at which the one or more products are presented within the annotated media file;

identify a product associated with a particular product annotation of the one or more product annotations based on comparing the one or more product annotations and the purchase command context data; and

transmit an offer associated with the identified product to the computing device for display on the computing device.

16. The system of claim 15 , wherein the processor is further configured to execute computer-readable program instructions stored in the storage medium to cause the system to:

receive, from the computing device, one or more operating state data describing an operating state of the computing device within a second predefined time period prior to the first time, wherein identifying the purchase command context data further comprises comparing the received one or more operating state data and the received one or more input data against the voice purchase command to identify the purchase command context data, the purchase command context data further comprising one or more of the operating state data.

17. The system of claim 15 , wherein the one or more operating state data comprises one or more of a video, an audio file, a text file, a webpage, or an application displayed on the computing device.

18. The system of claim 15 , wherein the processor is further configured to execute computer-readable program instructions stored in the storage medium to cause the system to:

in response to receiving the voice purchase command, retrieve a voice signature associated with the computing device; and

determine that the voice purchase command is valid based on the voice signature, wherein the offer is transmitted to the computing device in response to determining that the voice purchase command is valid.

19. The system of claim 18 , wherein the voice signature comprises one or more of a passphrase or physical quality of the voice associated with the computing device.

20. The system of claim 15 , comprising:

conducting, via the computing device, a transaction with a merchant computing system to purchase the product associated with the transmitted offer.

Assignments (2)
CHANGE OF NAME Recorded May 31, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 063805/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2021
From: VERLEY, FILIP; HOBBIE, STUART ROSS
To: GOOGLE INC.
Reel/Frame 057049/0363 →
Continuity (2)
Continuation 14621365 · Feb 12, 2015
Related Publication 20210358014A1 · Nov 18, 2021