Granted Patent B2

US 12,367,521 · App. 18/452,281 · Granted Jul 22, 2025

Inventors: Filip Verley, IV (Mountain View, CA); Stuart Ross Hobbie (Mountain View, CA)

Assignee: GOOGLE LLC

G06Q30/0633G06Q20/40145G10L17/22

Abstract

Claims (53)

1. A computer-implemented method to identify products based on contexts of user input, comprising:

by an account management computing system:

receiving, from a computing device, user input data detected by a sensor of the computing device at a first time;

identifying purchase command context data comprising one or more of operating state data and one or more input data by comparing the operating state data and the one or more input data to the user input data;

identifying, based on the purchase command context data, an annotated media file comprising one or more product annotations that identifies one or more products and one or more times at which the one or more products are presented within the annotated media file;

identifying, from the one or more product annotations, a product corresponding to a particular product annotation based on comparing the one or more product annotations and the purchase command context data;

transmitting an offer associated with the identified product to the computing device to display on the computing device; and

receiving, from the computing device, the one or more operating state data describing an internal operating state of the computing device during a first predefined time period prior to the first time, the internal operating state identifying content received from a server different from the account management computing system via a network that is displayed via a display device of the computing device or an internet address of a website accessed by the computing device.

2. The method of claim 1 , wherein the user input comprises a voice purchase command.

3. The method of claim 2 , comprising, by the account management computing system:

in response to receiving the voice purchase command, retrieving a voice signature associated with the computing device; and

determining that the voice purchase command is valid based on the voice signature, wherein the offer is transmitted to the computing device in response to determining that the voice purchase command is valid.

4. The method of claim 3 , wherein the voice signature comprises one or more of a passphrase or physical quality that is unique to a voice.

5. The method of claim 1 , comprising:

receiving, from the computing device, one or more input data comprising one or more of a sound input and a video input captured by the computing device at a second time during a second predefined time period that begins prior to the first time.

6. The method of claim 5 , wherein the second time after the first time, the one or more input data different from the content received from the server.

7. The method of claim 5 , comprising:

the one or more input data received from a source different from the account management computing system.

8. The method of claim 1 , wherein the one or more operating state data further comprises display data, the display data comprising one or more of a video, an audio file, a text file, a webpage, or an application displayed on the computing device.

9. The method of claim 1 , comprising:

retrieving, by the account management computing system, one or more stored product annotations from the annotated media file based on the identified purchase command context data.

10. The method of claim 1 , comprising:

conducting, via the computing device, a transaction with a merchant computing system to purchase the identified product associated with the transmitted offer.

11. A computer program product to identify products based on contexts of commands, comprising:

a non-transitory computer-readable medium having computer-readable program instructions embodied thereon that when executed by a computer cause the computer to:

receive, from a computing device, user input data detected by a sensor of the computing device at a first time;

identify purchase command context data comprising one or more of operating state data and one or more input data by comparing the operating state data and the one or more input data to the user input data;

identify, based on the purchase command context data, an annotated media file comprising one or more product annotations that identifies one or more products and one or more times at which the one or more products are presented within the annotated media file;

identify, from the one or more product annotations, a product corresponding to a particular product annotation based on comparing the one or more product annotations and the purchase command context data;

transmit an offer associated with the identified product to the computing device to display on the computing device; and

receiving, from the computing device, the one or more operating state data describing an internal operating state of the computing device during a first predefined time period prior to the first time, the internal operating state identifying content received from a server different from an account management computing system via a network that is displayed via a display device of the computing device or an internet address of a website accessed by the computing device.

12. The computer program product of claim 11 , the non-transitory computer-readable medium further having computer-readable program instructions embodied thereon that when executed by the computer cause the computer to:

receive, from the computing device, the one or more input data comprising one or more of a sound input and a video input captured by the computing device during a second predefined time period prior to the first time, wherein identifying the purchase command context data further comprises comparing the received one or more operating state data and the received one or more input data to the purchase command, the purchase command context data further comprising the one or more input data.

13. The computer program product of claim 11 , comprising:

conducting, via the computing device, a transaction with a merchant computing system to purchase the identified product associated with the transmitted offer.

14. A system to identify products based on contexts of commands, comprising:

a storage device; and

a processor communicatively coupled to the storage device, wherein the processor executes application code instructions that are stored in the storage device to cause the system to:

receive, from a computing device, user input data detected by a sensor of the computing device at a first time;

identify purchase command context data comprising one or more of operating state data and one or more input data by comparing the operating state data and the one or more input data to the user input data;

identify, based on the purchase command context data, an annotated media file comprising one or more product annotations that identifies one or more products and one or more times at which the one or more products are presented within the annotated media file;

identify, from the one or more product annotations, a product corresponding to a particular product annotation based on comparing the one or more product annotations and the purchase command context data;

transmit an offer associated with the identified product to the computing device to display on the computing device; and

receiving, from the computing device, the one or more operating state data describing an internal operating state of the computing device during a first predefined time period prior to the first time, the internal operating state identifying content received from a server different from an account management computing system via a network that is displayed via a display device of the computing device or an internet address of a website accessed by the computing device.

15. The system of claim 14 , wherein the processor is further configured to execute computer-readable program instructions stored in the storage device to cause the system to:

receive, from the computing device, one or more operating state data describing an operating state of the computing device within a second predefined time period prior to the first time, wherein identifying the purchase command context data further comprises comparing the received one or more operating state data and the received one or more input data against the purchase command to identify the purchase command context data, the purchase command context data further comprising one or more of the operating state data.

16. The system of claim 14 , wherein the one or more operating state data comprises one or more of a video, an audio file, a text file, a webpage, or an application displayed on the computing device.

17. The system of claim 14 , wherein the processor is further configured to execute computer-readable program instructions stored in the storage device to cause the system to:

in response to receiving the user input data, retrieve a signature associated with the computing device; and

determine that the user input data is valid based on the signature, wherein the offer is transmitted to the computing device in response to determining that the user input data is valid.

18. The system of claim 17 , wherein the signature comprises one or more of a passphrase or physical quality of the associated with the computing device.

19. The system of claim 14 , comprising:

conducting, via the computing device, a transaction with a merchant computing system to purchase the product associated with the transmitted offer.

Assignments (2)

Continuity (3)

References Cited (25)