IP Library Granted Patent US 10,885,560
Granted Patent B1
US 10,885,560 · App. 15/833,902 · Granted Jan 5, 2021

Systems and methods for annotating online content with offline interaction data

Inventors: Vinod Kumar Ramachandran (Mountain View, CA); Surojit Chatterjee (Los Altos, CA); Philip McDonnell (Belmont, CA)
Assignee: Google LLC
G06Q30/0277G06Q30/0242G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,885,560
App. No.
15/833,902
Granted
Jan 5, 2021
Kind
B1
Abstract

A computer-implemented method for annotating online content with offline interaction data and offline interaction conversion data is implemented by a content annotating computing device in communication with a memory. The method includes receiving a set of content interaction data based on an online interaction between an online user and a first online content item, identifying at least one physical location associated with the online content provider, determining a set of offline interaction conversion data based on the set of content interaction data and a set of offline interaction data, receiving a second online content item associated with the online content provider, and annotating the second online content item based at least partially on the set of offline interaction conversion data and the set of offline interaction data.

Claims (69)

1. A system to annotate content items, comprising:

an interface and a content annotation system executed by one or more processors to:

receive offline interaction data comprising a first identifier and an indication of an interaction between a merchant computing device located at a physical location of a merchant and one or more user computing devices associated with an online user;

receive an audio-based input detected by a microphone of the one or more user computing devices associated with the online user and a second identifier corresponding to the online user providing the audio-based input;

identify, responsive to receipt of the audio-based input, a request in the audio-based input;

select a first content item based on the request identified in the audio-based input;

compare the second identifier of the online user that provided the audio-based input with the first identifier corresponding to the interaction with the merchant computing device to determine that the audio-based input and the interaction are associated with a same online user;

generate, responsive to the determination that the audio-based input detected by the one or more user computing devices and the interaction with the merchant computing device are associated with the same online user, an annotation based on the offline interaction data comprising the indication of the interaction between the merchant computing device located at the physical location of the merchant and the one or more user computing devices;

annotate the first content item to include the annotation; and

transmit, responsive to the audio-based input, the first content item with the annotation to the one or more user computing devices.

2. The system of claim 1 , comprising:

the interface to transmit, to a second client computing device, a second content item, the second content item corresponding to the physical location of the merchant;

the interface to receive online interaction data indicating an interaction between the second client computing device and the second content item; and

the content annotation system to generate the annotation based on the online interaction data.

3. The system of claim 1 , comprising:

the interface to transmit, to a second client computing device, a second content item, the second content item corresponding to the physical location of the merchant;

the interface to receive online interaction data indicating an interaction between the second client computing device and the second content item;

the content annotation system to generate a second annotation based on the online interaction data; and

the content annotation system to include the second annotation in the content item.

4. The system of claim 1 , comprising:

the content annotation system to select the first content item based on the physical location of the merchant.

5. The system of claim 1 , wherein the interaction between the merchant computing device located at the physical location of the merchant and the one or more user computing devices indicates that the one or more user computing devices was present at the physical location of the merchant.

6. The system of claim 1 , wherein the offline interaction data comprises an indication of an interaction between a plurality of computing devices located at a plurality of physical locations and a plurality of client computing devices.

7. The system of claim 6 , wherein each of the plurality of physical locations corresponds to the physical location of the merchant.

8. The system of claim 1 , comprising:

the content annotation system to identify a plurality of demographic characteristics associated with the physical location of the merchant; and

the content annotation system to scale the offline interaction data based on the plurality of demographic characteristics.

9. The system of claim 1 , wherein the annotation comprises a portion of the offline interaction data.

10. The system of claim 1 , comprising:

the interface to receive a second audio-based input detected by the microphone of the one or more user computing devices;

the content annotation system to identify a second request in the second audio-based input;

the content annotation system to select a second content item based on the second request identified in the second audio-based input;

the content annotation system to generate a second annotation based on received online interaction data indicating an interaction between a plurality of client computing devices and a plurality of content items;

the content annotation system to annotate the second content item to include the generated second annotation; and

the interface to transmit the second content item comprising the second annotation to the one or more user computing devices.

11. A method to annotate content items, comprising:

receiving, by a content annotating computing device, offline interaction data comprising a first identifier and an indication of an interaction between a merchant computing device located at a physical location of a merchant and one or more user computing devices associated with an online user;

receiving, by the content annotating computing device, an audio-based input detected by a microphone of the one or more user computing devices associated with the online user and a second identifier corresponding to the online user providing the audio-based input;

identifying, by the content annotating computing device responsive to receipt of the audio-based input, a request in the audio-based input;

selecting, by the content annotating computing device, a first content item based on the request identified in the audio-based input;

comparing, by the content annotating computing device, the second identifier of the online user that provided the audio-based input with the first identifier corresponding to the interaction with the merchant computing device to determine that the audio-based input and the interaction are associated with a same online user;

generating, by the content annotating computing device responsive to the determination that the audio-based input detected by the one or more user computing devices and the interaction with the merchant computing device are associated with the same online user, an annotation based on the offline interaction data comprising the indication of the interaction between the merchant computing device located at the physical location of the merchant and the one or more user computing devices;

annotating, by the content annotating computing device and responsive to generating the annotation, the first content item to include the annotation; and

transmitting, by the content annotating computing device, the first content item annotated to include the annotation to the one or more user computing devices responsive to receiving the audio-based input.

12. The method of claim 11 , comprising:

transmitting, to a second client computing device, a second content item, the second content item corresponding to the physical location of the merchant;

receiving online interaction data indicating an interaction between the second client computing device and the second content item; and

generating the annotation based on the online interaction data.

13. The method of claim 11 , comprising:

transmitting, to a second client computing device, a second content item, the second content item corresponding to the physical location of the merchant;

receiving online interaction data indicating an interaction between the second client computing device and the second content item;

generating a second annotation based on the online interaction data; and

annotating the content item to include the second annotation.

14. The method of claim 11 , comprising:

selecting the first content item based on the physical location of the merchant.

15. The method of claim 11 , wherein the interaction between the merchant computing device located at the physical location of the merchant and the one or more user computing devices indicates that the one or more user computing devices was present at the physical location of the merchant.

16. The method of claim 11 , wherein the offline interaction data comprises an indication of an interaction between a plurality of computing devices located at a plurality of physical locations and a plurality of client computing devices.

17. The method of claim 16 , wherein each of the plurality of physical locations corresponds to the physical location.

18. The method of claim 11 , comprising:

identifying a plurality of demographic characteristics associated with the physical location of the merchant; and

scaling the offline interaction data based on the plurality of demographic characteristics.

19. The method of claim 11 , wherein the annotation comprises a portion of the offline interaction data.

20. The method of claim 11 , comprising:

receiving a second audio-based input detected by the microphone of the one or more user computing devices;

identifying a second request in the second audio-based input;

selecting a second content item based on the second request identified in the second audio-based input;

generating a second annotation based on received online interaction data indicating an interaction between a plurality of client computing devices and a plurality of content items;

annotating, responsive to generating the annotation, the second content item to include the generated second annotation; and

transmitting the second content item comprising the second annotation to the one or more user computing devices.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2018
From: RAMACHANDRAN, VINOD KUMAR; CHATTERJEE, SUROJIT; MCDONNELL, PHILIP
To: GOOGLE INC.
Reel/Frame 044794/0540 →
CHANGE OF NAME Recorded Feb 1, 2018
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 045215/0023 →
Continuity (1)
Continuation 14505612 · Oct 3, 2014