IP Library Granted Patent US 11,734,729
Granted Patent B2
US 11,734,729 · App. 17/119,264 · Granted Aug 22, 2023

Systems and methods for annotating online content with offline interaction data

Inventors: Vinod Kumar Ramachandran (Mountain View, CA); Surojit Chatterjee (Los Altos, CA); Philip McDonnell (Belmont, CA)
Assignee: GOOGLE LLC
G06Q30/0277G06Q30/0242G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,734,729
App. No.
17/119,264
Granted
Aug 22, 2023
Kind
B2
Abstract

A computer-implemented method for annotating online content with offline interaction data and offline interaction conversion data is implemented by a content annotating computing device in communication with a memory. The method includes receiving a set of content interaction data based on an online interaction between an online user and a first online content item, identifying at least one physical location associated with the online content provider, determining a set of offline interaction conversion data based on the set of content interaction data and a set of offline interaction data, receiving a second online content item associated with the online content provider, and annotating the second online content item based at least partially on the set of offline interaction conversion data and the set of offline interaction data.

Claims (63)

1. A system, comprising:

memory and one or more processors to:

receive offline interaction data comprising a first identifier and an indication of an interaction between a merchant computing device located at a physical location of a merchant and a first computing device associated with an online user;

receive a first audio-based input detected by a microphone of the first computing device and a second identifier corresponding to the online user providing the first audio-based input;

receive a second audio-based input detected by a microphone of a second computing device:

identify, responsive to receipt of the first audio-based input, a first request in the first audio-based input;

identify a second request in the second audio-based input;

compare the second identifier with the first identifier to determine that the first audio-based input and the interaction are associated with the online user;

identify, responsive to the determination that the first audio-based input and the interaction are associated with the online user, a first content item based on the first request and the offline interaction data;

select a second content item based on the second request;

generate an annotation based on received online interaction data; and

transmit, responsive to the first audio-based input, the first content item to the first computing device and the second content item with the annotation to the second computing device.

2. The system of claim 1 , comprising the one or more processors to:

select the first content item based on the first request; and

modify the first content item based on the offline interaction data.

3. The system of claim 1 , comprising:

the one or more processors to provide, with the first content item, an indication based on the offline interaction data.

4. The system of claim 1 , comprising the one or more processors to:

generate, based on the offline interaction data, an annotation; and

annotate the first content item with the annotation prior to transmission to the one or more user computing devices.

5. The system of claim 1 , comprising the one or more processors to:

transmit, to a second client computing device, a second content item, the second content item corresponding to the physical location;

receive online interaction data indicating an interaction between the second client computing device and the second content item; and

generate an annotation based on the online interaction data.

6. The system of claim 1 , comprising the one or more processors to:

transmit, to a second client computing device, a second content item, the second content item corresponding to the physical location;

receive online interaction data indicating an interaction between the second client computing device and the second content item; and

identify the first content item with an indication based on the online interaction data.

7. The system of claim 1 , comprising:

the one or more processors to select the first content item based on the physical location.

8. The system of claim 1 , wherein the interaction between a first computing device located at the physical location and the first computing device indicates that the first computing device was present at the physical location.

9. The system of claim 1 , wherein the offline interaction data comprises an indication of an interaction between a plurality of computing devices located at a plurality of physical locations and a plurality of client computing devices.

10. A method, comprising:

receiving, by one or more processors, offline interaction data comprising a first identifier and an indication of an interaction between a merchant computing device located at a physical location of a merchant and a first computing device associated with an online user;

receiving a first audio-based input detected by a microphone of the first computing device and a second identifier corresponding to the online user providing the first audio-based input;

receiving a second audio-based input detected by a microphone of a second computing device:

identifying responsive to receipt of the first audio-based input, a first request in the first audio-based input;

identifying a second request in the second audio-based input;

comparing the second identifier with the first identifier to determine that the first audio-based input and the interaction are associated with the online user;

identifying responsive to the determination that the first audio-based input and the interaction are associated with the online user, a first content item based on the first request and the offline interaction data;

selecting a second content item based on the second request;

generating an annotation based on received online interaction data; and

transmitting, by the one or more processors, responsive to the first audio-based input, the first content item to the first computing device and the second content item with the annotation to the second computing device.

11. The method of claim 10 , comprising:

selecting, by the one or more processors, the first content item based on the first request; and

modifying, by the one or more processors, the first content item based on the offline interaction data.

12. The method of claim 10 , comprising:

providing, by the one or more processors, with the first content item, an indication based on the offline interaction data.

13. The method of claim 10 , comprising:

generating, by the one or more processors, based on the offline interaction data, an annotation; and

annotating, by the one or more processors, the first content item with the annotation prior to transmission to the one or more user computing devices.

14. The method of claim 10 , comprising:

transmitting, by the one or more processors, to a second client computing device, a second content item, the second content item corresponding to the physical location;

receiving, by the one or more processors, online interaction data indicating an interaction between the second client computing device and the second content item; and

generating, by the one or more processors, an annotation based on the online interaction data.

15. The method of claim 10 , comprising:

transmitting, by the one or more processors, to a second client computing device, a second content item, the second content item corresponding to the physical location;

receiving, by the one or more processors, online interaction data indicating an interaction between the second client computing device and the second content item; and

identifying, by the one or more processors, the first content item with an indication based on the online interaction data.

16. The method of claim 10 , comprising:

selecting, by the one or more processors, the first content item based on the physical location.

17. The method of claim 10 , wherein the interaction between a first computing device located at the physical location and the first computing device indicates that the first computing device was present at the physical location.

18. The method of claim 10 , wherein the offline interaction data comprises an indication of an interaction between a plurality of computing devices located at a plurality of physical locations and a plurality of client computing devices.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2020
From: RAMACHANDRAN, VINOD KUMAR; CHATTERJEE, SUROJIT; MCDONNELL, PHILIP
To: GOOGLE INC.
Reel/Frame 054619/0620 →
CHANGE OF NAME Recorded Dec 11, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 054709/0001 →
Continuity (3)
Continuation 15833902 · Dec 6, 2017
Continuation 14505612 · Oct 3, 2014
Related Publication 20210097583A1 · Apr 1, 2021