IP Library Granted Patent US 10,528,982
Granted Patent B2
US 10,528,982 · App. 14/485,528 · Granted Jan 7, 2020

Determining a prompt for performing an action presented to a user in association with video data

Inventors: Fidji Nahema Simo (Palo Alto, CA); Asad K. Awan (San Francisco, CA); David Tin Ho Shih (San Francisco, CA)
Assignee: Facebook, Inc.
G06Q30/0269
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,528,982
App. No.
14/485,528
Granted
Jan 7, 2020
Kind
B2
Abstract

An online system provides an advertisement (“ad”) request including ad content and a prompt to perform an action presented in association with the ad content. For example, the ad content is video data and the prompt for performing an action is presented after the video data is presented or after a portion of the video data is presented. An advertiser may include a custom prompt in the ad request that includes text information and instructions associated with the text information that perform an action when executed. Multiple prompts may be included in the ad request, and the online system selects a prompt based on information maintained by the online system and associated with a user to be presented with the ad content. The selected prompt is communicated to a client device for presentation in association with the ad content.

Claims (71)

1. A method comprising:

receiving, at a server of an online system, a first advertisement and a second related advertisement from an advertiser organized in a sequence where the first advertisement precedes the second related advertisement, wherein each of the first and the second related advertisements includes different advertisement video data, a set of objects included in the advertisement video data, targeting criteria, and a set of prompts for performing a set of actions, each of the set of prompts comprising text data describing one of the set of actions and a network address for performing an action associated with the text data;

identifying, at the server of the online system, a user of the online system eligible to be presented with the first advertisement, the user associated with at least a threshold number of characteristics satisfying the targeting criteria included with the first advertisement;

selecting, by the server of the online system, a first prompt for performing an action from the set of prompts for performing actions of the first advertisement, wherein each prompt of the set of prompts corresponds to a different object in the set of objects, and the first prompt is selected for the user based on a relevance score between the characteristics of the user and the object in the set of objects corresponding to the first prompt;

identifying, by the server of the online system, a set of frames within the advertisement video data of the first advertisement that include the object that corresponds to the selected prompt by applying an object recognition algorithm to the advertisement video data of the first advertisement;

sending, by the server of the online system, the advertisement video data of the first advertisement to a client device of the identified user for display on a user interface of the client device, wherein the selected prompt is overlaid upon the identified set of frames that include the object such that a portion of each frame in the identified set of frames presents the prompt;

determining, by the server of the online system, that the user is eligible to be presented with an additional advertisement;

determining, by the server of the online system, that the user has been presented the advertisement video data of the first advertisement;

determining, by the server of the online system, that the user shall be presented advertisement video data of the second related advertisement, based on the received sequence and the determination that the user has been presented the advertisement video data of the first advertisement;

selecting, by the server of the online system, a second prompt for performing an action from the set of prompts for performing actions of the second related advertisement, wherein the second prompt is different from the first prompt; and

sending, by the server of the online system, the advertisement video data of the second related advertisement to the client device for display on the user interface, wherein the selected second prompt is overlaid upon the advertisement video data of the second related advertisement.

2. The method of claim 1 , further comprising:

storing information associated with the identified user indicating that the advertisement video data associated with the advertisement was presented to the user, the information indicating that the user is eligible to be presented with advertisement video data from an additional advertisement from the set of advertisements, the additional advertisement having a later position in the sequence than the advertisement.

3. The method of claim 1 , wherein the selected prompt for performing the action is presented to the user after a portion of the advertisement video data is presented.

4. The method of claim 1 , wherein selecting the prompt for performing the action based at least in part on the determined relevance scores comprises: selecting a prompt for performing the action having a maximum relevance score.

5. The method of claim 1 , wherein selecting the prompt for performing the action based at least in part on the determined relevance scores comprises:

ranking the set of prompts for performing actions based at least in part on the determined relevance scores; and

selecting a prompt for performing an action having at least a threshold position in the ranking.

6. The method of claim 1 , wherein determining the relevance score for each prompt from the set of prompts comprises:

retrieving characteristics of the advertisement video data included in the advertisement; and

determining the relevance score for each prompt from the set of prompts based at least in part on the characteristics of the user and the retrieved characteristics of the advertisement video data.

7. A non-transitory, computer program product comprising a computer-readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to:

receive, at a server of an online system, a first advertisement and a second related advertisement from an advertiser organized in a sequence where the first advertisement precedes the second related advertisement, wherein each of the first and second related advertisements includes different advertisement video data, a set of objects included in the advertisement video data, targeting criteria, and a set of prompts for performing a set of actions, each of the set of prompts comprising text data describing one of the set of actions and a network address for performing an action associated with the text data;

identify, at the server of the online system, a user of the online system eligible to be presented with the first advertisement, the user associated with at least a threshold number of characteristics satisfying the targeting criteria included with the first advertisement;

select, by the server of the online system, a first prompt for performing an action from the set of prompts for performing actions of the first advertisement, wherein each prompt of the set of prompts corresponds to a different object in the set of objects, and the first prompt is selected for the user based on a relevance score between the characteristics of the user and the object in the set of objects corresponding to the first prompt;

identify, by the server of the online system, a set of frames within the advertisement video data of the first advertisement that include the object that corresponds to the selected prompt by applying an object recognition algorithm to the advertisement video data of the first advertisement;

send, by the server of the online system, the advertisement video data of the first advertisement to a client device of the identified user for display on a user interface of the client device, wherein the selected prompt is overlaid upon the identified set of frames that include the object such that a portion of each frame in the identified set of frames presents the prompt;

determine, by the server of the online system, that the user is eligible to be presented with an additional advertisement;

determine, by the server of the online system, that the user has been presented the advertisement video data of the first advertisement;

determine, by the server of the online system, that the user shall be presented advertisement video data of the second related advertisement, based on the received sequence and the determination that the user has been presented the advertisement video data of the first advertisement;

select, by the server of the online system, a second prompt for performing an action from the set of prompts for performing actions of the second related advertisement, wherein the second prompt is different from the first prompt; and

send, by the server of the online system, the advertisement video data of the second related advertisement to the client device for display on the user interface, wherein the selected second prompt is overlaid upon the advertisement video data of the second related advertisement.

8. The computer program product of claim 7 , wherein the computer-readable storage medium further has instructions encoded thereon that, when executed by the processor, cause the processor to:

store information associated with the identified user indicating that the advertisement video data associated with the advertisement was presented to the user, the information indicating that the user is eligible to be presented with advertisement video data from an additional advertisement from the set of advertisements, the additional advertisement having a later position in the sequence than the advertisement.

9. The computer program product of claim 7 , wherein the selected prompt for performing the action is presented to the user after a portion of the advertisement video data is presented.

10. The computer program product of claim 7 , wherein select the prompt for performing the action based at least in part on the determined relevance scores comprises:

select a prompt for performing the action having a maximum relevance score.

11. The computer program product of claim 7 , wherein select the prompt for performing the action based at least in part on the determined relevance scores comprises:

rank the set of prompts for performing actions based at least in part on the determined relevance scores; and

select a prompt for performing an action having at least a threshold position in the ranking.

12. The computer program product of claim 7 , wherein determine the relevance score for each prompt from the set of prompts comprises:

retrieve characteristics of the advertisement video data included in the advertisement; and

determine the relevance score for each prompt from the set of prompts based at least in part on the characteristics of the user and the retrieved characteristics of the advertisement video data.

13. The method of claim 1 , further comprising:

identifying, at the server of the online system, a second user of the online system eligible to be presented with the advertisement;

selecting, by the server of the online system, a second prompt for performing an action from the set of prompts for performing actions, wherein the second prompt is selected for the second user based on a second relevance score between the characteristics of the second user and a second object in the set of objects corresponding to the second prompt, wherein the second object is different from the object in the set of objects corresponding to the prompt;

identifying, by the server of the online system, a second set of frames within the advertisement video data that include the second object that corresponds to the selected second prompt by applying an object recognition algorithm to the advertisement video data; and

sending, by the server of the online system, the advertisement video data to a second client device of the identified second user for display on a user interface of the second client device, wherein the selected second prompt is overlaid upon the identified second set of frames that include the second object such that a portion of each frame in the identified second set of frames presents the second prompt.

14. The non-transitory computer program product of claim 7 , further comprising:

identify, at the server of the online system, a second user of the online system eligible to be presented with the advertisement;

select, by the server of the online system, a second prompt for performing an action from the set of prompts for performing actions, wherein the second prompt is selected for the second user based on a second relevance score between the characteristics of the second user and a second object in the set of objects corresponding to the second prompt, wherein the second object is different from the object in the set of objects corresponding to the prompt;

identify, by the server of the online system, a second set of frames within the advertisement video data that include the second object that corresponds to the selected second prompt by applying an object recognition algorithm to the advertisement video data; and

send, by the server of the online system, the advertisement video data to a second client device of the identified second user for display on a user interface of the second client device, wherein the selected second prompt is overlaid upon the identified second set of frames that include the second object such that a portion of each frame in the identified second set of frames presents the second prompt.

15. A system, comprising:

a processor for executing computer program instructions; and

a non-transitory computer-readable storage medium storing computer program instructions executable by the processor to perform operations comprising:

receiving, at a server of an online system, a first advertisement and a second related advertisement from an advertiser organized in a sequence where the first advertisement precedes the second related advertisement, wherein each of the first and second related advertisements includes different advertisement video data, a set of objects included in the advertisement video data, targeting criteria, and a set of prompts for performing a set of actions, each of the set of prompts comprising text data describing one of the set of actions and a network address for performing an action associated with the text data;

identifying, at the server of the online system, a user of the online system eligible to be presented with the first advertisement, the user associated with at least a threshold number of characteristics satisfying the targeting criteria included with the first advertisement;

selecting, by the server of the online system, a first prompt for performing an action from the set of prompts for performing actions of the first advertisement, wherein each prompt of the set of prompts corresponds to a different object in the set of objects, and the first prompt is selected for the user based on a relevance score between the characteristics of the user and the object in the set of objects corresponding to the first prompt;

identifying, by the server of the online system, a set of frames within the advertisement video data of the first advertisement that include the object that corresponds to the selected prompt by applying an object recognition algorithm to the advertisement video data of the first advertisement;

sending, by the server of the online system, the advertisement video data of the first advertisement to a client device of the identified user for display on a user interface of the client device, wherein the selected prompt is overlaid upon the identified set of frames that include the object such that a portion of each frame in the identified set of frames presents the prompt;

determining, by the server of the online system, that the user is eligible to be presented with an additional advertisement;

determining, by the server of the online system, that the user has been presented the advertisement video data of the first advertisement;

determining, by the server of the online system, that the user shall be presented advertisement video data of the second related advertisement, based on the received sequence and the determination that the user has been presented the advertisement video data of the first advertisement;

selecting, by the server of the online system, a second prompt for performing an action from the set of prompts for performing actions of the second related advertisement, wherein the second prompt is different from the first prompt; and

sending, by the server of the online system, the advertisement video data of the second related advertisement to the client device for display on the user interface, wherein the selected second prompt is overlaid upon the advertisement video data of the second related advertisement.

16. The system of claim 15 , the operations further comprising:

identifying, at the server of the online system, a second user of the online system eligible to be presented with the advertisement;

selecting, by the server of the online system, a second prompt for performing an action from the set of prompts for performing actions, wherein the second prompt is selected for the second user based on a second relevance score between the characteristics of the second user and a second object in the set of objects corresponding to the second prompt, wherein the second object is different from the object in the set of objects corresponding to the prompt;

identifying, by the server of the online system, a second set of frames within the advertisement video data that include the second object that corresponds to the selected second prompt by applying an object recognition algorithm to the advertisement video data; and

sending, by the server of the online system, the advertisement video data to a second client device of the identified second user for display on a user interface of the second client device, wherein the selected second prompt is overlaid upon the identified second set of frames that include the second object such that a portion of each frame in the identified second set of frames presents the second prompt.

Assignments (2)
CHANGE OF NAME Recorded Nov 18, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058897/0824 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2015
From: SIMO, FIDJI NAHEMA; AWAN, ASAD K.; SHIH, DAVID TIN HO
To: FACEBOOK, INC.
Reel/Frame 035570/0259 →