IP Library Granted Patent US 12,493,898
Granted Patent B2
US 12,493,898 · App. 17/566,035 · Granted Dec 9, 2025

System and method for thin explore/exploit layer for providing additional degree of freedom in recommendations

Inventors: Oren Shlomo Somekh (Cfar-Neter, IL); Alex Shtoff (Haifa, IL); Avi Shahar (Ramat-Gan, IL); Tomer Shadi (New York, NY); Yair Koren (Haifa, IL); Anna Itzhaki (New York, NY); Yohay Kaplan (Haifa, IL); Tal Cohen (Ramat-Gan, IL); Boris Trayvas (New York, NY)
Assignee: YAHOO AD TECH LLC
G06Q30/0255G06Q30/0246G06Q30/0275G06Q30/0276G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,493,898
App. No.
17/566,035
Granted
Dec 9, 2025
Kind
B2
Abstract

The present teaching relates to displaying ads. An explore/exploit layer (EEL) is provided at frontend ad serving engine for storing combination distributions with respect to multiple ads. Each ad has multiple attributes. Each attribute can be instantiated using one of multiple assets. The frontend ad serving engine requests a recommended ad for bidding an ad display opportunity in a slot of a webpage viewed by a user on a user device. The recommended ad is one of the multiple ads. When the auction is successful, a combination of assets for the ad is drawn from the combination distributions in EEL and each of the assets instantiates a corresponding attribute of the ad. The combination is transmitted to the user device to render the ad.

Claims (108)

1 . A method implemented on at least one processor, a memory, and a communication platform for displaying ads, comprising:

receiving, at an explore/exploit layer (EEL) associated with one of a plurality of frontend ad serving engines, from an ad recommendation backend server, and based on a selection criteria configuration that maps each of subsets of combination distributions with respect to a plurality of ads to a corresponding one of the plurality of frontend ad serving engines, one of the subsets of combination distributions,

wherein each of the plurality of ads has a plurality of attributes, each of the plurality of attributes is associated with multiple assets, and each of the multiple assets can be used for rendering the attribute,

wherein different subsets of the combination distributions are received by different ones of the plurality of frontend ad serving engines, and

wherein each of the combination distributions represents a probability for each of a plurality of different combinations of assets being selected by users sharing one or more common characteristics;

sending, by the frontend ad serving engine to the ad recommendation backend server, a request for a recommendation of an ad to be used for bidding an ad display opportunity in a slot of a webpage viewed by a user on a user device;

receiving, at the frontend ad serving engine from the ad recommendation backend server, an ad recommended based on a display environment related to the user and the webpage, wherein the ad recommended is one of the plurality of ads;

upon a successful auction of the ad,

obtaining, by the frontend ad serving engine, a segment key representing a combination of a feature of the user and a feature of the user device, and

determining, by the frontend ad serving engine, whether combination distributions for the ad are available in the EEL;

in response to a determination that the combination distributions for the ad are available in the EEL, drawing, by the frontend ad serving engine, directly from the EEL without communicating with the ad recommendation backend server, a combination from the plurality of combinations based on the segment key and the combination distribution associated with the ad in the EEL; and

transmitting, by the frontend ad serving engine to the user device, the combination to render the ad to the user in the slot of the webpage on the user device.

2 . The method of claim 1 , wherein the plurality of attributes of each of the plurality of ads include at least some of:

a title of the ad;

an image that visually conveys information about the ad; and

a description that textually summarizes content of the ad, wherein

any of the multiple assets associated with each of the plurality of attributes of the ad can be used to render the attribute, and

the combination includes a plurality of assets, each for one of the plurality of attributes of the ad and is drawn to maximize a return of displaying the ad according to a predetermined criterion.

3 . The method of claim 2 , wherein the predetermined criterion includes:

a click through rate (CTR); or

a conversion rate (CVR).

4 . The method of claim 1 , wherein combination distributions associated with each of the plurality ads provide different ways to render the ad, wherein each combination in the combination distributions

represents one way to render the ad with respect to the display environment; and

is provided with an indication of a likelihood to be drawn to render the ad;

wherein the indication of the likelihood is determined based on a predicted performance of the combination in the display environment estimated by a prediction model; and

wherein the prediction model is obtained via machine learning based on training data to maximize a return of the ad according to a predetermined criterion.

5 . The method of claim 4 , wherein

the indication of the likelihood corresponds to a probability;

combinations related to an ad in the plurality of ads under each display environment form a distribution with the probabilities associated therewith adding up to one; and

the step of drawing is performed in accordance with the distributed probabilities for the combinations.

6 . The method of claim 1 , wherein the display environment is characterized based on information related to at least one of:

the user;

the user device;

the slot for displaying an ad;

the webpage where the slot resides; and

a traffic segment associated with the display environment.

7 . The method of claim 1 , wherein the combination distributions stored in the EEL are regularly updated so that the combination is drawn from the updated combination distributions in the EEL to maximize a return of displaying the ad in the display environment in a manner adapted to a change in the marketplace.

8 . Machine readable and non-transitory medium having information recorded thereon for displaying ads, wherein the information, once read by the machine, causes the machine to perform the following steps:

receiving, at an explore/exploit layer (EEL) associated with one of a plurality of frontend ad serving engines, an ad recommendation backend server, and based on a selection criteria configuration that maps each of subsets of combination distributions with respect to a plurality of ads to a corresponding one of the plurality of frontend ad serving engines, one of the subsets of combination distributions,

wherein each of the plurality of ads has a plurality of attributes, each of the plurality of attributes is associated with multiple assets, and each of the multiple assets can be used for rendering the attribute,

wherein different subsets of the combination distributions are received by different ones of the plurality of frontend ad serving engines, and

wherein each of the combination distributions represents a probability for each of a plurality of different combinations of assets being selected by users sharing one or more common characteristics;

sending, by the frontend ad serving engine to the ad recommendation backend server, a request for a recommendation of an ad to be used for bidding an ad display opportunity in a slot of a webpage viewed by a user on a user device;

receiving, at the frontend ad serving engine from the ad recommendation backend server, an ad recommended based on a display environment related to the user and the webpage, wherein the ad recommended is one of the plurality of ads;

upon a successful auction of the ad,

obtaining, by the frontend ad serving engine, a segment key representing a combination of a feature of the user and a feature of the user device, and

determining, by the frontend ad serving engine, whether combination distributions for the ad are available in the EEL;

in response to a determination that the combination distributions for the ad are available in the EEL, drawing, by the frontend ad serving engine, directly from the EEL without communicating with the ad recommendation backend server, a combination from the plurality of combinations based on the segment key and the combination distribution associated with the ad in the EEL; and

transmitting, by the frontend ad serving engine to the user device, the combination to render the ad to the user in the slot of the webpage on the user device.

9 . The medium of claim 8 , wherein the plurality of attributes of each of the plurality of ads include at least some of:

a title of the ad;

an image that visually conveys information about the ad; and

a description that textually summarizes content of the ad, wherein

any of the multiple assets associated with each of the plurality of attributes of the ad can be used to render the attribute, and

the combination includes a plurality of assets, each for one of the plurality of attributes of the ad and is drawn to maximize a return of displaying the ad according to a predetermined criterion.

10 . The medium of claim 9 , wherein the predetermined criterion includes:

a click through rate (CTR); or

a conversion rate (CVR).

11 . The medium of claim 8 , wherein combination distributions associated with each of the plurality ads provide different ways to render the ad, wherein each combination in the combination distributions

represents one way to render the ad with respect to the display environment; and

is provided with an indication of a likelihood to be drawn to render the ad;

wherein the indication of the likelihood is determined based on a predicted performance of the combination in the display environment estimated by a prediction model; and

wherein the prediction model is obtained via machine learning based on training data to maximize a return of the ad according to a predetermined criterion.

12 . The medium of claim 11 , wherein

the indication of the likelihood corresponds to a probability;

combinations related to an ad in the plurality of ads under each display environment form a distribution with the probabilities associated therewith adding up to one; and

the step of drawing is performed in accordance with the distributed probabilities for the combinations.

13 . The medium of claim 8 , wherein the display environment is characterized based on information related to at least one of:

the user;

the user device;

the slot for displaying an ad;

the webpage where the slot resides; and

a traffic segment associated with the display environment.

14 . The medium of claim 8 , wherein the combination distributions stored in the EEL are regularly updated so that the combination is drawn from the updated combination distributions in the EEL to maximize a return of displaying the ad in the display environment in a manner adapted to a change in the marketplace.

15 . A system for displaying ads comprises:

explore/exploit layers (EELs) each associated with a corresponding one of a plurality of frontend ad serving engines, each configured for receiving, from an ad recommendation backend server, and based on a selection criteria configuration that maps each of subsets of combination distributions with respect to a plurality of ads to a corresponding one of the plurality of frontend ad serving engines, one of the subsets of combination distributions,

wherein each of the plurality of ads has a plurality of attributes, each of the plurality of attributes is associated with multiple assets, and each of the multiple assets can be used for rendering the attribute,

wherein different subsets of the combination distributions are received by different ones of the plurality of frontend ad serving engines, and

wherein each of the combination distributions represents a probability for each of a plurality of different combinations of assets being selected by users sharing one or more common characteristics; and

the plurality of frontend ad serving engine each associated with a corresponding one of the EELs and configured for

sending, to the ad recommendation backend server, a request for a recommendation of an ad to be used for bidding an ad display opportunity in a slot of a webpage viewed by a user on a user device,

receiving, from the ad recommendation backend server, an ad recommended based on a display environment related to the user and the webpage, wherein the ad recommended is one of the plurality of ads,

upon a successful auction of the ad,

obtaining a segment key representing a combination of a feature of the user and a feature of the user device, and

determining whether combination distributions for the ad are available in the EEL,

in response to a determination that the combination distributions for the ad are available in the EEL, drawing, directly from the EEL without communicating with the ad recommendation backend server, a combination from the plurality of combinations based on the segment key and the combination distribution associated with the ad stored in the EEL, and

transmitting the combination to the user device to render the ad to the user in the slot of the webpage on the user device.

16 . The system of claim 15 , wherein the plurality of attributes of each of the plurality of ads include at least some of:

a title of the ad;

an image that visually conveys information about the ad; and

a description that textually summarizes content of the ad, wherein

any of the multiple assets associated with each of the plurality of attributes of the ad can be used to render the attribute, and

the combination includes a plurality of assets, each for one of the plurality of attributes of the ad and is drawn to maximize a return of displaying the ad according to a predetermined criterion.

17 . The system of claim 16 , wherein the predetermined criterion includes:

a click through rate (CTR); or

a conversion rate (CVR).

18 . The system of claim 15 , wherein combination distributions associated with each of the plurality ads provide different ways to render the ad, wherein each combination in the combination distributions

represents one way to render the ad with respect to the display environment; and

is provided with an indication of a likelihood to be drawn to render the ad;

wherein the indication of the likelihood is determined based on a predicted performance of the combination in the display environment estimated by a prediction model; and

wherein the prediction model is obtained via machine learning based on training data to maximize a return of the ad according to a predetermined criterion.

19 . The system of claim 15 , wherein the display environment is characterized based on information related to at least one of:

the user;

the user device;

the slot for displaying an ad;

the webpage where the slot resides; and

a traffic segment associated with the display environment.

20 . The system of claim 15 , wherein the combination distributions stored in the EEL are regularly updated so that the combination is drawn from the updated combination distributions in the EEL to maximize a return of displaying the ad in the display environment in a manner adapted to a change in the marketplace.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2022
From: SOMEKH, OREN SHLOMO; SHTOFF, ALEX; SHAHAR, AVI; SHADI, TOMER; KOREN, YAIR; ITZHAKI, ANNA; KAPLAN, YOHAY; COHEN, TAL; TRAYVAS, BORIS
To: VERIZON MEDIA INC.
Reel/Frame 060018/0065 →
CHANGE OF NAME Recorded Mar 22, 2022
From: VERIZON MEDIA INC.
To: YAHOO AD TECH LLC
Reel/Frame 059472/0328 →
Continuity (1)
Related Publication 20230214880A1 · Jul 6, 2023
References Cited (22)
US 9922347B1 · Burcham et al. · 2018 [cited by applicant]
US 10438114B1 · Blundell · 2019 [cited by examiner]
US 10740359B1 · Browne · 2020 [cited by applicant]
US 11216602B2 · Bourhani · 2022 [cited by examiner]
US 20080249855A1 · Collins · 2008 [cited by examiner]
US 20090132353A1 · Maggenti · 2009 [cited by examiner]
US 20100138452A1 · Henkin · 2010 [cited by examiner]
US 20140114746A1 · Pani et al. · 2014 [cited by applicant]
US 20180047058A1 · Kang et al. · 2018 [cited by applicant]
US 20180189843A1 · Kulkarni et al. · 2018 [cited by applicant]
US 20180232660A1 · Kagian et al. · 2018 [cited by applicant]
US 20190050894A1 · Cox et al. · 2019 [cited by applicant]
US 20190334903A1 · Lerner · 2019 [cited by examiner]
US 20200285516A1 · Darling · 2020 [cited by examiner]
Aharon et al., “Carousel Ads Optimization in Yahoo Gemini Native”, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Jul. 2019, pp. 1993-2001, Israel. [cited by applicant]
Office Action mailed Oct. 7, 2022 in U.S. Appl. No. 17/566,114. [cited by applicant]
Somekh et al., “Carousel Ads Optimization in Yahoo Gemini Native”, proc. KDD'2019. [cited by applicant]
Somekh et al., “Dynamic Creative Optimization in Verizon Media Native Advertising”, in proc. IEEEBigData'2020. [cited by applicant]
Somekh et al., “Conversion-Based Dynamic-Creative-Optimization in Native Advertising”, sub. to CIKM'2021, Nov. 2021, Queensland, Australia. [cited by applicant]
Office Action dated Aug. 1, 2023 in U.S. Appl. No. 17/566,161. [cited by applicant]
1 Non-Final Office Action mailed Jun. 20, 2024 in U.S. Appl. No. 17/566,161. [cited by applicant]
Examiner's Answer to Appeal Brief mailed Jul. 10, 2025 in U.S. Appl. No. 17/566,161. [cited by applicant]