IP Library Granted Patent US 12,632,776
Granted Patent B2
US 12,632,776 · App. 17/313,698 · Granted May 19, 2026

Systems and methods for rendering near-real-time embedding models for personalized news recommendations

Inventors: Peng-Yu Chen (Taipei City, TW); Yu-Ting Chang (Taipei City, TW); Chi-Chia Huang (New Taipei City, TW); Yi-Ting Tsao (New Taipei City, TW); Cheng-En Yen (New Taipei City, TW); Tzu-Chiang Liou (New Taipei City, TW)
Assignee: Yahoo Ad Tech LLC
G06N20/00G06N5/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,632,776
App. No.
17/313,698
Granted
May 19, 2026
Kind
B2
Abstract

The instant system and methods solves the cold start problem through various systems and methods directed to aggregating user interaction data associated with a user over a period of time, generating an embedding model based on the aggregated user interaction data, generating a content embedding vector based on the embedding model, generating an embedding profile vector based on the embedding model, storing the embedding profile vector in a storage device, receiving each of the content embedding vector and embedding vector profile for training a ranking model, and generating a predicted list of one or more content items of interest for recommending to the user.

Claims (54)

1 . A computer-implemented method for identifying content to recommend to a user, the method comprising:

creating a user interest profile, by a server processor of a computation device, by aggregating user interaction data associated with a user over a period of time, the user interaction data including one or more user interactions of a first type and one or more user interest features;

training, by the server processor, an embedding model to overlap the user interaction data with the one or more user interaction features and embed text features of the one or more user interest features into a vector space with a fixed length representation in order to overcome cold-start problems, the text features including click or skip labels, based on historical click or skip user feedback, and time decay factors to further train the embedding model to remove old text features;

generating, by a machine learning model processed by the server processor, a content embedding vector based on the embedding model, the content embedding vector including a mean pooling of words extracted from one or more content articles;

generating, by the server processor, an embedding profile vector based on the embedding model, the embedding profile vector including a vector representation of one or more user interaction data, the vector representation including the fixed length representation;

training, by the server processor, a machine learning prediction model based on the embedding profile vector and the content embedding vector;

receiving, by the server processor, a user search query;

determining in real-time, by the trained machine learning prediction model and based on the user search query, a predicted list of one or more content items of interest for recommending to the user and a corresponding relevance score for each of the one or more content items of interest; and

transmitting, over a network, to a device of the user for display, one of the one or more content items of interest based on the relevance score for each of the one or more content items of interest.

2 . The computer-implemented method of claim 1 , wherein:

the one or more user interactions of the first type include consecutive clicks of the user on one or more content articles within a predefined period of time.

3 . The computer-implemented method of claim 2 , wherein:

the predefined period of time includes within a twenty-four hour period of time.

4 . The computer-implemented method of claim 1 , wherein the embedding profile vector is multiplied by a decay factor, the decay factor configured to decrease a value of one or more past interactions over time.

5 . The computer-implemented method of claim 4 , wherein the decay factor is selected by a heuristic approach and is set as a hyperparameter.

6 . The computer-implemented method of claim 1 , wherein the one or more user interaction data of the first type includes: media streaming, search query, menu navigation, electronic messaging, or user application preference setting.

7 . The computer-implemented method of claim 1 , further comprising generating one or more of: a user recommendation, a user notification, and a user profile customization based on the trained machine learning prediction model.

8 . A system for profile partition generation comprising:

at least one processor; and

a storage device that stores a set of instructions, the set of instructions being executable by the at least one processor to cause the at least one processor to implement steps comprising:

creating a user interest profile, by a server processor of a computation device, by aggregating user interaction data associated with a user over a period of time, the user interaction data including one or more user interactions of a first type and one or more user interest features;

training, by the server processor, an embedding model to overlap the user interaction data with the one or more user interaction features and embed text features of the one or more interest features into a vector space with a fixed length representation in order to overcome cold-start problems, the text features including click or skip labels, based on historical click or skip user feedback, and time decay factors to further train the embedding model to remove old text features;

generating, by a machine learning model processed by the server processor, a content embedding vector based on the embedding model, the content embedding vector including a mean pooling of words extracted from one or more content articles;

generating, by the server processor, an embedding profile vector based on the embedding model, the embedding profile vector including a vector representation of one or more user interaction data, the vector representation including the fixed length representation;

training, by the server processor, a machine learning prediction model based on the embedding profile vector and the content embedding vector;

receiving, by the server processor, a user search query;

determining in real-time, by the trained machine learning prediction model and based on the user search query, a predicted list of one or more content items of interest for recommending to the user and a corresponding relevance score for each of the one or more content items of interest; and

transmitting, over a network, to a device of the user for display, one of the one or more content items of interest based on the relevance score for each of the one or more content items of interest.

9 . The system of claim 8 , wherein:

the one or more user interactions of the first type include consecutive clicks of the user on one or more content articles within a predefined period of time.

10 . The system of claim 9 , wherein:

the predefined period of time includes within a twenty-four hour period of time.

11 . The system of claim 8 , wherein the embedding profile vector is multiplied by a decay factor, the decay factor configured to decrease a value of one or more past interactions over time.

12 . The system of claim 11 , wherein the decay factor is selected by a heuristic approach and is set as a hyperparameter.

13 . The system of claim 8 , wherein the one or more user interaction data of the first type includes: media streaming, search query, menu navigation, electronic messaging, or user application preference setting.

14 . The system of claim 8 , further comprising:

generating one or more of: a user recommendation, a user notification, and a user profile customization based on the trained machine learning prediction model.

15 . A non-transitory computer readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations for profile partition generation, the operations comprising:

creating a user interest profile, by a server processor of a computation device, by aggregating user interaction data associated with a user over a period of time, the user interaction data including one or more user interactions of a first type and one or more user interest features;

training, by the server processor, an embedding model to overlap the user interaction data with the one or more user interaction features and embed text features of the one or more user interest features into a vector space with a fixed length representation in order to overcome cold-start problems, the text features including click or skip labels, based on historical click or skip user feedback, and time decay factors to further train the embedding model to remove old text features;

generating, by a machine learning model processed by the server processor, a content embedding vector based on the embedding model, the content embedding vector including a mean pooling of words extracted from one or more content articles;

generating, by the server processor, an embedding profile vector based on the embedding model, the embedding profile vector including a vector representation of one or more user interaction data, the vector representation including the fixed length representation;

training, by the server processor, a machine learning prediction model based on the embedding profile vector and the content embedding vector;

receiving, by the server processor, a user search query;

determining in real-time, by the trained machine learning prediction model and based on the user search query, a predicted list of one or more content items of interest for recommending to the user and a corresponding relevance score for each of the one or more content items of interest; and

transmitting, over a network, to a device of the user for display, one of the one or more content items of interest based on the relevance score for each of the one or more content items of interest.

16 . The non-transitory computer readable medium of claim 15 , wherein:

the one or more user interactions of the first type include consecutive clicks of the user on one or more content articles within a predefined period of time.

17 . The non-transitory computer readable medium of claim 16 , wherein:

the predefined period of time includes within a twenty-four hour period of time.

18 . The non-transitory computer readable medium of claim 15 , wherein the embedding profile vector is multiplied by a decay factor, the decay factor configured to decrease a value of one or more past interactions over time.

19 . The non-transitory computer readable medium of claim 15 , wherein the one or more user interaction data of the first type includes: media streaming, search query, menu navigation, electronic messaging, or user application preference setting.

20 . The non-transitory computer readable medium of claim 15 , further comprising:

generating one or more of: a user recommendation, a user notification, and a user profile customization based on the trained machine learning prediction model.

Assignments (4)
CHANGE OF NAME Recorded Sep 3, 2025
From: VERIZON MEDIA INC.
To: YAHOO AD TECH LLC
Reel/Frame 072826/0315 →
PATENT SECURITY AGREEMENT (FIRST LIEN) Recorded Sep 29, 2022
From: YAHOO ASSETS LLC
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 061571/0773 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: YAHOO AD TECH LLC (FORMERLY VERIZON MEDIA INC.)
To: YAHOO ASSETS LLC
Reel/Frame 058982/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2021
From: CHEN, PENG-YU; CHANG, YU-TING; HUANG, CHI-CHIA; TSAO, YI-TING; YEN, CHENG-EN; LIOU, TZU-CHIANG
To: VERIZON MEDIA INC.
Reel/Frame 056162/0500 →