IP Library › Granted Patent US 12,250,277
Granted Patent B2
US 12,250,277 · App. 17/329,128 · Granted Mar 11, 2025

Method for making recommendations to a user and apparatus, computing device, and storage medium

Inventors: Zhijie Qiu (Shenzhen, CN); Jun Rao (Shenzhen, CN); Yi Liu (Shenzhen, CN); Zhou Su (Shenzhen, CN); Shukai Liu (Shenzhen, CN); Zhenlong Sun (Shenzhen, CN); Qi Liu (Shenzhen, CN); Liangdong Wang (Shenzhen, CN); Tiantian Shang (Shenzhen, CN); Mingfei Liang (Shenzhen, CN); Lei Chen (Shenzhen, CN); Bo Zhang (Shenzhen, CN); Leyu Lin (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
H04L67/306G06F18/213G06N3/042G06V10/806G06V10/82H04L67/535G06V40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,250,277
App. No.
17/329,128
Granted
Mar 11, 2025
Kind
B2
Abstract

Embodiments of this application provide a method for making recommendations to a user and an apparatus, a computing device, and a storage medium. The method includes obtaining user attribute information, reading attribute information, reading history information, and candidate items; performing intra-group information fusion on the reading attribute information according to preset groupings to obtain reading feature information; obtaining a reading history weight according to the reading history information; obtaining history feature information according to the reading history weight and the reading history information; obtaining user feature information according to the user attribute information, the reading feature information, and the history feature information; and selecting a recommendation item from the candidate items according to the user feature information.

Claims (60)

1. A method for making recommendations to a user, performed by a computing device, the method comprising:

obtaining user attribute information, reading attribute information, reading history information, and candidate items;

performing intra-group information fusion on the reading attribute information according to preset groupings to obtain reading feature information;

obtaining a reading history weight according to the reading history information;

obtaining history feature information according to the reading history weight and the reading history information;

obtaining user feature information according to the user attribute information, the reading feature information, and the history feature information;

inputting the user feature information and the candidate items into a neural network, to determine similarity scores that describe degree of similarity between the user feature information and the candidate items by using an inner product algorithm or a cosine similarity; and

selecting a recommendation item from the candidate items according to the similarity scores, wherein a quantity of the candidate items exceeds 10 million, and distributed k-nearest neighbor (k-NN) servers are provided to complete on-line real-time recall for selecting the recommendation item.

2. The method according to claim 1 , wherein the performing intra-group information fusion on the reading attribute information according to preset groupings to obtain reading feature information comprises:

performing average pooling on the reading attribute information in a same group to obtain the reading feature information.

3. The method according to claim 1 , wherein the obtaining a reading history weight according to the reading history information comprises:

inputting the reading history information to a self-attention layer model to calculate a self-attention layer output vector of the reading history information; and

calculating the reading history weight according to the self-attention layer output vector and a preset parameter.

4. The method according to claim 3 , wherein the obtaining history feature information according to the reading history weight and the reading history information comprises:

inputting the self-attention layer output vector to an attention pooling layer model, and performing weighted averaging on the self-attention layer output vector according to the reading history weight to obtain the history feature information.

5. The method according to claim 3 , wherein the self-attention layer model performs the following method:

re-encoding the reading history information to obtain a first feature matrix, a second feature matrix, and a third feature matrix;

performing linear transformation on the first feature matrix, the second feature matrix, and the third feature matrix, and inputting the first feature matrix, the second feature matrix, and the third feature matrix on which the linear transformation has been performed into a first self-attention model in parallel for a plurality of times, to obtain output results of the first self-attention model;

concatenating the output results of the first self-attention model and performing linear transformation to obtain a self-attention layer output vector.

6. The method according to claim 1 , wherein the obtaining user feature information according to the user attribute information, the reading feature information, and the history feature information comprises:

combining the user attribute information, the reading feature information, and the history feature information into combined feature information; and

inputting the combined feature information into a multi-layer neural network to obtain the user feature information that matches dimensions of the candidate items.

7. A user recommendation apparatus, comprising a processor and a memory, the memory storing computer-executable instructions, the computer-executable instructions, when executed by the processor, causing the processor to:

obtain corresponding reading feature information according to different reading attribute information;

obtain history feature information according to reading history information;

obtain user feature information according to user attribute information, the reading feature information, and the history feature information;

input the user feature information and the candidate items into a neural network, to determine similarity scores that describe degree of similarity between the user feature information and the candidate items by using an inner product algorithm or a cosine similarity; and

select a recommendation item from candidate items according to the similarity scores, wherein a quantity of the candidate items exceeds 10 million, and distributed k-nearest neighbor (k-NN) servers are provided to complete on-line real-time recall for selecting the recommendation item.

8. The apparatus according to claim 7 , wherein the computer-executable instructions further cause the processor to:

input the reading history information into a self-attention layer model to obtain a self-attention layer output vector;

calculate a reading history weight according to the self-attention layer output vector and a preset parameter; and

input the self-attention layer output vector to an attention pooling layer model, and perform weighted averaging on the self-attention layer output vector according to the reading history weight to obtain the history feature information.

9. The apparatus according to claim 8 , wherein obtaining the history feature information according to the reading history weight and the reading history information comprises:

inputting the self-attention layer output vector to an attention pooling layer model, and performing weighted averaging on the self-attention layer output vector according to the reading history weight to obtain the history feature information.

10. The apparatus according to claim 8 , wherein the self-attention layer model performs:

re-encoding the reading history information to obtain a first feature matrix, a second feature matrix, and a third feature matrix;

performing linear transformation on the first feature matrix, the second feature matrix, and the third feature matrix, and inputting the first feature matrix, the second feature matrix, and the third feature matrix on which the linear transformation has been performed into a first self-attention model in parallel for a plurality of times, to obtain output results of the first self-attention model;

concatenating the output results of the first self-attention model and performing linear transformation to obtain a self-attention layer output vector.

11. A non-transitory computer-readable storage medium, storing computer-executable instructions, the computer-executable instructions, when executed by a processor, causing the processor to perform the method for making recommendations to a user, comprising:

obtaining user attribute information, reading attribute information, reading history information, and candidate items;

performing intra-group information fusion on the reading attribute information according to preset groupings to obtain reading feature information;

obtaining a reading history weight according to the reading history information;

obtaining history feature information according to the reading history weight and the reading history information;

obtaining user feature information according to the user attribute information, the reading feature information, and the history feature information;

inputting the user feature information and the candidate items into a neural network, to determine similarity scores that describe degree of similarity between the user feature information and the candidate items by using an inner product algorithm or a cosine similarity; and

selecting a recommendation item from the candidate items according to the similarity scores, wherein a quantity of the candidate items exceeds 10 million, and distributed k-nearest neighbor (k-NN) servers are provided to complete on-line real-time recall for selecting the recommendation item.

12. The computer-readable storage medium according to claim 11 , wherein the performing intra-group information fusion on the reading attribute information according to preset groupings to obtain reading feature information comprises:

performing average pooling on the reading attribute information in a same group to obtain the reading feature information.

13. The computer-readable storage medium according to claim 11 , wherein the obtaining a reading history weight according to the reading history information comprises:

inputting the reading history information to a self-attention layer model to calculate a self-attention layer output vector of the reading history information; and

calculating the reading history weight according to the self-attention layer output vector and a preset parameter.

14. The computer-readable storage medium according to claim 13 , wherein the obtaining history feature information according to the reading history weight and the reading history information comprises:

inputting the self-attention layer output vector to an attention pooling layer model, and performing weighted averaging on the self-attention layer output vector according to the reading history weight to obtain the history feature information.

15. The computer-readable storage medium according to claim 13 , wherein the self-attention layer model performs the following method:

re-encoding the reading history information to obtain a first feature matrix, a second feature matrix, and a third feature matrix;

performing linear transformation on the first feature matrix, the second feature matrix, and the third feature matrix, and inputting the first feature matrix, the second feature matrix, and the third feature matrix on which the linear transformation has been performed into a first self-attention model in parallel for a plurality of times, to obtain output results of the first self-attention model;

concatenating the output results of the first self-attention model and performing linear transformation to obtain a self-attention layer output vector.

16. The computer-readable storage medium according to claim 11 , wherein the obtaining user feature information according to the user attribute information, the reading feature information, and the history feature information comprises:

combining the user attribute information, the reading feature information, and the history feature information into combined feature information; and

inputting the combined feature information into a multi-layer neural network to obtain the user feature information that matches dimensions of the candidate items.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2021
From: QIU, ZHIJIE; RAO, JUN; LIU, YI; SU, ZHOU; LIU, SHUKAI; SUN, ZHENLONG; LIU, QI; WANG, LIANGDONG; SHANG, TIANTIAN; LIANG, MINGFEI; CHEN, LEI; ZHANG, BO; LIN, LEYU
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 056355/0799 →
Priority Claims (1)
CN 201910312887.0 · Apr 18, 2019 · national
Continuity (2)
Continuation PCTCN2020078144 · Mar 6, 2020
Related Publication 20210279552A1 · Sep 9, 2021
References Cited (29)
US 4718103A · Shojima · 1988 [cited by examiner]
US 10977322B2 · Muralidhar · 2021 [cited by examiner]
US 20150309961A1 · Ozaki · 2015 [cited by examiner]
US 20160132789A1 · Flinn · 2016 [cited by examiner]
US 20170132230A1 · Muralidhar · 2017 [cited by examiner]
US 20170169341A1 · Tang · 2017 [cited by examiner]
US 20180285779A1 · Zhou · 2018 [cited by examiner]
US 20190005113A1 · Kenedy · 2019 [cited by examiner]
US 20190205939A1 · Lal · 2019 [cited by examiner]
US 20190213660A1 · Astrada · 2019 [cited by examiner]
US 20200026772A1 · Wheeler · 2020 [cited by examiner]
US 20230126925A1 · Lin · 2023 [cited by examiner]
US 20240202797A1 · Pendar · 2024 [cited by examiner]
CN 104239466A · 2014 [cited by applicant]
CN 107145518A · 2017 [cited by applicant]
CN 108280114A · 2018 [cited by applicant]
CN 109543714A · 2019 [cited by applicant]
CN 110046304A · 2019 [cited by applicant]
The World Intellectual Property Organization (WIPO) International Search Report for PCT/CN2020/078144 Jun. 12, 2020 6 Pages (including translation). [cited by applicant]
Dzmitry Bahdanau et al., “Neural Machine Translation by Jointly Learning to Align and Translate,” In Proceedings of the 3rd International Conference on Learning Representations, Apr. 24, 2015. 15 pages. [cited by applicant]
Hongwei Wang et al., “DKN: Deep Knowledge-Aware Network for News Recommendation,” In Proceedings of 26th International World Wide Web Conference, Jan. 30, 2018. 10 pages. [cited by applicant]
Steffen Rendle et al, “BPR: Bayesian Personalized Ranking from Implicit Feedback,” In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI2009), pp. 452-461, 2009. 10 pages. [cited by applicant]
Ruslan Salakhutdinov et al. “Restricted Boltzmann Machines for Collaborative Filtering,” In Proceedings of the 24th international conference on Machine learning, pp. 791-798, 2007. 8 pages. [cited by applicant]
Junxuan Chen et al., “Deep CTR Prediction in Display Advertising,” In Proceedings of the 24th ACM international conference on Multimedia, 2016. 10 pages. [cited by applicant]
Qiwen Liu et al., “Enlister: Baidu's Recommender System for the Biggest Chinese Q&A Website,” In RecSys-12: Proceedings of the 6th ACM conference on Recommender systems, pp. 285-288, 2012. 4 pages. [cited by applicant]
James. Davidson et al., “The Youtube Video Recommendation System,” In Proceedings of the Fourth ACM Conference on Recommender Systems, RecSys '10, pp. 293-296, 2010. 4 pages. [cited by applicant]
Paul Covington et al., “Deep Neural Networks for YouTube Recommendations,” In Proceedings of the 10th ACM Conference on Recommender Systems, pp. 191-198, 2016. 8 pages. [cited by applicant]
Steffen Rendle, “Factorization Machines,” In IEEE International Conference on Data Mining, pp. 995-1000, 2010. 6 pages. [cited by applicant]
Santosh Kabbur et al., “FISM: Factored Item Similarity Models for Top-N Recommender Systems,” In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 659-667, 2013. 9 p… [cited by applicant]