IP Library › Granted Patent US 12,248,507
Granted Patent B2
US 12,248,507 · App. 17/578,838 · Granted Mar 11, 2025

Method, electronic device, and computer program product for content recommendation

Inventors: Zijia Wang (WeiFang, CN); Jiacheng Ni (Shanghai, CN); Jinpeng Liu (Shanghai, CN); Zhen Jia (Shanghai, CN)
Assignee: Dell Products L.P.
G06F16/435G06F16/24578
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,248,507
App. No.
17/578,838
Granted
Mar 11, 2025
Kind
B2
Abstract

Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for content recommendation. A method for content recommendation includes determining a similarity between a first recommendation result and a second recommendation result for a content set. The first recommendation result and the second recommendation result are determined based on different recommendation techniques and respectively indicative of a recommendation degree for each content in the content set. The method further includes adjusting the second recommendation result using the similarity. In addition, the method further includes determining a target recommendation result for the content set based on the first recommendation result and the adjusted second recommendation result. In this manner, the accuracy and stability of the finally obtained recommendation results can be improved.

Claims (99)

1. A method for content recommendation, comprising:

determining, in at least one processing device of an Internet platform, a similarity between a first recommendation result and a second recommendation result for a content set, the first recommendation result and the second recommendation result being determined based on different recommendation techniques and respectively indicative of a recommendation degree for each of a plurality of content items in the content set, wherein the similarity is computed in the form of at least one vector of values indexed by identifiers of respective ones of the content items in the content set;

adjusting, in the at least one processing device of the Internet platform, the second recommendation result using the similarity;

determining, in the at least one processing device of the Internet platform, a target recommendation result for the content set based on the first recommendation result and the adjusted second recommendation result;

providing the target recommendation result from the at least one processing device of the Internet platform to a user device over a network; and

responsive to user interaction with a display presenting the target recommendation result at the user device, providing access to corresponding content at least in part via the at least one processing device of the Internet platform;

wherein determining the similarity between the first and second recommendation results comprises:

determining a first vector comprising a first set of indications based on the first recommendation result, the first vector being indexed by the identifiers of respective ones of the content items in the content set;

determining a second vector comprising a second set of indications based on the second recommendation result, the second vector being indexed by the identifiers of respective ones of the content items in the content set; and

determining the similarity based at least in part on a distance measure computed between the first and second vectors;

wherein adjusting the second recommendation result using the similarity comprises:

determining a modification factor based on the similarity; and

adjusting the second recommendation result based on the modification factor to alter an impact of the second recommendation result in determining the target recommendation result;

wherein adjusting the second recommendation result based on the modification factor comprises computing updated values for respective ones of the second set of indications of the second vector as a function of previous values for the respective ones of the second set of indications and the modification factor.

2. The method according to claim 1 , wherein determining the similarity comprises:

determining the first vector as the first set of indications based on the first recommendation result, the first set of indications being respectively indicative of recommendation degrees for corresponding contents in the content set;

determining the second vector as the second set of indications based on the second recommendation result, the second set of indications being respectively indicative of recommendation degrees for corresponding contents in the content set; and

determining the distance measure between the first and second vectors at least in part by computing a cosine similarity between the first set of indications and the second set of indications.

3. The method according to claim 1 , wherein adjusting the second recommendation result comprises:

determining a scaling factor based on the similarity; and

scaling the second recommendation result using the scaling factor.

4. The method according to claim 1 , wherein determining the target recommendation result comprises:

acquiring a first optimized recommendation result corresponding to the first recommendation result using the first recommendation result and the adjusted second recommendation result; and

determining the target recommendation result based on the first optimized recommendation result.

5. The method according to claim 4 , wherein determining the target recommendation result based on the first optimized recommendation result comprises:

adjusting the first recommendation result using the similarity;

acquiring a second optimized recommendation result corresponding to the second recommendation result using the second recommendation result and the adjusted first recommendation result; and

determining the target recommendation result based on the first optimized recommendation result and the second optimized recommendation result.

6. The method according to claim 1 , wherein the content set is a set of candidate articles and the recommendation technique recommends a candidate article from the set of candidate articles based on a predetermined base article, and the method further comprises:

determining a set of correlation measures associated with the set of candidate articles, each correlation measure in the set of correlation measures being indicative of a correlation degree between a corresponding candidate article and the base article; and

adjusting the target recommendation result using the set of correlation measures, so as to update the target recommendation result.

7. The method according to claim 6 , wherein the set of candidate articles comprises a first candidate article, the set of correlation measures comprises a first correlation measure corresponding to the first candidate article, and determining the set of correlation measures comprises:

determining, using a pre-trained language model, a correlation degree between a reference of the first candidate article and a title of the base article to serve as the first correlation measure.

8. An electronic device of an Internet platform, the electronic device comprising:

a processor; and

a memory coupled to the processor, wherein the memory has instructions stored therein, and the instructions, when executed by the processor, cause the electronic device to execute actions comprising:

determining a similarity between a first recommendation result and a second recommendation result for a content set, the first recommendation result and the second recommendation result being determined based on different recommendation techniques and respectively indicative of a recommendation degree for each of a plurality of content items in the content set, wherein the similarity is computed in the form of at least one vector of values indexed by identifiers of respective ones of the content items in the content set;

adjusting the second recommendation result using the similarity;

determining a target recommendation result for the content set based on the first recommendation result and the adjusted second recommendation result;

providing the target recommendation result from the Internet platform to a user device over a network; and

responsive to user interaction with a display presenting the target recommendation result at the user device, providing access to corresponding content at least in part via the Internet platform;

wherein determining the similarity between the first and second recommendation results comprises:

determining a first vector comprising a first set of indications based on the first recommendation result, the first vector being indexed by the identifiers of respective ones of the content items in the content set;

determining a second vector comprising a second set of indications based on the second recommendation result, the second vector being indexed by the identifiers of respective ones of the content items in the content set; and

determining the similarity based at least in part on a distance measure computed between the first and second vectors;

wherein adjusting the second recommendation result using the similarity comprises:

determining a modification factor based on the similarity; and

adjusting the second recommendation result based on the modification factor to alter an impact of the second recommendation result in determining the target recommendation result;

wherein adjusting the second recommendation result based on the modification factor comprises computing updated values for respective ones of the second set of indications of the second vector as a function of previous values for the respective ones of the second set of indications and the modification factor.

9. The electronic device according to claim 8 , wherein determining the similarity comprises:

determining the first vector as the first set of indications based on the first recommendation result, the first set of indications being respectively indicative of recommendation degrees for corresponding contents in the content set;

determining the second vector as the second set of indications based on the second recommendation result, the second set of indications being respectively indicative of recommendation degrees for corresponding contents in the content set; and

determining the distance measure between the first and second vectors at least in part by computing a cosine similarity between the first set of indications and the second set of indications.

10. The electronic device according to claim 8 , wherein adjusting the second recommendation result comprises:

determining a scaling factor based on the similarity; and

scaling the second recommendation result using the scaling factor.

11. The electronic device according to claim 8 , wherein determining the target recommendation result comprises:

acquiring a first optimized recommendation result corresponding to the first recommendation result using the first recommendation result and the adjusted second recommendation result; and

determining the target recommendation result based on the first optimized recommendation result.

12. The electronic device according to claim 11 , wherein determining the target recommendation result based on the first optimized recommendation result comprises:

adjusting the first recommendation result using the similarity;

acquiring a second optimized recommendation result corresponding to the second recommendation result using the second recommendation result and the adjusted first recommendation result; and

determining the target recommendation result based on the first optimized recommendation result and the second optimized recommendation result.

13. The electronic device according to claim 8 , wherein the content set is a set of candidate articles, the recommendation technique recommends a candidate article from the set of candidate articles based on a predetermined base article, and the actions further comprise:

determining a set of correlation measures associated with the set of candidate articles, each correlation measure in the set of correlation measures being indicative of a correlation degree between a corresponding candidate article and the base article; and

adjusting the target recommendation result using the set of correlation measures, so as to update the target recommendation result.

14. The electronic device according to claim 13 , wherein the set of candidate articles comprises a first candidate article, the set of correlation measures comprises a first correlation measure corresponding to the first candidate article, and determining the set of correlation measures comprises:

determining, using a pre-trained language model, a correlation degree between a reference of the first candidate article and a title of the base article to serve as the first correlation measure.

15. A computer program product tangibly stored on a computer-readable medium and comprising machine-executable instructions, wherein the machine-executable instructions, when executed by at least one processing device of an Internet platform, cause the at least one processing device of the Internet platform to perform a method for content recommendation, the method comprising:

determining a similarity between a first recommendation result and a second recommendation result for a content set, the first recommendation result and the second recommendation result being determined based on different recommendation techniques and respectively indicative of a recommendation degree for each of a plurality of content items in the content set, wherein the similarity is computed in the form of at least one vector of values indexed by identifiers of respective ones of the content items in the content set;

adjusting the second recommendation result using the similarity;

determining a target recommendation result for the content set based on the first recommendation result and the adjusted second recommendation result;

providing the target recommendation result from the at least one processing device of the Internet platform to a user device over a network; and

responsive to user interaction with a display presenting the target recommendation result at the user device, providing access to corresponding content at least in part via the at least one processing device of the Internet platform;

wherein determining the similarity between the first and second recommendation results comprises:

determining a first vector comprising a first set of indications based on the first recommendation result, the first vector being indexed by the identifiers of respective ones of the content items in the content set;

determining a second vector comprising a second set of indications based on the second recommendation result, the second vector being indexed by the identifiers of respective ones of the content items in the content set; and

determining the similarity based at least in part on a distance measure computed between the first and second vectors;

wherein adjusting the second recommendation result using the similarity comprises:

determining a modification factor based on the similarity; and

adjusting the second recommendation result based on the modification factor to alter an impact of the second recommendation result in determining the target recommendation result;

wherein adjusting the second recommendation result based on the modification factor comprises computing updated values for respective ones of the second set of indications of the second vector as a function of previous values for the respective ones of the second set of indications and the modification factor.

16. The computer program product according to claim 15 , wherein determining the similarity comprises:

determining the first vector as the first set of indications based on the first recommendation result, the first set of indications being respectively indicative of recommendation degrees for corresponding contents in the content set;

determining the second vector as the second set of indications based on the second recommendation result, the second set of indications being respectively indicative of recommendation degrees for corresponding contents in the content set; and

determining the distance measure between the first and second vectors at least in part by computing a cosine similarity between the first set of indications and the second set of indications.

17. The computer program product according to claim 15 , wherein adjusting the second recommendation result comprises:

determining a scaling factor based on the similarity; and

scaling the second recommendation result using the scaling factor.

18. The computer program product according to claim 15 , wherein determining the target recommendation result comprises:

acquiring a first optimized recommendation result corresponding to the first recommendation result using the first recommendation result and the adjusted second recommendation result; and

determining the target recommendation result based on the first optimized recommendation result.

19. The computer program product according to claim 18 , wherein determining the target recommendation result based on the first optimized recommendation result comprises:

adjusting the first recommendation result using the similarity;

acquiring a second optimized recommendation result corresponding to the second recommendation result using the second recommendation result and the adjusted first recommendation result; and

determining the target recommendation result based on the first optimized recommendation result and the second optimized recommendation result.

20. The computer program product according to claim 15 , wherein the content set is a set of candidate articles and the recommendation technique recommends a candidate article from the set of candidate articles based on a predetermined base article, and the method further comprises:

determining a set of correlation measures associated with the set of candidate articles, each correlation measure in the set of correlation measures being indicative of a correlation degree between a corresponding candidate article and the base article; and

adjusting the target recommendation result using the set of correlation measures, so as to update the target recommendation result.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2022
From: WANG, ZIJIA; NI, JIACHENG; LIU, JINPENG; JIA, ZHEN
To: DELL PRODUCTS L.P.
Reel/Frame 058694/0468 →
Priority Claims (1)
CN 202111625650.1 · Dec 28, 2021 · national
Continuity (1)
Related Publication 20230205802A1 · Jun 29, 2023
References Cited (47)
US 8301623B2 · Chakrabarti · 2012 [cited by examiner]
US 8301692B1 · Hamaker · 2012 [cited by examiner]
US 10115146B1 · Anderson · 2018 [cited by examiner]
US 10372736B2 · Li · 2019 [cited by examiner]
US 11070881B1 · Srinivasaraghavan · 2021 [cited by examiner]
US 11113745B1 · Cetintas · 2021 [cited by examiner]
US 11316941B1 · Jain · 2022 [cited by examiner]
US 11416536B2 · Zhao · 2022 [cited by examiner]
US 11935106B2 · Yang · 2024 [cited by examiner]
US 20070239686A1 · Quinn-Jacobs · 2007 [cited by examiner]
US 20090248599A1 · Hueter · 2009 [cited by examiner]
US 20100094799A1 · Ohashi · 2010 [cited by examiner]
US 20100100416A1 · Herbrich · 2010 [cited by examiner]
US 20110184899A1 · Gadanho · 2011 [cited by examiner]
US 20120095863A1 · Schiff · 2012 [cited by examiner]
US 20130159331A1 · Zhang · 2013 [cited by examiner]
US 20150220539A1 · Lambert · 2015 [cited by examiner]
US 20170053558A1 · Zhou · 2017 [cited by examiner]
US 20180012284A1 · Igarashi · 2018 [cited by examiner]
US 20180268253A1 · Hoffman · 2018 [cited by examiner]
US 20180276542A1 · Cheng · 2018 [cited by examiner]
US 20190384831A1 · Alonso · 2019 [cited by examiner]
US 20200151586A1 · Yuan · 2020 [cited by examiner]
US 20200227026A1 · Rajagopal · 2020 [cited by examiner]
US 20200251213A1 · Tran · 2020 [cited by examiner]
US 20200327599A1 · Renaud · 2020 [cited by examiner]
US 20200402143A1 · Gutnik · 2020 [cited by examiner]
US 20210019550A1 · Xu · 2021 [cited by examiner]
US 20210174164A1 · Hsieh · 2021 [cited by examiner]
US 20210241343A1 · Arora · 2021 [cited by examiner]
US 20210406736A1 · Sennik · 2021 [cited by examiner]
US 20220086393A1 · Peters · 2022 [cited by examiner]
US 20220092028A1 · Layton · 2022 [cited by examiner]
US 20220108175A1 · Lyske · 2022 [cited by examiner]
US 20220129804A1 · Dooley · 2022 [cited by examiner]
US 20220198779A1 · Saraee · 2022 [cited by examiner]
US 20220317979A1 · Araujo Soares · 2022 [cited by examiner]
US 20230044463A1 · Woolf · 2023 [cited by examiner]
US 20230153338A1 · Mai · 2023 [cited by examiner]
US 20230205802A1 · Wang · 2023 [cited by examiner]
J. Vig, “Deconstructing BERT, Part 2: Visualizing the Inner Workings of Attention,” https://towardsdatascience.com/deconstructing-bert-part-2-visualizing-the-inner-workings-of-attention-60a16d86b5c1, Jan. 7, 2019, 29 pa… [cited by applicant]
E. Nalisnick et al., “Improving Document Ranking with Dual Word Embeddings,” WWW'16 Companion, Apr. 2016, 2 pages. [cited by applicant]
Wikipedia, “Okapi BM25,” https://en.wikipedia.org/wiki/Okapi_BM25, Feb. 24, 2021, 4 pages. [cited by applicant]
Wikipedia, “Latent Dirichlet Allocation,” https://en.wikipedia.org/wiki/Latent_Dirichlet_allocation, Dec. 8, 2021, 8 pages. [cited by applicant]
G. Shperber, “A Gentle Introduction to Doc2Vec,” https://medium.com/wisio/a-gentle-introduction-to-doc2vec-db3e8c0cce5e, Jul. 26, 2017, 10 pages. [cited by applicant]
H. Tian et al., “Paper2vec: Citation—Context Based Document Distributed Representation for Scholar Recommendation,” arXiv:1703.06587v1, Mar. 20, 2017, 17 pages. [cited by applicant]
M. Färber et al., “HybridCite: A Hybrid Model for Context-Aware Citation Recommendation,” The ACM/IEEE Joint Conference on Digital Libraries, Aug. 2020, 10 pages. [cited by applicant]