IP Library Granted Patent US 12,242,555
Granted Patent B2
US 12,242,555 · App. 18/807,634 · Granted Mar 4, 2025

Combined wide and deep machine learning models for automated database element processing systems, methods and apparatuses

Inventors: Bing Song (La Canada, CA); Jeffrey Michael Balbien (Los Angeles, CA); Hao Lu (Los Angeles, CA); Phillip Yang (Los Angeles, CA); Patrick Soon-Shiong (Los Angeles, CA)
Assignee: NantMedia Holdings, LLC
G06F16/9535G06F40/284G06F40/40G06N3/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,242,555
App. No.
18/807,634
Granted
Mar 4, 2025
Kind
B2
Abstract

A method of automated database element processing includes training a wide machine learning model with historical feature vector inputs to generate a wide ranked element output. The method includes training a deep machine learning model with the historical feature vector inputs to generate a deep ranked element output. The method includes generating a set of inputs specific to an individual entity, obtaining a set of current article database elements, and creating a feature vector input according to the set of inputs and the set of current article database elements. The method includes processing the feature vector input with the wide machine learning model to generate a wide ranked element list, processing the feature vector input with the deep machine learning model to generate a deep ranked element list, and merging database elements of the wide and deep ranked element lists to generate a ranked element recommendation output.

Claims (45)

1. A computer-based recommendation system comprising:

at least one computer readable non-transitory memory storing computer-executable instructions including at least one trained wide machine learning model configured to generate a wide ranked article output and at least one trained deep machine learning model configured to generate a deep ranked article output; and

at least one processor coupled with the at least one computer readable non-transitory memory and that performs the following operations upon execution of the computer-executable instructions:

generating a set of inputs specific to a subscriber and derived from article access records associated with the subscriber;

obtaining a set of current articles published according to specified time period criteria;

creating a feature vector input according to the set of inputs specific to the subscriber and the set of current articles;

generating, via the at least one trained wide machine learning model, a wide ranked article list from a wide model subset of the current articles generated based on the feature vector input and based on a subscriber click history, and having a highest correlation with the article access records;

generating, via the at least one trained deep machine learning model, a deep ranked article list from a deep model subset of the current articles generated based on the feature vector input and based on the subscriber click history, and having a highest correlation with the article access records;

generating a ranked article recommendation output by merging articles from the wide ranked article list and the deep ranked article list; and

displaying the ranked article recommendation output on a user device of the subscriber.

2. The computer-based recommendation system of claim 1 , wherein the set of current articles comprises news articles.

3. The computer-based recommendation system of claim 1 , wherein the set of current articles comprises newspaper articles.

4. The computer-based recommendation system of claim 1 , wherein at least one of the trained wide machine learning model and the trained deep machine learning model is trained on the subscriber click history associated with historical articles.

5. The computer-based recommendation system of claim 4 , wherein the subscriber click history comprises a number of clicks.

6. The computer-based recommendation system of claim 4 , wherein the subscriber click history comprises a click history since a last training of the at least one of the trained wide machine learning model and the trained deep machine learning model.

7. The computer-based recommendation system of claim 4 , wherein both the trained wide machine learning model and the trained deep machine learning model are trained on the subscriber click history associated with historical articles.

8. The computer-based recommendation system of claim 1 , wherein the operations further include obtaining the subscriber click history over a time period.

9. The computer-based recommendation system of claim 8 , wherein the time period is at least 45 days.

10. The computer-based recommendation system of claim 1 , wherein at least one of the trained wide machine learning model and the trained deep machine learning model trained on the subscriber click history associated with historical articles is a supervised trained model.

11. The computer-based recommendation system of claim 1 , wherein at least one of the trained wide machine learning model and the trained deep machine learning model trained on the subscriber click history associated with historical articles is an unsupervised trained model.

12. The computer-based recommendation system of claim 1 , wherein the specified time period criteria comprises an elapsed time requirement since the trained wide machine learning model and the trained deep machine learning model were trained.

13. The computer-based recommendation system of claim 12 , wherein the specified time period criteria comprises a sliding window.

14. The computer-based recommendation system of claim 12 , wherein the elapsed time requirement comprises a time period threshold.

15. The computer-based recommendation system of claim 14 , wherein the time period threshold is at least 45 days.

16. The computer-based recommendation system of claim 15 , wherein the time period threshold is at least six months.

17. The computer-based recommendation system of claim 1 , wherein the operations further include retraining or finetuning the trained wide machine learning model and the trained deep machine learning model.

18. The computer-based recommendation system of claim 17 , wherein the trained wide machine learning model and the trained deep machine learning model are retrained or finetuned periodically.

19. The computer-based recommendation system of claim 18 , wherein the trained wide machine learning model and the trained deep machine learning model are retrained or finetuned every hour.

20. The computer-based recommendation system of claim 18 , wherein the trained wide machine learning model and the trained deep machine learning model are retrained or finetuned every five minutes.

21. A computer-based recommendation method comprising:

generating a set of inputs specific to a subscriber and derived from article access records associated with the subscriber;

obtaining a set of current articles published according to specified time period criteria;

creating a feature vector input according to the set of inputs specific to the subscriber and the set of current articles;

generating, via at least one trained wide machine learning model configured to generate a wide ranked article output, a wide ranked article list from a wide model subset of the current articles generated based on the feature vector input and based on a subscriber click history, and having a highest correlation with the article access records;

generating, via at least one trained deep machine learning model configured to generate a deep ranked article output, a deep ranked article list from a deep model subset of the current articles generated based on the feature vector input and based on the subscriber click history, and having a highest correlation with the article access records;

generating a ranked article recommendation output by merging articles from the wide ranked article list and the deep ranked article list; and

displaying the ranked article recommendation output on a user device of the subscriber.

22. A non-transitory computer-readable medium storing computer-executable instructions, the computer-executable instructions comprising:

generating a set of inputs specific to a subscriber and derived from article access records associated with the subscriber;

obtaining a set of current articles published according to specified time period criteria;

creating a feature vector input according to the set of inputs specific to the subscriber and the set of current articles;

generating, via at least one trained wide machine learning model configured to generate a wide ranked article output, a wide ranked article list from a wide model subset of the current articles generated based on the feature vector input and based on a subscriber click history, and having a highest correlation with the article access records;

generating, via at least one trained deep machine learning model configured to generate a deep ranked article output, a deep ranked article list from a deep model subset of the current articles generated based on the feature vector input and based on the subscriber click history, and having a highest correlation with the article access records;

generating a ranked article recommendation output by merging articles from the wide ranked article list and the deep ranked article list; and

displaying the ranked article recommendation output on a user device of the subscriber.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: YANG, PHILLIP; SOON-SHIONG, PATRICK
To: NANTWORKS, LLC
Reel/Frame 068321/0249 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: BALBIEN, JEFFREY MICHAEL; LU, HAO
To: LOS ANGELES TIMES COMMUNICATIONS, LLC
Reel/Frame 068321/0646 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: SONG, BING
To: IMMUNITYBIO, INC.
Reel/Frame 068321/0662 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: LOS ANGELES TIMES COMMUNICATIONS, LLC
To: NANTMEDIA HOLDINGS, LLC
Reel/Frame 068321/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: NANTWORKS, LLC
To: NANTMEDIA HOLDINGS, LLC
Reel/Frame 068321/0704 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: IMMUNITYBIO, INC.
To: NANTMEDIA HOLDINGS, LLC
Reel/Frame 068321/0734 →
Continuity (3)
Continuation 17643881 · Dec 13, 2021
Provisional Application 63125570 · Dec 15, 2020
Related Publication 20240411827A1 · Dec 12, 2024
References Cited (21)
US 10510003B1 · Olabiyi · 2019 [cited by examiner]
US 10679124B1 · Corrado · 2020 [cited by examiner]
US 10938979B1 · Dave et al. · 2021 [cited by applicant]
US 11393036B2 · Wang et al. · 2022 [cited by applicant]
US 20170300814A1 · Shaked et al. · 2017 [cited by applicant]
US 20190050750A1 · Le et al. · 2019 [cited by applicant]
US 20190139092A1 · Nomula · 2019 [cited by applicant]
US 20210097367A1 · Zhang et al. · 2021 [cited by applicant]
US 20220188366A1 · Song et al. · 2022 [cited by applicant]
US 20220197248A1 · Weinberg · 2022 [cited by applicant]
US 20220230226A1 · Shahrasbi · 2022 [cited by examiner]
US 20220398643A1 · Sivakumar · 2022 [cited by examiner]
Wu, F., et al., “Mind: A Large-scale Dataset for News Recommendation,” p. 1-10 (2020). [cited by applicant]
Cheng, H., et al., “Wide & Deep Learning for Recommender Systems,” Jun. 24, 2016, p. 1-4. [cited by applicant]
Le, Q., & Mikolov, T., “Distributed Representations of Sentences and Documents,” Google Inc., May 22, 2014, p. 1-9. [cited by applicant]
Wikipedia, “tf-idf” Aug. 25, 2020, https://en.wikipedia.org/wiki/Tf-idf. [cited by applicant]
Wikipedia, “Okapi BM35”, Aug. 25, 2020, http://en.wikipedia.org/wiki/Okapi_BM25. [cited by applicant]
Reimers, N., & Gurevych, I., “Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks,” Aug. 27, 2019, p. 1-11. [cited by applicant]
Vaswani, A., et al., “Attention is All You Need,” Dec. 6, 2017, p. 1-15. [cited by applicant]
Giorgi, J.M., et al., “DeCLUTR: Deep Contrastive Learing for Unsupervised Textual Representations,” Jun. 11, 2020, pp. 1-22. [cited by applicant]
W. Jing and Y. Bailong (2021). News Text Classification and Recommendation Technology Based on Wide & Deep-Bert Model. IEEE International Conference on Information Communication and Software Engineering (ICICSE), 209-21… [cited by applicant]