IP Library Granted Patent US 12,339,918
Granted Patent B2
US 12,339,918 · App. 18/988,223 · Granted Jun 24, 2025

Combined wide and deep machine learning models for automated database element processing systems, methods and apparatuses

Inventors: Bing Song (La Canada, CA); Jeffrey Michael Balbien (Los Angeles, CA); Hao Lu (Los Angeles, CA); Phillip Yang (Los Angeles, CA); Patrick Soon-Shiong (Los Angeles, CA)
Assignee: NantMedia Holdings, LLC
G06F16/9535G06F40/284G06F40/40G06N3/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,339,918
App. No.
18/988,223
Granted
Jun 24, 2025
Kind
B2
Abstract

A method of automated database element processing includes training a wide machine learning model with historical feature vector inputs to generate a wide ranked element output. The method includes training a deep machine learning model with the historical feature vector inputs to generate a deep ranked element output. The method includes generating a set of inputs specific to an individual entity, obtaining a set of current article database elements, and creating a feature vector input according to the set of inputs and the set of current article database elements. The method includes processing the feature vector input with the wide machine learning model to generate a wide ranked element list, processing the feature vector input with the deep machine learning model to generate a deep ranked element list, and merging database elements of the wide and deep ranked element lists to generate a ranked element recommendation output.

Claims (45)

1. A computer-based roadblock article recommendation system comprising:

at least one computer readable non-transitory memory storing computer-executable instructions; and

at least one processor coupled with the at least one computer readable non-transitory memory and that executes the following operations upon execution of the computer-executable instructions:

generating a set of inputs specific to a subscriber, the set of inputs derived from article access records associated with the subscriber;

obtaining a set of candidate roadblock articles;

creating a feature vector input according to the set of inputs specific to the subscriber and the set of candidate roadblock articles;

processing the feature vector input using at least one trained machine learning model to generate a wide and deep merged ranked list of roadblock articles;

selecting a roadblock article from the wide and deep merged ranked list of roadblock articles;

generating a roadblock link for the selected roadblock article; and

inserting the roadblock link within a target article.

2. The computer-based roadblock article recommendation system of claim 1 , wherein the at least one trained machine learning model comprises a wide machine learning model or a deep machine learning model.

3. The computer-based roadblock article recommendation system of claim 2 , wherein the wide machine learning model comprises a term frequency-inverse document frequency (TFIDF) model or a best matching (BM25) model.

4. The computer-based roadblock article recommendation system of claim 2 , wherein the deep machine learning model comprises a Doc2Vec model or a deep contrastive learning (DECLUTR) model.

5. The computer-based roadblock article recommendation system of claim 1 , wherein the operations further include determining a location within the target article to insert the roadblock link.

6. The computer-based roadblock article recommendation system of claim 5 , wherein determining the location is based on a ranking of areas where a reader is more likely to look while reading the target article.

7. The computer-based roadblock article recommendation system of claim 1 , wherein the operations further include automatically generating content associated with the selected roadblock article or the roadblock link.

8. The computer-based roadblock article recommendation system of claim 7 , wherein automatically generating the content comprises using a generative pre-trained transformer (GPT) model.

9. The computer-based roadblock article recommendation system of claim 1 , wherein the operations further including automatically generating a description for the roadblock link.

10. The computer-based roadblock article recommendation system of claim 1 , wherein the set of inputs specific to the subscriber includes at least one of a geolocation, a device type, a sex, an age, a time, or a day.

11. The computer-based roadblock article recommendation system of claim 1 , wherein the article access records include at least one of a number of clicks on each article or an amount of time spent viewing each article.

12. The computer-based roadblock article recommendation system of claim 1 , wherein the operations further including retraining the at least one trained machine learning model periodically.

13. The computer-based roadblock article recommendation system of claim 12 , wherein the at least one trained machine learning model is retrained at least hourly.

14. The computer-based roadblock article recommendation system of claim 1 , wherein the set of candidate roadblock articles is obtained from articles published within a specified time period.

15. The computer-based roadblock article recommendation system of claim 1 , wherein the operations further includes inserting the roadblock link based on a template.

16. The computer-based roadblock article recommendation system of claim 1 , wherein the operations further includes generating multiple roadblock links for insertion within the target article.

17. The computer-based roadblock article recommendation system of claim 1 , wherein the roadblock link comprises a promotional article link or an advertisement.

18. The computer-based roadblock article recommendation system of claim 1 , wherein the at least one trained machine learning model is trained on historical article items.

19. The computer-based roadblock article recommendation system of claim 18 , wherein the historical article items are historical article items related to the subscriber.

20. The computer-based roadblock article recommendation system of claim 1 , wherein the operations further include generating roadblock link recommendations that include content opposing what the subscriber normally views thereby combating self-imposed filter bubbles.

21. A computer-based method comprising:

generating a set of inputs specific to a subscriber, the set of inputs derived from article access records associated with the subscriber;

obtaining a set of candidate roadblock articles;

creating a feature vector input according to the set of inputs specific to the subscriber and the set of candidate roadblock articles;

processing the feature vector input using at least one trained machine learning model to generate a wide and deep merged ranked list of roadblock articles;

selecting a roadblock article from the wide and deep merged ranked list of roadblock articles;

generating a roadblock link for the selected roadblock article; and

inserting the roadblock link within a target article.

22. A non-transitory computer-readable media comprising instructions which, when executed by at least one processor, cause the at least one processor to execute the following operations:

generating a set of inputs specific to a subscriber, the set of inputs derived from article access records associated with the subscriber;

obtaining a set of candidate roadblock articles;

creating a feature vector input according to the set of inputs specific to the subscriber and the set of candidate roadblock articles;

processing the feature vector input using at least one trained machine learning model to generate a wide and deep merged ranked list of roadblock articles;

selecting a roadblock article from the wide and deep merged ranked list of roadblock articles;

generating a roadblock link for the selected roadblock article; and

inserting the roadblock link within a target article.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: YANG, PHILLIP; SOON-SHIONG, PATRICK
To: NANTWORKS, LLC
Reel/Frame 069666/0660 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: BALBIEN, JEFFREY MICHAEL; LU, HAO
To: LOS ANGELES TIMES COMMUNICATIONS, LLC
Reel/Frame 069666/0785 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: SONG, BING
To: IMMUNITYBIO, INC.
Reel/Frame 069666/0804 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: LOS ANGELES TIMES COMMUNICATIONS, LLC
To: NANTMEDIA HOLDINGS, LLC
Reel/Frame 069666/0886 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: NANTWORKS, LLC
To: NANTMEDIA HOLDINGS, LLC
Reel/Frame 069666/0896 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2024
From: IMMUNITYBIO, INC.
To: NANTMEDIA HOLDINGS, LLC
Reel/Frame 069666/0938 →
Continuity (4)
Continuation 18807634 · Aug 16, 2024
Continuation 17643881 · Dec 13, 2021
Provisional Application 63125570 · Dec 15, 2020
Related Publication 20250131055A1 · Apr 24, 2025
References Cited (23)
US 10762422B2 · Shaked · 2020 [cited by examiner]
US 10938979B1 · Dave et al. · 2021 [cited by applicant]
US 11210583B2 · Mathew · 2021 [cited by examiner]
US 11393036B2 · Wang · 2022 [cited by examiner]
US 11716400B2 · Harish · 2023 [cited by examiner]
US 20170300814A1 · Shaked et al. · 2017 [cited by applicant]
US 20190050750A1 · Le et al. · 2019 [cited by applicant]
US 20190139092A1 · Nomula · 2019 [cited by applicant]
US 20210097367A1 · Zhang et al. · 2021 [cited by applicant]
US 20220188366A1 · Song et al. · 2022 [cited by applicant]
US 20220197248A1 · Weinberg · 2022 [cited by applicant]
US 20220230226A1 · Shahrasbi et al. · 2022 [cited by applicant]
US 20220398643A1 · Sivakumar et al. · 2022 [cited by applicant]
US 20240411827A1 · Song et al. · 2024 [cited by applicant]
Wu, F., et al., “MIND: A Large-scale Dataset for News Recommendation,” p. 1-10 (2020). [cited by applicant]
Cheng, H., et al., “Wide & Deep Learning for Recommender Systems,” Jun. 24, 2016, p. 1-4. [cited by applicant]
Le, Q., & Mikolov, T., “Distributed Representations of Sentences and Documents,” Google Inc., May 22, 2014, p. 1-9. [cited by applicant]
Wikipedia, “tf-idf” Aug. 25, 2020, https://en.wikipedia.org/wiki/Tf-idf. [cited by applicant]
Wikipedia, “Okapi BM25”, Aug. 25, 2020, http://en.wikipedia.org/wiki/Okapi_BM25. [cited by applicant]
Reimers, N., & Gurevych, I., “Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks,” Aug. 27, 2019, p. 1-11. [cited by applicant]
Vaswani, A., et al., “Attention is All You Need,” Dec. 6, 2017, p. 1-15. [cited by applicant]
Giorgi, J.M., et al., “DeCLUTR: Deep Contrastive Learing for Unsupervised Textual Representations,” Jun. 11, 2020, pp. 1-22. [cited by applicant]
W. Jing and Y. Bailong (2021). News Text Classification and Recommendation Technology Based on Wide & Deep-Bert Model. IEEE International Conference on Information Communication and Software Engineering (ICICSE), 209-21… [cited by applicant]