IP Library › Granted Patent US 12,353,424
Granted Patent B2
US 12,353,424 · App. 16/935,187 · Granted Jul 8, 2025

Intuitive content search results suggestion system

Inventors: John Trenkle (Albany, CA); Snehal Mistry (Fairfield, CA); Qiang Chen (Beijing, CN); Chang She (San Francisco, CA); Rameen Mahdavi (San Francisco, CA); Marios Assiotis (San Francisco, CA)
Assignee: Tubi, Inc.
G06F16/24578G06F16/248G06F16/26G06F16/288G06N3/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,353,424
App. No.
16/935,187
Granted
Jul 8, 2025
Kind
B2
Abstract

System and methods for intuitive search operation results using machine learning including: identifying a first candidate content item matching a content item search request; identifying a first content item model corresponding to the first candidate content item including word vector collaborative filtering representations of the first candidate content item; identifying a set of content item models where each: is associated with at least one corresponding available content item, and includes word vector collaborative filtering representations; applying deep neural learning to compare the first content item model with the set of content item models to generate a subset of the content item models most relevant to the first content item model; generating a result set of available content items corresponding to the subset of the content item models most relevant to the first content item model; and providing the result set of available content items.

Claims (77)

1. A system for intuitive search operation results using machine learning, the system comprising:

a computer processor;

a content comprehension engine executing on the computer processor and configured to:

receive a content item search request identifying a requested content item, wherein the requested content item has insufficient platform velocity to be classified as a known content item;

search a repository comprising a plurality of known content item models to determine that no known content item model comprising word vector collaborative filtering representations of user engagement with the requested content item is available to the content comprehension engine, wherein each of the plurality of known content item models has sufficient platform velocity to be classified as a known content item;

generate, based on determining that no known content item model is available, an unknown content item model corresponding to the requested content item using a set of input embeddings of an unknown content embedding space generated based on content metadata and contextual content data associated with the requested content item;

execute a deep neural machine learning model configured to project from the unknown content embedding space to a known content embedding space by:

providing the set of input embeddings as inputs to the deep neural machine learning model;

generating a set of output embeddings representing collaborative filtering representations of anticipated user engagement with the requested content item in the known content embedding space;

perform a relevance search using the set of output embeddings to identify a subset of the plurality of known content item models based on a match strength of each of the plurality of known content item models with the content item search request, wherein each of the subset of the plurality of known content item models:

is associated with at least one corresponding available content item, and

includes word vector collaborative filtering representations of sufficient real user engagement with the associated at least one corresponding available content item in the known content embedding space; and

provide a result set comprising the corresponding available content items of the identified subset of the plurality of known content item models in response to the content item search request, wherein the result set is displayed in a user interface element of a client device ordered according to the match strength of each of the subset of the plurality of known content item models.

2. The system of claim 1 , wherein performing the relevance search further comprises:

querying the repository comprising the plurality of known content item models;

ranking, based on the output embeddings, the plurality of known content item models by relevance using a ranking criteria; and

selecting the subset of the plurality of known content item models as being most relevant to the unavailable content item model based on the ranking.

3. The system of claim 2 , wherein the ranking criteria comprises at least one selected from a group consisting of relevancy, temporal relevancy, similarity, popularity, value, promotional status, requesting account demographics, requesting account preferences, and requesting account past behavior.

4. The system of claim 1 , wherein:

generating the result set comprises including content tier information corresponding to each available content item in the result set for use in arranging a display of the available content items according to content tier.

5. The system of claim 1 , wherein the content comprehension engine is further configured to:

utilize the output embeddings to determine a set of content tiers most relevant to the unknown content item model, wherein providing the result set comprises including the set of content tiers for display.

6. The system of claim 1 , wherein the result set of available content items comprises at least one content item of a different type from a type of the requested content item.

7. A method for intuitive search operation results using machine learning, the method comprising:

receiving a content item search request identifying a requested content item, wherein the requested content item has insufficient platform velocity to be classified as a known content item;

searching a repository comprising a plurality of known content item models to determine that no known content item model comprising word vector collaborative filtering representations of user engagement with the requested content item is available to the content comprehension engine, wherein each of the plurality of known content item models has sufficient platform velocity to be classified as a known content item;

generating, by at least one computer processor and based on determining that no known content item model is available, an unknown content item model corresponding to the requested content item using a set of input embeddings of an unknown content embedding space generated based on content metadata and contextual content data associated with the requested content item;

executing, by the at least one computer processor, a deep neural machine learning model configured to project from the unknown content embedding space to a known content embedding space by:

providing the set of input embeddings as inputs to the deep neural machine learning model;

generating a set of output embeddings representing collaborative filtering representations of anticipated user engagement with the requested content item in the known content embedding space;

performing a relevance search using the set of output embeddings to identify a subset of the plurality of known content item models based on a match strength of each of the plurality of known content item models with the content item search request, wherein each of the subset of the plurality of known content item models:

is associated with at least one corresponding available content item, and

includes word vector collaborative filtering representations of sufficient real user engagement with the associated at least one corresponding available content item in the known content embedding space; and

providing a result set comprising the corresponding available content items of the identified subset of the plurality of known content item models in response to the content item search request, wherein the result set is displayed in a user interface element of a client device ordered according to the match strength of each of the subset of the plurality of known content item models.

8. The method of claim 7 , wherein performing the relevance search further comprises:

querying the repository comprising the plurality of known content item models;

ranking, based on the output embeddings, the plurality of known content item models by relevance using a ranking criteria; and

selecting the subset of the plurality of known content item models as being most relevant to the unavailable content item model based on the ranking.

9. The method of claim 8 , wherein the ranking criteria comprises at least one selected from a group consisting of relevancy, temporal relevancy, similarity, popularity, value, promotional status, requesting account demographics, requesting account preferences, and requesting account past behavior.

10. The method of claim 7 , wherein:

generating the result set comprises including content tier information corresponding to each available content item in the result set for use in arranging a display of the available content items according to content tier.

11. The method of claim 7 , further comprising:

utilizing the output embeddings to determine a set of content tiers most relevant to the unknown content item model, wherein providing the result set comprises including the set of content tiers for display.

12. The method of claim 7 , wherein the result set of available content items comprises at least one content item of a different type from a type of the requested content item.

13. A non-transitory computer-readable storage medium comprising a plurality of instructions for intuitive search operation results using machine learning, the plurality of instructions configured to execute on at least one computer processor to enable the at least one computer processor to:

receive a content item search request identifying a requested content item, wherein the requested content item has insufficient platform velocity to be classified as a known content item;

search a repository comprising a plurality of known content item models to determine that no known content item model comprising word vector collaborative filtering representations of user engagement with the requested content item is available to the content comprehension engine, wherein each of the plurality of known content item models has sufficient platform velocity to be classified as a known content item;

generate, based on determining that no known content item model is available, an unknown content item model corresponding to the requested content item using a set of input embeddings of a unknown content embedding space generated based on content metadata and contextual content data associated with the requested content item;

execute a deep neural machine learning model configured to project from the unknown content embedding space to a known content embedding space by:

providing the set of input embeddings as inputs to the deep neural machine learning model;

generating a set of output embeddings representing collaborative filtering representations of anticipated user engagement with the requested content item in the known content embedding space;

perform a relevance search using the set of output embeddings to identify a subset of the plurality of known content item models based on a match strength of each of the plurality of known content item models with the content item search request, wherein each of the subset of the plurality of known content item models:

is associated with at least one corresponding available content item, and

includes word vector collaborative filtering representations of sufficient real user engagement with the associated at least one corresponding available content item in the known content embedding space; and

provide a result set comprising the corresponding available content items of the identified subset of the plurality of known content item models in response to the content item search request, wherein the result set is displayed in a user interface element of a client device ordered according to the match strength of each of the subset of the plurality of known content item models.

14. The non-transitory computer-readable storage medium of claim 13 , wherein performing the relevance search further comprises:

querying the repository comprising the plurality of known content item models;

ranking, based on the output embeddings, the plurality of known content item models by relevance using a ranking criteria; and

selecting the subset of the plurality of known content item models as being most relevant to the unavailable content item model based on the ranking.

15. The system of claim 1 , wherein content comprehension engine is further configured to:

identify, after providing the result set, real user engagement with the requested content item;

determine that the sufficient platform velocity of user engagement is met based on the real user engagement;

generate a set of warm-start characteristics using the real user engagement;

receive a second content item search request identifying the requested content item; and

provide (i) the set of warm-start characteristics and (ii) the set of input embeddings as inputs to a second execution of the deep neural machine learning model to generate a second set of output embeddings, wherein the second set of output embeddings are used to perform a second relevance search.

16. The method of claim 7 , further comprising:

identifying, after providing the result set, real user engagement with the requested content item;

determining that the sufficient platform velocity of user engagement is met based on the real user engagement;

generating a set of warm-start characteristics using the real user engagement;

receiving a second content item search request identifying the requested content item; and

providing (i) the set of warm-start characteristics and (ii) the set of input embeddings as inputs to a second execution of the deep neural machine learning model to generate a second set of output embeddings, wherein the second set of output embeddings are used to perform a second relevance search.

17. The non-transitory computer-readable storage medium of claim 13 , wherein the plurality of instructions are further configured to execute on the at least one computer processor to enable the at least one computer processor to:

identify, after providing the result set, real user engagement with the requested content item;

determine that the sufficient platform velocity of user engagement is met based on the real user engagement;

generate a set of warm-start characteristics using the real user engagement; and

receive a second content item search request identifying the requested content item;

provide (i) the set of warm-start characteristics and (ii) the set of input embeddings as inputs to a second execution of the deep neural machine learning model to generate a second set of output embeddings, wherein the second set of output embeddings are used to perform a second relevance search.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2020
From: TRENKLE, JOHN; MISTRY, SNEHAL; CHEN, QIANG; SHE, CHANG; MAHDAVI, RAMEEN; ASSIOTIS, MARIOS
To: TUBI, INC.
Reel/Frame 053272/0869 →
Continuity (1)
Related Publication 20220027373A1 · Jan 27, 2022
References Cited (83)
US 8776111B1 · Eldering et al. · 2014 [cited by applicant]
US 9215123B1 · Fears et al. · 2015 [cited by applicant]
US 9230212B2 · Su · 2016 [cited by examiner]
US 9277275B1 · Arini · 2016 [cited by applicant]
US 9465604B1 · Burgyan et al. · 2016 [cited by applicant]
US 9563928B1 · Sokolowski et al. · 2017 [cited by applicant]
US 11004135B1 · Sandler · 2021 [cited by applicant]
US 20010020255A1 · Hofmann et al. · 2001 [cited by applicant]
US 20020129368A1 · Schlack et al. · 2002 [cited by applicant]
US 20020178126A1 · Beck et al. · 2002 [cited by applicant]
US 20030235184A1 · Dorenbosch et al. · 2003 [cited by applicant]
US 20050101321A1 · Ikeda et al. · 2005 [cited by applicant]
US 20050177835A1 · Chickering · 2005 [cited by applicant]
US 20060075019A1 · Donovan et al. · 2006 [cited by applicant]
US 20060253323A1 · Phan et al. · 2006 [cited by applicant]
US 20070233671A1 · Oztekin et al. · 2007 [cited by applicant]
US 20080082604A1 · Mansour et al. · 2008 [cited by applicant]
US 20080259906A1 · Shkedi · 2008 [cited by applicant]
US 20090006214A1 · Lerman · 2009 [cited by applicant]
US 20090064301A1 · Sachdeva · 2009 [cited by applicant]
US 20090089161A1 · Alo et al. · 2009 [cited by applicant]
US 20090106785A1 · Pham · 2009 [cited by applicant]
US 20090129479A1 · Yellamraju · 2009 [cited by applicant]
US 20090204478A1 · Kaib et al. · 2009 [cited by applicant]
US 20100151816A1 · Besehanic et al. · 2010 [cited by applicant]
US 20100211967A1 · Ramaswamy et al. · 2010 [cited by applicant]
US 20100246981A1 · Hu et al. · 2010 [cited by applicant]
US 20110040636A1 · Simmons et al. · 2011 [cited by applicant]
US 20110093335A1 · Fordyce et al. · 2011 [cited by applicant]
US 20110103374A1 · LaJoie et al. · 2011 [cited by applicant]
US 20110113116A1 · Burdette et al. · 2011 [cited by applicant]
US 20110125594A1 · Brown et al. · 2011 [cited by applicant]
US 20110167440A1 · Greenfield · 2011 [cited by applicant]
US 20110219229A1 · Cholas et al. · 2011 [cited by applicant]
US 20110246298A1 · Williams et al. · 2011 [cited by applicant]
US 20110252305A1 · Tschani et al. · 2011 [cited by applicant]
US 20110258049A1 · Ramer et al. · 2011 [cited by applicant]
US 20120007866A1 · Tahan · 2012 [cited by applicant]
US 20120016655A1 · Travieso · 2012 [cited by applicant]
US 20120029983A1 · Rodriguez et al. · 2012 [cited by applicant]
US 20120089455A1 · Belani et al. · 2012 [cited by applicant]
US 20120102169A1 · Yu et al. · 2012 [cited by applicant]
US 20120151079A1 · Besehanic et al. · 2012 [cited by applicant]
US 20130110634A1 · Cochran et al. · 2013 [cited by applicant]
US 20130132856A1 · Binyamin et al. · 2013 [cited by applicant]
US 20130156269A1 · Matsui et al. · 2013 [cited by applicant]
US 20130198376A1 · Anda et al. · 2013 [cited by applicant]
US 20130268951A1 · Wyatt et al. · 2013 [cited by applicant]
US 20130311649A1 · DeFrancesco et al. · 2013 [cited by applicant]
US 20130346202A1 · Kouladjie · 2013 [cited by applicant]
US 20140075014A1 · Chourey · 2014 [cited by applicant]
US 20140101739A1 · Li et al. · 2014 [cited by applicant]
US 20140143052A1 · Stryker · 2014 [cited by applicant]
US 20140157289A1 · Aarts et al. · 2014 [cited by applicant]
US 20140181121A1 · Nice · 2014 [cited by applicant]
US 20140181243A1 · Nieuwenhuys · 2014 [cited by applicant]
US 20140282642A1 · Needham et al. · 2014 [cited by applicant]
US 20140372415A1 · Fernandez-Ruiz · 2014 [cited by applicant]
US 20140379911A1 · Fayssal et al. · 2014 [cited by applicant]
US 20150206198A1 · Marshall · 2015 [cited by applicant]
US 20150234564A1 · Snibbe et al. · 2015 [cited by applicant]
US 20150271540A1 · Melby et al. · 2015 [cited by applicant]
US 20150382075A1 · Neumeier et al. · 2015 [cited by applicant]
US 20160358209A1 · Khozani et al. · 2016 [cited by applicant]
US 20160360289A1 · Santoro et al. · 2016 [cited by applicant]
US 20170064411A1 · Goli et al. · 2017 [cited by applicant]
US 20170132510A1 · Paluri · 2017 [cited by examiner]
US 20170171580A1 · Hirsch · 2017 [cited by examiner]
US 20170193390A1 · Weston · 2017 [cited by examiner]
US 20180121799A1 · Hashimoto et al. · 2018 [cited by applicant]
US 20180189570A1 · Paluri · 2018 [cited by applicant]
US 20190034976A1 · HAmedi et al. · 2019 [cited by applicant]
US 20190065589A1 · Wen et al. · 2019 [cited by applicant]
US 20200004886A1 · Ramanath · 2020 [cited by examiner]
US 20200019561A1 · Doyle · 2020 [cited by examiner]
CN 110769288A · 2020 [cited by applicant]
CN 110837578B · 2021 [cited by applicant]
WO 2018148493A1 · 2018 [cited by applicant]
WO WO2018236732A1 · 2018 [cited by examiner]
WO 2019231559A1 · 2019 [cited by applicant]
Deldjoo. “Movie genome: alleviating new item cold start inmovie recommendation” 291-343.Springer Nature. Web. URL: https://link.springer.com/article/10.1007/s 11257-019-09221-y. Feb. 26, 2019; Entire Document. [cited by applicant]
International Search Report and Written Opinion received in PCT/US21/42452, mailed on Jan. 19, 2022 (14 pages). [cited by applicant]
Shankar et al. “Deep Learning based Large Scale Visual Recommendation and Search for E-Commerce.” 1-9, 2017. [cited by applicant]