IP Library › Granted Patent US 12,222,988
Granted Patent B2
US 12,222,988 · App. 18/359,790 · Granted Feb 11, 2025

Machine-learning system for servicing queries for digital content

Inventors: Steven Hicklin (York, GB); Noushin Rezapour Asheghi (Atlanta, GA)
Assignee: EQUIFAX INC.
G06F16/90344G06F16/9035G06F16/906G06F40/30G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,222,988
App. No.
18/359,790
Granted
Feb 11, 2025
Kind
B2
Abstract

In some aspects, a content-extraction system can receive a query from a client device and generate a result set of digital content responsive to the query. For instance, the content-extraction system can obtain, from a search system, a set of digital content matching one or more keywords. The content-extraction system can exclude digital content items lacking core content, digital content items with duplicative content, or both. In some aspects, the content-extraction system can determine, for one or more remaining digital content items, a content attribute score. The content-extraction system can select, as the result set of digital content, a subset of digital content based on the content attribute scores. The content-extraction system can output the result set to the client device.

Claims (90)

1. A computing system comprising:

a client device configured to transmit a search query regarding an entity to a query system;

a search computing device configured to:

search a digital dataset based on keywords to determine a set of digital content, each digital content item in the set of digital content including one or more keywords identified from the search query, and

transmit the set of digital content to the query system; and

the query system communicatively coupled, via a data network, to the client device and the search computing device, the query system positioned remotely from the client device and between the client device and the search computing device, the query system comprising:

a non-transitory computer-readable medium storing program code; and

one or more processing devices communicatively coupled to the non-transitory computer-readable medium, the one or more processing devices configured to execute the program code to perform operations comprising:

receiving, from the client device, the query regarding the entity, wherein the query includes a request for documents with a certain sentiment regarding the entity,

creating a result set of digital content from the set of digital content, wherein creating the result set of digital content comprises:

obtaining, from the search computing device, the set of digital content,

generating, based on one or more machine-learning models, a reduced set of digital content by removing non-core content and duplicates from the set of digital content,

executing a content-attribute machine-learning model for each digital content item in the reduced set of digital content to determine a sentiment score based on a respective portion of each digital content item in the set of digital content, and

selecting, as the result set of digital content, a subset of digital content from the set of digital content, wherein the subset of digital content is selected based on the sentiment score determined for each digital content item in the set of digital content being above a threshold value associated with the certain sentiment, and

transmitting, to the client device, a message configured for providing the client device with access to the result set of digital content.

2. The computing system of claim 1 , wherein obtaining the set of digital content comprises:

obtaining, from the query, a name of the entity;

matching the name of the entity to names of individuals associated with the entity;

identifying a user preference specified via input from the client device;

determining the one or more keywords based on the name of the entity, the names of individuals associated with the entity, and the user preference;

transmitting, to the search computing device, a keyword query having the one or more keywords; and

receiving the set of digital content from the search computing device that match the one or more keywords.

3. The computing system of claim 1 , wherein executing the content-attribute machine-learning model for each digital content item comprises:

performing a sentiment analysis on a portion of each digital content item to determine a sentiment of the portion; and

determining, for each digital content item in the set of digital content, the sentiment score based on the sentiment of the portion and a location of the one or more keywords in the digital content item.

4. The computing system of claim 1 , wherein the one or more machine-learning models comprise a classification machine-learning model and wherein generating the reduced set of digital content further comprises:

executing the classification machine learning model for the set of digital content to extract core content from each digital content item in the set of digital content, wherein the classification machine learning model comprises a neural network model that comprises one or more hidden layers of interconnected nodes and is configured to identify core content from the digital content item using features comprising one or more of lexical features, text statistics, or relative position of text blocks; and

removing, from the set of digital content, content identified as non-core content.

5. The computing system of claim 4 , wherein extracting the core content from each digital content item comprises:

applying a machine-learning model to each digital content item that identifies the core content and non-core content in each digital content item; and

removing, from each digital content item, the non-core content.

6. The computing system of claim 4 , wherein determining the sentiment score comprises applying the content-attribute machine-learning model to the core content of each digital content item of the set of digital content.

7. The computing system of claim 1 , wherein generating the reduced set of digital content comprises:

tokenizing (i) a first digital content item in the set of digital content and (ii) a second digital content item in the set of digital content,

determining an amount of duplicate data between the tokenized first digital content item in the set of digital content and the tokenized second digital content item in the set of digital content, and

modifying the set of digital content by removing the first digital content item from the set of digital content based on the amount of duplicate data exceeding a threshold amount.

8. A method comprising:

receiving, by a content-extraction system and from a client device, a query regarding an entity, the content-extraction system positioned remotely from the client device and between the client device and a search computing device that is configured to search a digital dataset based on keywords, wherein the query includes a request for documents with a certain sentiment regarding the entity;

creating, by the content-extraction system, a result set of digital content responsive to the query, wherein creating the result set of digital content comprises:

obtaining, from the search computing device, a set of digital content, each digital content item in the set of digital content including one or more keywords identified from the query,

generating, based on one or more machine-learning models, a reduced set of digital content by removing non-core content and duplicates from the set of digital content,

executing, a content-attribute machine-learning model for each digital content item in the reduced set of digital content to determine a sentiment score based on a respective portion of each digital content item in the reduced set of digital content, and

selecting, as the result set of digital content, a subset of digital content from the reduced set of digital content, wherein the subset of digital content is selected based on the sentiment score determined for each digital content item in the reduced set of digital content; and

transmitting, by the content-extraction system, the result set of digital content to the client device.

9. The method of claim 8 , wherein obtaining the set of digital content comprises:

obtaining, from the query, a name of the entity;

matching the name of the entity to names of individuals associated with the entity;

identifying a user preference specified via input received by the content-extraction system from the client device;

determining the one or more keywords based on the name of the entity, the names of individuals associated with the entity, and the user preference;

transmitting, to the search computing device, a keyword query having the one or more keywords; and

receiving the set of digital content from the search computing device that match the one or more keywords.

10. The method of claim 8 , wherein executing the content-attribute machine-learning model for each digital content item comprises:

performing a sentiment analysis on a portion of each digital content item to determine a sentiment of the portion; and

determining, for each digital content item in the set of digital content, a sentiment score based on the sentiment of the portion and a location of the one or more keywords in the digital content item.

11. The method of claim 8 , wherein the one or more machine-learning models comprises a classification machine learning model and wherein generating the reduced set of digital content comprises:

executing the classification machine-learning model for the set of digital content to extract core content from each digital content item in the set of digital content, wherein the classification machine-learning model comprises a neural network model that comprises one or more hidden layers of interconnected nodes and is configured to identify core content from the digital content item using features comprising one or more of lexical features, text statistics, or relative position of text blocks; and

removing, from the set of digital content, content identified as non-core content.

12. The method of claim 11 , wherein extracting the core content from each digital content item comprises:

applying a machine-learning model to each digital content item that identifies the core content and non-core content in each digital content item; and

removing, from each digital content item, the non-core content.

13. The method of claim 11 , wherein determining the sentiment score comprises applying the content-attribute machine-learning model to the core content of each digital content item of the set of digital content.

14. The method of claim 8 , wherein generating the reduced set of digital content comprises:

tokenizing (i) a first digital content item in the set of digital content and (ii) a second digital content item in the set of digital content,

determining an amount of duplicate data between the tokenized first digital content item in the set of digital content and the tokenized second digital content item in the set of digital content, and

modifying the set of digital content by removing the first digital content item from the set of digital content based on the amount of duplicate data exceeding a threshold amount.

15. A non-transitory computer-readable medium having program code stored thereon, wherein the program code, when executed by one or more processing devices of a filtering system, configures the filtering system to perform operations comprising:

receiving, from a client device, a query regarding an entity, wherein the filtering system positioned remotely from the client device and between the client device and a search computing device that is configured to search a digital dataset based on keywords and wherein the query includes a request for documents with a certain sentiment regarding the entity;

creating a result set of digital content responsive to the query, wherein creating the result set of digital content comprises:

obtaining, from the search computing device, a set of digital content, each digital content item in the set of digital content including one or more keywords identified from the query,

generating, based on one or more machine-learning models, a reduced set of digital content by removing non-core content and duplicates from the set of digital content,

executing a content-attribute machine-learning model for each digital content item in the reduced set of digital content to determine a sentiment score based on a respective portion of each digital content item in the reduced set of digital content, and

selecting, as the result set of digital content, a subset of digital content from the reduced set of digital content, wherein the subset of digital content is selected based on the sentiment score determined for each digital content item in the reduced set of digital content; and

transmitting to the client device the result set of digital content.

16. The non-transitory computer-readable medium of claim 15 , wherein obtaining the set of digital content comprises:

obtaining, from the query, a name of the entity;

matching the name of the entity to names of individuals associated with the entity;

identifying a user preference specified via input received from the client device;

determining the one or more keywords based on the name of the entity, the names of individuals associated with the entity, and the user preference;

transmitting, to the search computing device, a keyword query having the one or more keywords; and

receiving the set of digital content from the search computing device that match the one or more keywords.

17. The non-transitory computer-readable medium of claim 15 , wherein executing the content-attribute machine-learning model for each digital content item comprises:

performing a sentiment analysis on a portion of each digital content item to determine a sentiment of the portion; and

determining, for each digital content item in the set of digital content, a respective value of the sentiment score based on the sentiment of the portion and a location of the one or more keywords in the digital content item.

18. The non-transitory computer-readable medium of claim 15 , wherein the one or more machine-learning models comprises a classification machine-learning model and wherein generating the reduced set of digital content comprises:

executing the classification machine-learning model for the set of digital content to extract core content from each digital content item in the set of digital content, wherein the classification machine-learning model comprises a neural network model that comprises one or more hidden layers of interconnected nodes and is configured to identify core content from the digital content item using features comprising one or more of lexical features, text statistics, or relative position of text blocks; and

removing, from the set of digital content, content identified as non-core content.

19. The non-transitory computer-readable medium of claim 18 , wherein extracting the core content from each digital content item comprises:

applying a machine-learning model to each digital content item that identifies the core content and non-core content in each digital content item; and

removing, from each digital content item, the non-core content.

20. The non-transitory computer-readable medium of claim 18 , wherein determining the sentiment score comprises applying the content-attribute machine-learning model to the core content of each digital content item of the set of digital content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2024
From: HICKLIN, STEVEN; ASHEGHI, NOUSHIN REZAPOUR
To: EQUIFAX INC.
Reel/Frame 066543/0474 →
Continuity (3)
Continuation 16623724
Provisional Application 62521825 · Jun 19, 2017
Related Publication 20230367821A1 · Nov 16, 2023
References Cited (58)
US 5649193A · Sumita et al. · 1997 [cited by applicant]
US 6801906B1 · Bates et al. · 2004 [cited by applicant]
US 6978419B1 · Kantrowitz · 2005 [cited by applicant]
US 7809695B2 · Conrad et al. · 2010 [cited by applicant]
US 7895225B1 · Thirumalai et al. · 2011 [cited by applicant]
US 7945600B1 · Thomas et al. · 2011 [cited by applicant]
US 8447722B1 · Ahuja et al. · 2013 [cited by applicant]
US 9009162B1 · Luo · 2015 [cited by applicant]
US 9026516B1 · Chapin et al. · 2015 [cited by applicant]
US 9916383B1 · Ching · 2018 [cited by applicant]
US 11748416B2 · Hicklin et al. · 2023 [cited by applicant]
US 20020099700A1 · Li · 2002 [cited by applicant]
US 20050027631A1 · McAtee · 2005 [cited by applicant]
US 20050060311A1 · Tong et al. · 2005 [cited by applicant]
US 20070276829A1 · Wang et al. · 2007 [cited by applicant]
US 20080010276A1 · Morton et al. · 2008 [cited by applicant]
US 20080215546A1 · Baum et al. · 2008 [cited by applicant]
US 20080263023A1 · Vailaya et al. · 2008 [cited by applicant]
US 20080263032A1 · Vailaya et al. · 2008 [cited by applicant]
US 20080263033A1 · Vailaya et al. · 2008 [cited by applicant]
US 20100082570A1 · Altaf et al. · 2010 [cited by applicant]
US 20100114899A1 · Guha et al. · 2010 [cited by applicant]
US 20100287033A1 · Mathur · 2010 [cited by applicant]
US 20110178995A1 · Suchter et al. · 2011 [cited by applicant]
US 20110202522A1 · Ciemiewicz et al. · 2011 [cited by applicant]
US 20120005200A1 · Lawrence · 2012 [cited by applicant]
US 20120197934A1 · Zhang et al. · 2012 [cited by applicant]
US 20130024448A1 · Herbrich et al. · 2013 [cited by applicant]
US 20130254209A1 · Kang · 2013 [cited by applicant]
US 20140136509A1 · Kritt et al. · 2014 [cited by applicant]
US 20140201154A1 · Varadharajan et al. · 2014 [cited by applicant]
US 20140201203A1 · Krishna et al. · 2014 [cited by applicant]
US 20140222791A1 · Childress et al. · 2014 [cited by applicant]
US 20150058344A1 · Bhatia et al. · 2015 [cited by applicant]
US 20150088894A1 · Czarlinska et al. · 2015 [cited by applicant]
US 20150154660A1 · Weald et al. · 2015 [cited by applicant]
US 20160004703A1 · Angaluri et al. · 2016 [cited by applicant]
US 20160342591A1 · Zholudev et al. · 2016 [cited by applicant]
US 20160364608A1 · Sengupta et al. · 2016 [cited by applicant]
US 20170017724A1 · Macgillivray et al. · 2017 [cited by applicant]
US 20170075538A1 · Park et al. · 2017 [cited by applicant]
US 20170139814A1 · Chau et al. · 2017 [cited by applicant]
US 20170139939A1 · Rougier · 2017 [cited by applicant]
US 20170220650A1 · Tsai · 2017 [cited by applicant]
US 20170344636A1 · Barajas Gonzalez et al. · 2017 [cited by applicant]
US 20180018564A1 · Erenrich et al. · 2018 [cited by applicant]
US 20180114060A1 · Lozano et al. · 2018 [cited by applicant]
US 20180203915A1 · Marshall et al. · 2018 [cited by applicant]
US 20210081499A1 · Rakshit et al. · 2021 [cited by applicant]
Canadian Application No. CA3,067,326, Office Action, Mailed On Oct. 12, 2023, 6 pages. [cited by applicant]
European Application No. EP18821512.3, Office Action, Mailed On Jan. 25, 2024, 6 pages. [cited by applicant]
U.S. Appl. No. 16/623,724, Final Office Action mailed on May 23, 2022, 13 pages. [cited by applicant]
U.S. Appl. No. 16/623,724, Non-Final Office Action mailed on Oct. 5, 2022, 12 pages. [cited by applicant]
U.S. Appl. No. 16/623,724, Non-Final Office Action mailed on Nov. 9, 2021, 22 pages. [cited by applicant]
U.S. Appl. No. 16/623,724, Notice of Allowance mailed on Apr. 21, 2023, 8 pages. [cited by applicant]
European Application No. 18821512.3, Extended European Search Report mailed on Feb. 3, 2021, 11 pages. [cited by applicant]
International Application No. PCT/US2018/038038, International Preliminary Report on Patentability mailed on Jan. 2, 2020, 9 pages. [cited by applicant]
International Application No. PCT/US2018/038038, International Search Report and Written Opinion mailed on Oct. 8, 2018, 13 pages. [cited by applicant]