IP Library › Granted Patent US 11,314,706
Granted Patent B2
US 11,314,706 · App. 16/999,767 · Granted Apr 26, 2022

Metadata aggregation using a trained entity matching predictive model

Inventors: Christopher C. Stoafer (Seattle, WA); Jordi Badia Pujol (Madrid, ES); Francesc Josep Guitart Bravo (Lleida, ES); Marc Junyent Martin (Barcelona, ES); Miquel Angel Farre Guiu (Bern, CH); Calvin Lawson (Seattle, WA); Erick L. Luerken (Seattle, WA)
Assignee: Disney Enterprises, Inc.
G06F16/215G06F9/4881G06F11/3419G06F11/3433G06F16/1794G06F16/217G06F16/2462G06F16/24542G06F16/24549G06F16/3346G06F16/383G06F17/11G06F30/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,314,706
App. No.
16/999,767
Granted
Apr 26, 2022
Kind
B2
Abstract

A metadata aggregation system includes a computing platform having a hardware processor and a memory storing a software code including a trained entity matching predictive model trained using training data obtained from a reference database. The hardware processor executes the software code to obtain metadata inputs from multiple sources, conform the metadata inputs to a common format, match, using the trained entity matching predictive model, at least some of the conformed metadata inputs to the same entity, and determine, using the trained entity matching predictive model, a confidence score for each match. The software code further sends a request to one or more human editor(s) for confirmation of each match having a confidence score greater than a first threshold and less than a second threshold, and updates the reference database, in response to receiving a confirmation that at least one match is a confirmed match, to include the confirmed match.

Claims (63)

1. A metadata aggregation system comprising:

a computing platform including a hardware processor and a system memory;

a software code stored in the system memory, the software code including a trained entity matching predictive model trained using training data obtained from a reference database;

the hardware processor configured to execute the software code to:

obtain a plurality of metadata inputs from a plurality of sources;

conform the plurality of metadata inputs to a common format;

match, using the trained entity matching predictive model, at least some of the conformed plurality of metadata inputs to a same entity to generate a plurality of matches;

determine, using the trained entity matching predictive model, a confidence score for each of the plurality of matches;

send a confirmation request to at least one human editor for confirmation of each of the plurality of matches having a respective confidence score greater than a first threshold score and less than a second threshold score; and

update the reference database, in response to receiving a confirmation of at least one of the plurality of matches as a confirmed match from the at least one human editor, to include the confirmed match in the reference database.

2. The metadata aggregation system of claim 1 , wherein the hardware processor is further configured to execute the software code to:

obtain an updated training data from the updated reference database; and

retrain, using the updated training data, the trained entity matching predictive model.

3. The metadata aggregation system of claim 2 , wherein the hardware processor is further configured to execute the software code to:

receive a plurality of entity queries from at least one client of the metadata aggregation system;

identify, using the trained entity matching predictive model, a plurality of entity matching failures based on null-results in response to at least some of the plurality of entity queries; and

prioritize the retraining of the trained entity matching predictive model to reduce the plurality of entity matching failures.

4. The metadata aggregation system of claim 1 , wherein the hardware processor is further configured to execute the software code to:

perform an automated identification of each of the plurality of matches having a respective confidence score greater than or equal to the second threshold score as another confirmed match; and

further update the updated reference database to include the another confirmed match in the updated reference database.

5. The metadata aggregation system of claim 4 , wherein the hardware processor is further configured to execute the software code to:

obtain a further updated training data from the further updated training database; and

retrain, using the further updated training data, the trained entity matching predictive model.

6. The metadata aggregation system of claim 5 , wherein the hardware processor is further configured to execute the software code to:

receive a plurality of entity queries from at least one client of the metadata aggregation system;

identify, using the trained entity matching predictive model, a plurality of entity matching failures based on null-results in response to at least some of the plurality of entity queries; and

prioritize the retraining of the trained entity matching predictive model to reduce the plurality of entity matching failures.

7. The metadata aggregation system of claim 1 , wherein the hardware processor is further configured to execute the software code to:

perform an automated identification of each of the plurality of matches having a respective confidence score less than or equal to the first threshold score as a mismatch; and

prevent the reference database from being updated to include the mismatch.

8. The metadata aggregation system of claim 1 , wherein at least one of the plurality of sources of the plurality of metadata inputs comprises at least one of a knowledge base or a news source.

9. The metadata aggregation system of claim 1 , wherein at least one of the plurality of sources of the plurality of metadata inputs comprises a social media platform.

10. The metadata aggregation system of claim 1 , wherein the same entity is one of an athlete, a sports team, a sports league, a movie, a movie franchise, a video game, a linear television program or series, a web television program or series, an actor, or a fictional character.

11. A method for use by a metadata aggregation system including a computing platform having a hardware processor and a system memory storing a software code, the software code including a trained entity matching predictive model trained using training data obtained from a reference database, the method comprising:

obtaining, by the software code executed by the hardware processor, a plurality of metadata inputs from a plurality of sources;

conforming, by the software code executed by the hardware processor, the plurality of metadata inputs to a common format;

matching, by the software code executed by the hardware processor and using the trained entity matching predictive model, at least some of the conformed plurality of metadata inputs to a same entity to generate a plurality of matches;

determining, by the software code executed by the hardware processor and using the trained entity matching predictive model, a confidence score for each of the plurality of matches;

sending, by the software code executed by the hardware processor, a confirmation request to at least one human editor for confirmation of each of the plurality of matches having a respective confidence score greater than a first threshold score and less than a second threshold score; and

updating the reference database, by the software code executed by the hardware processor in response to receiving a confirmation of at least one of the plurality of matches as a confirmed match from the at least one human editor, to include the confirmed match in the reference database.

12. The method of claim 11 , further comprising:

obtaining, by the software code executed by the hardware processor, an updated training data from the updated reference database; and

retraining, by the software code executed by the hardware processor and using the updated training data, the trained entity matching predictive model.

13. The method of claim 12 , further comprising:

receiving, by the software code executed by the hardware processor, a plurality of entity queries from at least one client of the metadata aggregation system;

identifying, by the software code executed by the hardware processor and using the trained entity matching predictive model, a plurality of entity matching failures based on null-results in response to at least some of the plurality of entity queries; and

prioritizing, by the software code executed by the hardware processor, the retraining of the trained entity matching predictive model to reduce the plurality of entity matching failures.

14. The method of claim 11 , further comprising:

performing, by the software code executed by the hardware processor, an automated identification of each of the plurality of matches having a respective confidence score greater than or equal to the second threshold score as another confirmed match; and

further updating, by the software code executed by the hardware processor, the updated reference database to include the another confirmed match in the updated reference database.

15. The method of claim 14 , further comprising:

obtaining, by the software code executed by the hardware processor, a further updated training data from the further updated training database; and

retraining, by the software code executed by the hardware processor and using the further updated training data, the trained entity matching predictive model.

16. The method of claim 15 , further comprising:

receiving, by the software code executed by the hardware processor, a plurality of entity queries from at least one client of the metadata aggregation system;

identifying, by the software code executed by the hardware processor and using the trained entity matching predictive model, a plurality of entity matching failures based on null-results in response to at least some of the plurality of entity queries; and

prioritizing, by the software code executed by the hardware processor, the retraining of the trained entity matching predictive model to reduce the plurality of entity matching failures.

17. The method of claim 11 , further comprising:

performing, by the software code executed by the hardware processor, an automated identification of each of the plurality of matches having a respective confidence score less than or equal to the first threshold score as a mismatch; and

preventing, by the software code executed by the hardware processor, the reference database from being updated to include the mismatch.

18. The method of claim 11 , wherein at least one of the plurality of sources of the plurality of metadata inputs comprises at least one of a knowledge base or a news source.

19. The method of claim 11 , wherein at least one of the plurality of sources of the plurality of metadata inputs comprises a social media platform.

20. The method of claim 11 , wherein the same entity is one of an athlete, a sports team, a sports league, a movie, a movie franchise, a video game, a linear television program or series, a web television program or series, an actor, or a fictional character.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2020
From: STOAFER, CHRISTOPHER C.; LAWSON, CALVIN; LUERKEN, ERICK L.
To: DISNEY ENTERPRISES, INC.
Reel/Frame 053578/0839 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2020
From: PUJOL, JORDI BADIA; BRAVO, FRANCESC JOSEP GUITART; MARTIN, MARC JUNYENT; GUIU, MIQUEL ANGEL FARRE
To: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
Reel/Frame 053578/0980 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2020
From: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
To: DISNEY ENTERPRISES, INC.
Reel/Frame 053579/0110 →
Continuity (1)
Related Publication 20220058196A1 · Feb 24, 2022