IP Library › Granted Patent US 11,354,894
Granted Patent B2
US 11,354,894 · App. 16/655,117 · Granted Jun 7, 2022

Automated content validation and inferential content annotation

Inventors: Miquel Angel Farre Guiu (Bern, CH); Matthew C. Petrillo (Sandy Hook, CT); Monica Alfaro Vendrell (Barcelona, ES); Daniel Fojo (Barcelona, ES); Albert Aparicio Isarn (Barcelona, ES); Francesc Josep Guitart Bravo (Lleida, ES); Jordi Badia Pujol (Madrid, ES); Marc Junyent Martin (Barcelona, ES); Anthony M. Accardo (Los Angeles, CA)
Assignee: Disney Enterprises, Inc.
G06V20/20G06K9/6256G06N5/025G06N5/04G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,894
App. No.
16/655,117
Filed
Oct 16, 2019
Granted
Jun 7, 2022
Kind
B2
Art Unit
2677
USPC
382/180
Abstract

According to one implementation, a system for automating inferential content annotation includes a computing platform having a hardware processor and a system memory storing a software code including a set of rules trained to annotate content inferentially. The hardware processor executes the software code to utilize one or more feature analyzer(s) to apply labels to features detected in the content, access one or more knowledge base(s) to validate at least one of the applied labels, and to obtain, from the knowledge base(s), descriptive data linked to the validated label(s). The software code then infers, using the set of rules, one or more label(s) for the content based on the validated label(s) and the descriptive data, and outputs tags for annotating the content, where the tags include the validated label(s) and the inferred label(s).

Claims (37)

1. An automated content annotation system comprising:

a computing platform including a hardware processor and a system memory;

a software code stored in the system memory, the software code including a set of rules trained to annotate content inferentially;

the hardware processor configured to execute the software code to:

utilize at least one feature analyzer to apply a plurality of labels to features detected in the content;

access at least one knowledge base to validate at least one of the applied plurality of labels;

obtain, from the at least one knowledge base, a descriptive data linked to the at least one validated label in the at least one knowledge base;

infer, using the set of rules, at least one label for the content based on the at least one validated label and the descriptive data linked to the at least one validated label; and

output tags for annotating the content, the tags including the at least one validated label and the inferred at least one label.

2. The automated content annotation system of claim 1 , wherein the inferred at least one label is a subset of a plurality of preliminary labels generated inferentially using the set of rules for the content, and wherein the hardware processor is further configured to execute the software code to:

determine a relevance score for each of the plurality of preliminary labels; and

identify the inferred at least one label for the content based on the relevance score.

3. The automated content annotation system of claim 2 , wherein the inferred at least one label is one of the plurality of preliminary labels having a highest relevance score.

4. The automated content annotation system of claim 2 , wherein the inferred at least one label includes each of the plurality of preliminary labels having a respective relevance score greater than a predetermined threshold.

5. The automated content annotation system of claim 1 , wherein the at least one feature analyzer includes at least one of a facial recognition module, an object recognition module, or an activity recognition module.

6. The automated content annotation system of claim 1 , wherein the at least one feature analyzer includes a text analysis module configured to analyze text and speech included in the content.

7. The automated content annotation system of claim 1 , wherein the at least one feature analyzer includes at least one of an organization recognition module or a venue recognition module.

8. The automated content annotation system of claim 1 , wherein the at least one knowledge base is stored in the system memory.

9. The automated content annotation system of claim 1 , wherein the descriptive data is obtained from the at least one knowledge base via a packet-switched network.

10. The automated content annotation system of claim 1 , wherein the content comprises at least one of sports content, television programming content, movie content, advertising content, or video gaming content.

11. A method for use by an automated content annotation system including a computing platform having a hardware processor and a system memory storing a software code including a set of rules for trained to annotate content inferentially, the method comprising:

utilizing at least one feature analyzer, by the software code executed by the hardware processor, to apply a plurality of labels to features detected in the content;

accessing at least one knowledge base, by the software code executed by the hardware processor, to validate at least one of the applied plurality of labels;

obtaining, by the software code executed by the hardware processor, from the at least one knowledge base, a descriptive data linked to the at least one validated label in the at least one knowledge base;

inferring, by the software code executed by the hardware processor and using the set of rules, at least one label for the content based on the at least one validated label and the descriptive data linked to the at least one validated label; and

outputting, by the software code executed by the hardware processor, tags for annotating the content, the tags including the at least one validated label and the inferred at least one label.

12. The method of claim 11 , wherein the inferred at least one label is a subset of a plurality of preliminary labels generated inferentially using the set of rules for the content, the method further comprising:

determining, by the software code executed by the hardware processor, a relevance score for each of the plurality of preliminary labels; and

identifying the inferred at least one label for the content, by the software code executed by the hardware processor, based on the relevance score.

13. The method of claim 12 , wherein the inferred at least one label is one of the plurality of preliminary labels having a highest relevance score.

14. The method of claim 12 , wherein the inferred at least one label includes each of the plurality of preliminary labels having a respective relevance score greater than a predetermined threshold.

15. The method of claim 11 , wherein the at least one feature analyzer includes at least one of a facial recognition module, an object recognition module, or an activity recognition module.

16. The method of claim 11 , wherein the at least one feature analyzer includes a text analysis module configured to analyze text and speech included in the content.

17. The method of claim 11 , wherein the at least one feature analyzer includes at least one of an organization recognition module or a venue recognition module.

18. The method of claim 11 , wherein the at least one knowledge base is stored in the system memory.

19. The method of claim 11 , wherein the descriptive data is obtained from the at least one knowledge base via a packet-switched network.

20. The method of claim 11 , wherein the content comprises at least one of sports content, television programming content, movie content, advertising content, or video gaming content.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2020
From: APARICIO ISARN, ALBERT
To: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
Reel/Frame 053954/0609 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2019
From: PETRILLO, MATTHEW C.; ACCARDO, ANTHONY M.
To: DISNEY ENTERPRISES, INC.
Reel/Frame 050748/0334 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2019
From: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
To: DISNEY ENTERPRISES, INC.
Reel/Frame 050752/0859 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2019
From: GUIU, MIQUEL ANGEL FARRE; VENDRELL, MONICA ALFARO; FOJO, DANIEL; APARICIO, ALBERT; BRAVO, FRANCESC JOSEP GUITART; PUJOL, JORDI BADIA; MARTIN, MARC JUNYENT
To: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
Reel/Frame 050752/0914 →
Continuity (1)
Related Publication 20210117678A1 · Apr 22, 2021
Cited By (1)
US 12,626,729