IP Library Granted Patent US 11,523,188
Granted Patent B2
US 11,523,188 · App. 15/199,677 · Granted Dec 6, 2022

Systems and methods for intelligent media content segmentation and analysis

Inventors: Nimesh Narayan (Los Angeles, CA); Jack Luu (Huntington Beach, CA); Alan Pao (Santa Monica, CA); Matthew Petrillo (Sandy Hook, CT); Anthony M. Accardo (Los Angeles, CA); Alexis Lindquist (Los Angeles, CA); Miquel Angel Farre Guiu (Bern, CH); Katharine S. Ettinger (Santa Monica, CA); Lena Volodarsky Bareket (Los Angeles, CA)
Assignee: Disney Enterprises, Inc.
H04N21/47205G06V20/49G11B27/28H04N21/8133H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,523,188
App. No.
15/199,677
Granted
Dec 6, 2022
Kind
B2
Abstract

There is provided a system including a non-transitory memory storing an executable code and a hardware processor executing the executable code to receive a media content including a plurality of frames, divide the media content into a plurality of shots, each of the plurality of shots including a plurality of frames of the media content based on a first similarity between the plurality of frames, determine a plurality of sequential shots of the plurality of shots to be part of a first sub-scene of a plurality of sub-scenes of a scene based on a timeline continuity of the plurality of sequential shots, identify each of the plurality of shots of the media content and each of the plurality of sub-scenes with a corresponding beginning time code and a corresponding ending time code.

Claims (38)

1. A system comprising:

a non-transitory memory storing an executable code;

a hardware processor configured to execute the executable code to:

receive a media content;

divide the media content into a plurality of shots, each of the plurality of shots including a plurality of frames of the media content, wherein the media content is divided into the plurality of shots based on a first similarity between the plurality of frames;

determine a plurality of sequential shots of the plurality of shots to be part of a first sub-scene of a plurality of sub-scenes of a scene based on a timeline continuity of the plurality of sequential shots;

identify each of the plurality of shots of the media content and each of the plurality of sub-scenes with a corresponding beginning time code and a corresponding ending time code;

receive a user input annotating at least one of the identified plurality of shots or the identified plurality of sub-scenes; and

store the user input in an annotation database.

2. The system of claim 1 , wherein the hardware processor is further configured to execute the executable code to:

determine one or more sequential sub-scenes of the plurality of sub-scenes to be part of the scene; and

identify the scene with a corresponding beginning time code and a corresponding ending time code.

3. The system of claim 1 , wherein the hardware processor is further configured to execute the executable code to:

transmit one or more of the plurality of shots for displaying on a display.

4. The system of claim 3 , wherein the hardware processor is further configured to execute the executable code to:

transmit a supplemental content related to the one or more of the plurality of shots for displaying on the display concurrent with displaying of the one or more of the plurality of shots.

5. The system of claim 1 , wherein the first similarity between the plurality of frames of each shot of the media content is one of a same character, a same setting, or a same theme.

6. The system of claim 1 , wherein the first similarity is determined using one of an edit decision list, a metadata content, or computer vision.

7. The system of claim 1 , wherein the plurality of sub-scenes in the scene provide context to at least one of a preceding sub-scene of the scene or a succeeding sub-scene of the scene.

8. The system of claim 1 , wherein each scene includes at least one connecting element.

9. A method for use with a system comprising a non-transitory memory and a hardware processor, the method comprising:

receiving, using the hardware processor, a media content;

dividing, using the hardware processor, the media content into a plurality of shots, each of the plurality of shots including a plurality of frames of the media content, wherein the media content is divided into the plurality of shots based on a first similarity between the plurality of frames;

determining, using the hardware processor, a plurality of sequential shots of the plurality of shots to be part of a first sub-scene of a plurality of sub-scenes of a scene based on a timeline continuity of the plurality of sequential shots; and

identifying, using the hardware processor, each of the plurality of shots of the media content and each of the plurality of sub-scenes with a corresponding beginning time code and a corresponding ending time code;

receiving, using the hardware processor, a user input annotating at least one of the identified plurality of shots or the identified plurality of sub-scenes; and

storing, using the hardware processor, the user input in an annotation database.

10. The method of claim 9 , further comprising:

determining, using the hardware processor, one or more sequential sub-scenes of the plurality of sub-scenes to be part of the scene; and

identifying, using the hardware processor, the scene with a corresponding beginning time code and a corresponding ending time code.

11. The method of claim 9 , further comprising:

transmitting, using the hardware processor, one or more of the plurality of shots for displaying on a display.

12. The method of claim 11 , further comprising:

transmitting, using the hardware processor, a supplemental content related to the one or more of the plurality of shots for displaying on the display concurrent with displaying of the one or more of the plurality of shots.

13. The method of claim 9 , wherein the first similarity between the plurality of frames of each shot of the media content is one of a same character, a same setting, or a same theme.

14. The method of claim 9 , wherein the first similarity is determined using one of an edit decision list, a metadata content, or computer vision.

15. The method of claim 9 , wherein the plurality of sub-scenes in the scene provide context to at least one of a preceding sub-scene of the scene or a succeeding sub-scene of the scene.

16. The method of claim 9 , wherein each scene includes at least one connecting element.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2020
From: LUU, JACK
To: WALT DISNEY PICTURES
Reel/Frame 052950/0425 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2020
From: PAO, ALAN
To: WALT DISNEY PICTURES
Reel/Frame 052615/0722 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2020
From: WALT DISNEY PICTURES
To: DISNEY ENTERPRISES, INC.
Reel/Frame 052615/0835 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2016
From: PETRILLO, MATTHEW; ACCARDO, ANTHONY M.; LINDQUIST, ALEXIS; ETTINGER, KATHERINE S.; VOLODARSKY BAREKET, LENA
To: DISNEY ENTERPRISES, INC.
Reel/Frame 039558/0814 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2016
From: FARRE GUIU, MIQUEL ANGEL
To: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
Reel/Frame 039558/0897 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2016
From: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
To: DISNEY ENTERPRISES, INC.
Reel/Frame 039851/0217 →
Continuity (1)
Related Publication 20180005041A1 · Jan 4, 2018