IP Library Granted Patent US 12,210,718
Granted Patent B2
US 12,210,718 · App. 16/155,633 · Granted Jan 28, 2025

Time-based metadata management system for digital media

Inventors: Matthew G. Berry (Raleigh, NC); Tim Jones (Cary, NC); Isaac Kunkel (Cary, NC)
Assignee: Adeia Media Solutions Inc.
G06F3/048H04N21/234363H04N21/4312H04N21/47217H04N21/84H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,210,718
App. No.
16/155,633
Granted
Jan 28, 2025
Kind
B2
Abstract

Managing metadata associated with a digital media asset includes selecting the digital media asset, displaying the digital media asset in a filmstrip format that presents one or more scenes from the digital media asset along a timeline, wherein each scene corresponds with an underlying point in time along the timeline, and wherein the digital media asset has a start time and an end time that define the timeline, displaying at least one track in timeline alignment with the film strip format wherein the at least one track corresponds with a type of metadata associated with the digital media asset, and displaying on the at least one track, one or more segments, wherein each segment has a start point and an end point along the timeline and wherein each respective segment represents a span of time in which the type of metadata occurs within the digital media asset.

Claims (34)

1. A method comprising:

receiving, from a server, first data used by a client device to generate for display a digital media asset in a film strip format representing one or more scenes of the digital media asset along a timeline, wherein each scene of the one or more scenes is associated with a respective point in time along the timeline of the digital media asset, wherein the timeline is defined by a start and an end time;

receiving, from the server, second data used by the client device to generate for display a plurality of tracks, wherein each track of the plurality of tracks is indicative of a different type of metadata associated with the digital media asset and wherein the different types of metadata comprise metadata associated with the digital media asset in its entirety and metadata associated with a specific point or segment of time within the digital media asset;

receiving, by the client device, a selection of a particular character from the plurality of tracks of the digital asset;

in response to receiving the selection of the particular character from the plurality of tracks;

performing facial recognition to identify a plurality of on-screen appearances of the selected particular character in the plurality of tracks of the digital asset;

automatically associating the plurality of on-screen appearances of the selected particular character with metadata attributes and time-codes; and

generating for simultaneous display both the digital media asset in the filmstrip format and one or more subtracks corresponding to the plurality of the on-screen appearance of the particular character in a non-contiguous manner based on the time-codes, wherein each subtrack comprises one or more associated non-contiguous time-coded segments that include the on-screen appearance of the same particular character as the particular track, wherein the generating for display comprises:

displaying the one or more associated non-contiguous time-coded segments of the digital asset edited together to appear in a contiguous manner.

2. The method of claim 1 , wherein each of the different type of metadata is created by an owner of the digital media asset, automatically generated by the server by applying at least one metadata generation mechanism to content of the digital media asset, or generated by a user.

3. The method of claim 1 , wherein the start and end points of at least one of the one or more segments spans at least one of a time period of one scene, more than one scene, a portion of one scene, and portions of more than one scene.

4. The method of claim 1 , further comprising receiving input indicating an edit to at least one segment of the plurality of tracks, the edit including adding, deleting, or changing the at least one segment.

5. The method of claim 2 , wherein the at least one metadata generation mechanism includes face detection algorithm modules, ad break detection algorithm modules, speech recognition modules, or other automated metadata detection modules.

6. The method of claim 2 , wherein access to generate for display the plurality of tracks in timeline alignment of the different type of metadata associated with the digital media asset on the client device is provided by an authorized user.

7. The method of claim 2 , wherein the particular aspect of the different type of metadata occurring within each segment of the digital media asset is automatically generated by the owner by applying the at least one metadata generation mechanism, or generated by the user.

8. A non-transitory computer readable medium having instructions encoded thereon, that when executed by control circuitry causes the control circuitry to:

receive, from a server, first data used by a client device to generate for display a digital media asset in a film strip format representing one or more scenes of the digital media asset digital media asset along a timeline, wherein each scene of the one or more scenes is associated with a respective point in time along the timeline of the digital media asset, wherein the timeline is defined by a start and an end time;

receive, from the server, second data used by the client device to generate for display a plurality of tracks, wherein each track of the plurality of tracks is indicative of a different type of metadata associated with the digital media asset and wherein the different types of metadata comprise metadata associated with the digital media asset in its entirety and metadata associated with a specific point or segment of time within the digital media asset;

receive, by the client device, a selection of a particular character from the plurality of tracks of the digital media asset; and

in response to receiving the selection of the particular track from the plurality of tracks:

perform facial recognition to identify a plurality of on-screen appearances of the selected particular character in the plurality of tracks of the digital asset;

automatically associate the plurality of on-screen appearances of the selected particular character with metadata attributes and time-codes; and

generate for simultaneous display both the digital media asset in the filmstrip format and one or more subtracks corresponding to the plurality of the on-screen appearance of the particular character in a non-contiguous manner based on the time-codes, wherein each subtrack comprises one or more associated non-contiguous time-coded segments that include the on-screen appearance of the same particular character as the particular track, wherein the generating for display comprises:

displaying the one or more associated non-contiguous time-coded segments of the digital media asset edited together to appear in a contiguous manner.

9. The non-transitory computer-readable medium of claim 8 , wherein each of the different type of metadata is created by an owner of the digital media asset, automatically generated by the server by applying at least one metadata generation mechanism to content of the digital media asset, or generated by a user.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the start and end points of at least one of the one or more segments spans at least one of a time period of one scene, more than one scene, a portion of one scene, and portions of more than one scene.

11. The non-transitory computer-readable storage medium of claim 8 , wherein the instructions further cause the control circuitry to receive input indicating an edit to at least one segment of the plurality of tracks, the edit including adding, deleting, or changing the at least one segment.

12. The non-transitory computer-readable storage medium of claim 9 , wherein the at least one metadata generation mechanism includes face detection algorithm modules, ad break detection algorithm modules, speech recognition modules, or other automated metadata detection modules.

13. The non-transitory computer-readable storage medium of claim 9 , wherein access to generate for display the plurality of tracks in timeline alignment of the different type of metadata associated with the digital media asset on the client device is provided by an authorized user.

14. The non-transitory computer-readable storage medium of claim 9 , wherein the particular aspect of the different type of metadata occurring within each segment of the digital media asset is automatically generated by the owner by applying the at least one metadata generation mechanism, or generated by the user.

15. The method of claim 1 , wherein the character is associated with an on-screen appearance of an actor.

16. The method of claim 15 , wherein the metadata includes an identifier that is associated with the actor's name.

17. The method of claim 15 , the one or more associated non-contiguous time-coded segments of the digital asset edited together to appear in a contiguous manner include the on-screen appearance of the same actor in a scene of the non-contiguous time-coded segment.

18. The method of claim 1 , wherein the display of the one or more associated non-contiguous time-coded segments of the digital asset edited together to appear in a contiguous manner contains the same particular character in each contiguous segment.

Assignments (9)
CHANGE OF NAME Recorded Sep 26, 2024
From: TIVO SOLUTIONS INC.
To: ADEIA MEDIA SOLUTIONS INC.
Reel/Frame 069051/0243 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
CHANGE OF NAME Recorded May 22, 2019
From: TIVO INC.
To: TIVO SOLUTIONS INC.
Reel/Frame 049253/0493 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2019
From: BERRY, MATTHEW G.; JONES, TIM; KUNKEL, ISAAC
To: DIGITALSMITHS CORPORATION
Reel/Frame 049253/0421 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2019
From: DIGITALSMITHS CORPORATION
To: TIVO INC.
Reel/Frame 049253/0450 →
Continuity (2)
Continuation 12905520 · Oct 15, 2010
Related Publication 20190107906A1 · Apr 11, 2019
References Cited (13)
US 6393158B1 · Gould · 2002 [cited by examiner]
US 6602297B1 · Song · 2003 [cited by examiner]
US 20030070183A1 · Pierre · 2003 [cited by examiner]
US 20050005308A1 · Logan · 2005 [cited by examiner]
US 20060036568A1 · Moore · 2006 [cited by examiner]
US 20060236338A1 · Shimoda · 2006 [cited by examiner]
US 20070016599A1 · Plastina · 2007 [cited by examiner]
US 20080244410A1 · Schormann · 2008 [cited by examiner]
US 20080292279A1 · Kamada · 2008 [cited by examiner]
US 20090055383A1 · Zalewski · 2009 [cited by examiner]
US 20100031162A1 · Wiser · 2010 [cited by examiner]
US 20100107117A1 · Pearce · 2010 [cited by examiner]
US 20110299832A1 · Butcher · 2011 [cited by examiner]