IP Library › Patent Application 15788063
Patent Application
App. No. 15/788,063

METHODS AND SYSTEMS FOR PROCESSING SYNCHRONOUS DATA TRACKS IN A MEDIA EDITING SYSTEM

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/788,063
Abstract

A software architecture and framework based on plug-in software modules supports flexible handling of synchronous data streams by media production and editing applications. Plug-ins called by the applications convert data from synchronous data streams into a form that enables a user of such an application to view and edit time-synchronous data contained within such data streams. The synchronous data is displayed in a temporally aligned manner in a synchronous data track within a timeline display of the application user interface. In one example, closed caption data extracted from the ancillary portion of a video signal is displayed as text on a data track temporally synchronized with the source video track. Other plug-ins analyze media tracks to generate time-synchronous data which may also be displayed in a temporally aligned manner within a synchronous data track in a timeline.

Claims (36)

1 . A method of processing a time-based media track associated with a time-based media project, the method comprising:

calling a software module that is able to access the time-based media track;

using the software module to analyze the time-based media track to generate time-based analysis results;

reading the time-based media track and the time-based analysis results into a media processing application; and

displaying a time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally synchronized display of the time-based analysis results such that a representation of time-based analysis results associated with a given temporal location within the time-based media track is displayed in the time-synchronous data track timeline representation at a spatial location corresponding to and aligned with the given temporal location in a display of the time-based media track within the graphical user interface of the media processing application.

2 . The method of claim 1 , wherein analyzing the time-based media track includes detecting motion within a video track and the time-based analysis results include motion vectors.

3 . The method of claim 1 , wherein analyzing the time-based media track includes analyzing a speech audio track and the time-based analysis results include at least one of phonemes and text.

4 . The method of claim 1 , wherein analyzing the time-based media track includes detecting faces within a video track and the time-based analysis results include face identification.

5 . The method of claim 1 , wherein analyzing the time-based media track includes assessing a technical quality of the time-based media track, and the time-based analysis results include evaluations of the technical quality of the time-based media track.

6 . The method of claim 1 , wherein analyzing the time-based media track includes identifying ambient sounds within a sound track and the time-based analysis results include location detection.

7 . The method of claim 1 , wherein analyzing the time-based media track includes identifying features within a pictured scene in a video track and the time-based analysis results include location detection.

8 . A method of processing a time-based media track associated with a time-based media project, the method comprising:

reading the time-based media track into a media processing application;

from the media processing application, calling a software plug-in module;

enabling the software plug-in module to access and analyze the time-based media track to generate time-based analysis results;

generating a time-synchronous data track comprising time-synchronous analysis results; and

displaying the time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally aligned display of the time-synchronous analysis results such that a representation of time-synchronous analysis results associated with a given temporal location within the time-based media track is displayed in the synchronous data track timeline representation at a spatial location corresponding to the given temporal location.

9 . The method of claim 8 , wherein analyzing the time-based media track includes detecting motion within a video track and the time-based analysis results include motion vectors.

10 . The method of claim 8 , wherein analyzing the time-based media track includes analyzing a speech audio track and the time-based analysis results include at least one of phonemes and text.

11 . The method of claim 8 , wherein analyzing the time-based media track includes detecting faces within a video track and the time-based analysis results include face identification.

12 . The method of claim 8 , wherein analyzing the time-based media track includes assessing a technical quality of the time-based media track, and the time-based analysis results include evaluations of the technical quality of the time-based media track.

13 . The method of claim 8 , wherein analyzing the time-based media track includes identifying ambient sounds within a sound track and the time-based analysis results include location detection.

14 . The method of claim 8 , wherein analyzing the time-based media track includes identifying features within a pictured scene in a video track and the time-based analysis results include location detection.

15 . A system comprising:

a memory for storing computer-readable instructions; and

a processor connected to the memory, wherein the processor, when executing the computer-readable instructions, causes the system to perform a method of processing a time-based media track associated with a time-based media project, the method comprising:

calling a software module that is able to access the time-based media track;

causing the software module to analyze the time-based media track to generate time-based analysis results;

reading the time-based media track and the time-based analysis results into a media processing application; and

displaying a time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally synchronized display of the time-based analysis results such that a representation of time-based analysis results associated with a given temporal location within the time-based media track is displayed in the time-synchronous data track timeline representation at a spatial location corresponding to and aligned with the given temporal location in a display of the time-based media track within the graphical user interface of the media processing application.

16 . A computer program product comprising:

a non-transitory computer-readable medium with computer program instructions encoded thereon, wherein the computer program instructions, when processed by a computer system, instruct the computer system to perform a method of processing a time-based media track associated with a time-based media project, the method comprising:

calling a software module that is able to access the time-based media track;

causing the software module to analyze the time-based media track to generate time-based analysis results;

reading the time-based media track and the time-based analysis results into a media processing application; and

displaying a time-synchronous data track within a timeline representation of the time-based media project within a graphical user interface of the media processing application, the time-based data track including a temporally synchronized display of the time-based analysis results such that a representation of time-based analysis results associated with a given temporal location within the time-based media track is displayed in the time-synchronous data track timeline representation at a spatial location corresponding to and aligned with the given temporal location in a display of the time-based media track within the graphical user interface of the media processing application.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2017
From: RANSDELL, THOMAS R.; LAIRD, MICHAEL D.; WALLACE, RONALD C.
To: AVID TECHNOLOGY, INC.
Reel/Frame 043903/0580 →