IP Library Granted Patent US 10,771,863
Granted Patent B2
US 10,771,863 · App. 16/041,970 · Granted Sep 8, 2020

Automated media publishing

Inventor: Shailendra Mathur (Quebec, CA)
Assignee: Avid Technology, Inc.
H04N21/854G06F16/40G06F40/117G06Q10/103H04N21/845
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,771,863
App. No.
16/041,970
Granted
Sep 8, 2020
Kind
B2
Abstract

The described methods, systems, and computer program products enable media composition editors to tag compositional objects with editorial rendition rules that specify how rendering decisions are to be made and how source media assets are to be selected and processed to generate an output rendering of a media composition that adheres to the editor's rendition-related choices. The editorially-specified rendition rules include spatial-type rules, temporal-type rules, and color-type rules, and generally pertain to the spatial, temporal, and color ranges and resolutions to be included within a rendition. When a rendition of a media composition is to be generated, a rendition engine interprets and applies the editorial rendition rules to generate and output the rendition in accordance with rendition parameters supplied to the rendition engine by a rendition profile, and, in some cases, by the media composition and the source media assets.

Claims (54)

1. A method of generating a rendition of a media composition, the method comprising:

receiving the media composition, wherein:

the media composition includes a compositional object that references a source media asset;

the compositional object is associated with an editorial rendition rule specified by an editor of the media composition using a media composition application; and

the editorial rendition rule specifies how the compositional object is to be rendered for each value of a plurality of values of an essence encoding parameter;

receiving a rendition profile that specifies a given value of a media essence encoding parameter for the rendition of the media composition; and

generating from the source media asset the rendition of the compositional object of the media composition in accordance with the editorial rendition rule as it applies to the compositional object for the given value of the media essence encoding parameter.

2. The method of claim 1 , wherein the media composition has a plurality of versions, and the rendition profile further specifies a version of the plurality of versions of the media composition that is to be used to generate the rendition of the composition.

3. The method of claim 1 , wherein the editorial rendition rule is a spatial editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a spatial rendition parameter.

4. The method of claim 3 , wherein the spatial rendition parameter is a framing box that defines a portion of a video frame of the compositional object of the media composition, and wherein a first portion of the source media asset of the composition that lies within the framing box is prioritized for inclusion within the rendition.

5. The method of claim 4 , wherein an aspect ratio of a target display for the rendition is larger than an aspect ratio of the framing box, and wherein a second portion of the source media asset of the composition outside the framing box is also prioritized for inclusion within the rendition, wherein the second portion of the source media asset of the media composition includes media essence data.

6. The method of claim 1 , wherein the editorial rendition rule is a temporal editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a temporal rendition parameter.

7. The method of claim 6 , wherein the temporal rendition parameter includes a temporal framing range that defines a temporal range within the source media asset of the composition, and wherein a temporal portion of the source media asset of the media composition that lies within the temporal framing range is prioritized for inclusion within the rendition.

8. The method of claim 1 , wherein the editorial rendition rule is a dynamic range editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a dynamic range rendition parameter.

9. The method of claim 8 , wherein the source media asset of the composition is a video asset, and the dynamic range rendition parameter is a legal dynamic range that defines a range of pixel brightness values within the source media asset of the composition, and wherein pixels of the source media asset of the composition having brightness values that lie within the legal range are prioritized for inclusion within the rendition.

10. The method of claim 8 , wherein the source media asset of the composition is an audio asset, and the dynamic range rendition parameter is a legal dynamic range that defines a range of audio sample intensity values within the source media asset of the composition, and wherein audio samples of the source media asset of the composition having intensity values that lie within the legal range are prioritized for inclusion within the rendition.

11. The method of claim 1 , wherein the editorial rendition rule is a color editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a color gamut rendition parameter.

12. The method of claim 11 , wherein:

the source media asset of the composition is one of a graphics asset and a video asset;

the color gamut rendition parameter includes a legal color range that defines a multi-dimensional region within a multi-dimensional color space; and

pixels of the source media asset of the composition having color values that lie within the legal color range are prioritized for inclusion within the rendition.

13. The method of claim 1 , wherein:

the editorial rendition rule is a spatial editorial rendition rule for layout of title text on a frame of the rendition;

the media essence encoding parameter is a spatial framing box;

the source media asset of the composition is a text titling effect; and

text of the text titling effect is rendered within the framing box on the frame of the rendition.

14. The method of claim 1 , wherein:

the editorial rendition rule is a compositing editorial rendition rule;

the media essence encoding parameter is a spatial framing box;

the source media asset of the composition is a compositing effect; and

a frame of the rendition with a composited image within the framing box is rendered.

15. The method of claim 1 , wherein the generating step includes interpreting the editorial rendition rule using generic logic for executing rules.

16. The method of claim 1 , wherein the generating step includes executing logic that is learned using deep learning methods from captured editorial rendition decisions of a cohort of editors working with a range of media content, source media types, and rendition requirements.

17. A computer program product comprising:

non-transitory computer-readable storage with computer program instructions stored thereon, wherein the computer program instructions, when processed by a computing system, instruct the computing system to perform a method of generating a rendition of a media composition, the method comprising:

receiving the media composition, wherein:

the media composition includes a compositional object that references a source media asset;

the compositional object is associated with an editorial rendition rule specified by an editor of the media composition using a media composition application; and

the editorial rendition rule specifies how the compositional object is to be rendered for each value of a plurality of values of an essence encoding parameter;

receiving a rendition profile that specifies a given value of a media essence encoding parameter for the rendition of the media composition; and

generating from the source media asset the rendition of the compositional object of the media composition in accordance with the editorial rendition rule as it applies to the compositional object for the given value of the media essence encoding parameter.

18. The computer program product of claim 17 , wherein the computing system is remote from a location from which the media composition is received.

19. The computer program product of claim 17 , wherein the computing system is implemented in the cloud.

20. A media composition rendition engine comprising:

a memory for storing computer-readable instructions; and

a processor connected to the memory, wherein the processor, when executing the computer-readable instructions, causes the media composition rendition engine to:

receive the media composition, wherein:

the media composition includes a compositional object that references a source media asset;

the compositional object is associated with an editorial rendition rule specified by an editor of the media composition using a media composition application; and

the editorial rendition rule specifies how the compositional object is to be rendered for each value of a plurality of values of an essence encoding parameter;

receive a rendition profile that specifies a given value of a media essence encoding parameter for the rendition of the media composition; and

generate from the source media asset the rendition of the compositional object of the media composition in accordance with the editorial rendition rule as it applies to the compositional object for the given value of the media essence encoding parameter.

21. The media composition rendition engine of claim 20 , wherein the media composition rendition engine is located remotely from a location from which the media composition is received.

22. The media composition rendition engine of claim 20 , wherein the media composition rendition engine is implemented in the cloud.

Assignments (4)
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 054900/0716) Recorded Nov 8, 2023
From: JPMORGAN CHASE BANK, N.A.
To: AVID TECHNOLOGY, INC.
Reel/Frame 065523/0146 →
PATENT SECURITY AGREEMENT Recorded Nov 8, 2023
From: AVID TECHNOLOGY, INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 065523/0194 →
SECURITY INTEREST Recorded Jan 5, 2021
From: AVID TECHNOLOGY, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054900/0716 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2018
From: MATHUR, SHAILENDRA
To: AVID TECHNOLOGY, INC.
Reel/Frame 046427/0344 →
Continuity (2)
Continuation 16025043 · Jul 2, 2018
Related Publication 20200007956A1 · Jan 2, 2020
Cited By (1)
US 12,356,107