IP Library Granted Patent US 10,867,635
Granted Patent B2
US 10,867,635 · App. 15/919,835 · Granted Dec 15, 2020

Method and system for generation of a variant video production from an edited video production

Inventors: Alexander Rav-Acha (Rehovot, IL); Oren Boiman (Sunnyvale, CA)
Assignee: VIMEO, INC.
G11B27/031G11B27/28H04N21/23418H04N21/23439H04N21/854
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,867,635
App. No.
15/919,835
Granted
Dec 15, 2020
Kind
B2
Abstract

A method for generating a variant video production from an original video production is provided herein. The method may include the following steps: obtaining an original video production made of a plurality of visual assets being video cuts and/or images and at least one original audio track; automatically analyzing content of the original video production, to separate said visual assets; automatically detecting and storing editing operations applied on the visual assets during creation of the original video production; and automatically generating a variant video production based on at least some of the separated visual assets, wherein only some of the separated visual assets retain respective editing operations applied on the visual assets during the creation of the original video production.

Claims (35)

1. A method for automatically generating a storyboard from an originally edited video, the method comprising:

obtaining the originally edited video comprising a plurality of visual assets being video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images and at least one original audio track;

automatically separating said originally edited video, into said video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images, by applying visual analysis to said originally edited video; and

automatically generating a storyboard by showing at least some of the video cuts and/or images and at least some of said transitions and/or video effects;

wherein the automatically separating of said originally edited video further includes separating the at least one original audio track into audio cuts, wherein—at least one of the video cuts and one of the audio cuts are synchronized and have non-identical durations, and wherein another one of the video cuts and said audio cut are non-synchronized.

2. The method according to claim 1 , wherein the originally edited video is manually edited by a third party.

3. A method for automatically generating a storyboard from an originally edited video, the method comprising:

obtaining the originally edited video comprising a plurality of visual assets being video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images and at least one original audio track;

automatically separating said originally edited video, into said video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images, by applying visual analysis to said originally edited video;

automatically generating a storyboard by showing at least some of the video cuts and/or images and at least some of said transitions and/or video effects;

automatically generating a further video production based on at least some of the video cuts and/or images with at least some of said transitions and/or video effects wherein in the further video production, at least some of said transitions and/or video effects are modified compared with the originally edited video; and separating the at least one original audio track into speech components and music components wherein the automatically generating a further video production further comprises editing the separated speech components differently than the separated music components.

4. The method according to claim 3 , wherein the automatically separating of said originally edited video further includes separating the at least one original audio track into speech components and music components.

5. A method for automatically generating a storyboard from an originally edited video, the method comprising:

obtaining the originally edited video comprising a plurality of visual assets being video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images and at least one original audio track;

automatically separating said originally edited video, into said video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images, by applying visual analysis to said originally edited video;

automatically generating a storyboard by showing at least some of the video cuts and/or images and at least some of said transitions and/or video effects;

automatically generating a further video production based on at least some of the video cuts and/or images with at least some of said transitions and/or video effects wherein in the further video production, at least some of said transitions and/or video effects are modified compared with the originally edited video;

repeating the automatically generating a further video production, to generate a plurality of further video productions; and

selecting a best further video production based on predefined criteria, wherein the selecting of the best further video production is carried out based on success criteria in an online campaign.

6. The method according to claim 5 , wherein the applying visual analysis to said originally edited video separates video effects parameters.

7. A method for automatically generating a storyboard from an originally edited video, the method comprising:

obtaining the originally edited video comprising a plurality of video cuts and/or images, at least one text layer, and at least one original audio track;

automatically separating said originally edited video, into said video cuts and/or images and at least one text layer, by applying visual analysis to said originally edited video; and

automatically generating a storyboard by showing at least some of the video cuts and/or images and at least some of said at least one text layer, wherein the originally edited video further includes at least one text layer and wherein the applying visual analysis to said originally edited video further identifies said text layer, and wherein said automatically generating a further video production comprises replacing the identified text layer with a different text layer.

8. A method for automatically generating a storyboard from an originally edited video, the method comprising:

obtaining the originally edited video comprising a plurality of visual assets being video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images and at least one original audio track;

automatically separating said originally edited video, into said video cuts and/or images and transitions and/or video effects applied to said video cuts and/or images, by applying visual analysis to said originally edited video;

automatically generating a storyboard by showing at least some of the video cuts and/or images and at least some of said transitions and/or video effects;

automatically generating a further video production based on at least some of the video cuts and/or images with at least some of said transitions and/or video effects wherein in the further video production, at least some of said transitions and/or video effects are modified compared with the originally edited video,

wherein the automatically generating a further video production includes (a) minimization of the distance of the video cuts in the further video production from their respective locations in the original video production, and (b) maximization of the number of video cuts synchronized to the music.

9. The method according to claim 8 , wherein the automatically generating a further video production is applied so that the further video product satisfies a desired total duration.

10. A method for automatically generating a storyboard from an originally edited video, the method comprising:

obtaining the originally edited video comprising a plurality of video cuts and/or images, at least one text layer, and at least one original audio track;

automatically separating said originally edited video, into said video cuts and/or images and at least one text layer, by applying visual analysis to said originally edited video; and

automatically generating a storyboard by showing at least some of the video cuts and/or images and at least some of said at least one text layer, wherein the applying visual analysis to said originally edited video includes identifying special shots, comprising at least one of: Text slides, Post-Roll, Pre-Roll.

Assignments (5)
SECURITY INTEREST Recorded May 4, 2026
From: VIMEO.COM, INC.
To: INTESA SANPAOLO S.P.A., AS SECURITY AGENT
Reel/Frame 074553/0001 →
RELEASE OF PATENT SECURITY INTERESTS FILED FEBRUARY 12, 2021 AT REEL/FRAME 055288/0371 Recorded Jul 3, 2023
From: JPMORGAN CHASE BANK, N.A.
To: VIMEO.COM, INC. (FKA VIMEO, INC.)
Reel/Frame 064193/0449 →
CHANGE OF NAME Recorded Jun 25, 2021
From: VIMEO, INC.
To: VIMEO.COM, INC.
Reel/Frame 056754/0261 →
SECURITY AGREEMENT Recorded Feb 12, 2021
From: VIMEO, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 055288/0371 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: MAGISTO LTD.
To: VIMEO, INC.
Reel/Frame 051435/0430 →
Continuity (6)
Continuation In Part 15012875 · Feb 2, 2016
Continuation In Part 14538361 · Nov 11, 2014
Provisional Application 62470410 · Mar 13, 2017
Provisional Application 62110651 · Feb 2, 2015
Provisional Application 61902307 · Nov 11, 2013
Related Publication 20180204597A1 · Jul 19, 2018