IP Library › Granted Patent US 12,744,911
Granted Patent B2
US 12,744,911 · App. 19/049,062 · Granted Sep 22, 2026

Methods and systems for automated synchronization and optimization of audio visual files

Inventor: Brian Hardy (Atlanta, GA)
Assignee: EDG, LLC
H04N19/139H04N19/119H04N19/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,744,911
App. No.
19/049,062
Granted
Sep 22, 2026
Kind
B2
Abstract

One variation of a method for autonomously generating an optimized audio-visual (AV) file from an original AV file comprises: a) generating a vector cube comprising a plurality of vector matrices for an original AV file; b) for each vector matrix within the vector cube, determining an optimal subframe having a subframe size larger than or equal to a predetermined minimum subframe size; and c) generating an optimized AV file based on the optimal subframes determined for each of the vector matrices within the vector cube.

Claims (46)

1 . A computer-implemented method for processing a video, the method comprising:

identifying a plurality of still images from an original video;

identifying, based on a framework applicable to respective ones of the plurality of still images, a first area within a first still image of the plurality of still images;

identifying, based on the framework, a second area within a second still image of the plurality of still images, the second area corresponding to the first area;

determining a quantitative score associated with an extent to which a difference between the first area of the first still image and the second area of the second still image is frameable within a first subframe of the framework, wherein a size of the first subframe is smaller than a size of the framework;

determining, based on the quantitative score, a second subframe of the framework that improves upon the extent to which the difference between the first area of the first still image and the second area of the second still image is frameable within the first subframe, wherein a size of the second subframe is smaller than the size of the framework and different from the size of the first subframe;

modifying, based on the second subframe, the second still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified second still image; and

including the modified second still image in a new video.

2 . The method of claim 1 , wherein the quantitative score is a first quantitative score, the method further comprising:

identifying, based on the framework, a third area within a third still image of the plurality of still images, the third area corresponding to the second area;

determining a second quantitative score associated with an extent to which a difference between the second area of the second still image and the third area of the third still image is frameable within the second subframe of the framework;

determining, based on the second quantitative score, a third subframe of the framework that improves upon the extent to which the difference between the second area of the second still image and the third area of the third still image is frameable within the second subframe, wherein a size of the third subframe is smaller than the size of the framework and different from the size of the second subframe;

modifying, based on the third subframe, the third still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified third still image; and

including the modified third still image in the new video.

3 . The method of claim 1 , wherein the original video also includes audio.

4 . The method of claim 1 , wherein respective ones of the plurality of still images from the original video are separated by a same time interval within a time period of the original video.

5 . The method of claim 1 , wherein the difference between the first area of the first still image and the second area of the second still image is determined based on a motion vector.

6 . The method of claim 1 , wherein the difference between the first area of the first still image and the second area of the second still image is determined based on a pixel delta.

7 . The method of claim 1 , wherein the difference between the first area of the first still image and the second area of the second still image is determined using computer vision techniques.

8 . The method of claim 1 , wherein the first area corresponds to a location of an object in the first still image.

9 . The method of claim 1 , wherein the size of the second subframe is equal to or larger than a predetermined minimum subframe size.

10 . The method of claim 1 , wherein size of the second subframe is proportional to the size of the framework.

11 . A system configured to process a video, the system comprising:

memory including machine-readable instructions; and

one or more processors configured, in response to executing the machine-readable instructions, to perform operations comprising:

identifying a plurality of still images from an original video;

identifying, based on a framework applicable to respective ones of the plurality of still images, a first area within a first still image of the plurality of still images;

identifying, based on the framework, a second area within a second still image of the plurality of still images, the second area corresponding to the first area;

determining a quantitative score associated with an extent to which a difference between the first area of the first still image and the second area of the second still image is frameable within a first subframe of the framework, wherein a size of the first subframe is smaller than a size of the framework;

determining, based on the quantitative score, a second subframe of the framework that improves upon the extent to which the difference between the first area of the first still image and the second area of the second still image is frameable within the first subframe, wherein a size of the second subframe is smaller than the size of the framework and different from the size of the first subframe;

modifying, based on the second subframe, the second still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified second still image; and

including the modified second still image in a new video.

12 . The system of claim 11 , wherein the quantitative score is a first quantitative score, wherein the operations further comprise:

identifying, based on the framework, a third area within a third still image of the plurality of still images, the third area corresponding to the second area;

determining a second quantitative score associated with an extent to which a difference between the second area of the second still image and the third area of the third still image is frameable within the second subframe of the framework;

determining, based on the second quantitative score, a third subframe of the framework that improves upon the extent to which the difference between the second area of the second still image and the third area of the third still image is frameable within the second subframe, wherein a size of the third subframe is smaller than the size of the framework and different from the size of the second subframe;

modifying, based on the third subframe, the third still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified third still image; and

including the modified third still image in the new video.

13 . The system of claim 11 , wherein the original video also includes audio.

14 . The system of claim 11 , wherein respective ones of the plurality of still images from the original video are separated by a same time interval within a time period of the original video.

15 . The system of claim 11 , wherein the difference between the first area of the first still image and the second area of the second still image is determined based on a motion vector.

16 . The system of claim 11 , wherein the difference between the first area of the first still image and the second area of the second still image is determined based on a pixel delta.

17 . The system of claim 11 , wherein the difference between the first area of the first still image and the second area of the second still image is determined using computer vision techniques.

18 . The system of claim 11 , wherein the first area corresponds to a location of an object in the first still image.

19 . The system of claim 11 , wherein the size of the second subframe is equal to or larger than a predetermined minimum subframe size.

20 . The system of claim 11 , wherein size of the second subframe is proportional to the size of the framework.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2026
From: HARDY, BRIAN
To: EDG, LLC
Reel/Frame 075298/0498 →
Continuity (5)
Continuation 18497150 · Oct 30, 2023
Continuation 17722803 · Apr 18, 2022
Continuation 17197741 · Mar 10, 2021
Provisional Application 62988070 · Mar 11, 2020
Related Publication 20260006212A1 · Jan 1, 2026
References Cited (43)
US 6043845A · Thompson · 2000 [cited by applicant]
US 6577766B1 · Standridge · 2003 [cited by applicant]
US 7917935B2 · McAlpine et al. · 2011 [cited by applicant]
US 9001207B1 · Webb et al. · 2015 [cited by applicant]
US 9147239B2 · Pau et al. · 2015 [cited by applicant]
US 9270941B1 · Lavelle · 2016 [cited by applicant]
US 9311738B2 · Kilgard · 2016 [cited by applicant]
US 9521398B1 · Woodman · 2016 [cited by examiner]
US 9626584B2 · Lin et al. · 2017 [cited by applicant]
US 9798933B1 · Meisser et al. · 2017 [cited by applicant]
US 10104338B2 · Goesnar · 2018 [cited by applicant]
US 10113910B2 · Brunk et al. · 2018 [cited by applicant]
US 10356279B2 · Yamada · 2019 [cited by applicant]
US 10498941B2 · Rhoads et al. · 2019 [cited by applicant]
US 10506196B2 · Ray et al. · 2019 [cited by applicant]
US 10587800B2 · Boyce et al. · 2020 [cited by applicant]
US 10806009B2 · Rodinger et al. · 2020 [cited by applicant]
US 10853953B2 · Nater et al. · 2020 [cited by applicant]
US 10867422B2 · Zhang et al. · 2020 [cited by applicant]
US 10878245B2 · Nater et al. · 2020 [cited by applicant]
US 10986308B2 · Huynh Thien et al. · 2021 [cited by applicant]
US 11430155B2 · Tourapis et al. · 2022 [cited by applicant]
US 20020122659A1 · McGrath · 2002 [cited by examiner]
US 20050243925A1 · Bottreau · 2005 [cited by examiner]
US 20060088191A1 · Zhang · 2006 [cited by examiner]
US 20070005795A1 · Gonzalez · 2007 [cited by examiner]
US 20070016405A1 · Mehrotra · 2007 [cited by examiner]
US 20070200853A1 · Bruggeman · 2007 [cited by examiner]
US 20070288973A1 · Glatron et al. · 2007 [cited by applicant]
US 20080231756A1 · Kondo · 2008 [cited by examiner]
US 20110096840A1 · Sano · 2011 [cited by examiner]
US 20150371426A1 · Levy · 2015 [cited by examiner]
US 20160218820A1 · Scurrell · 2016 [cited by examiner]
US 20170076156A1 · Borel et al. · 2017 [cited by applicant]
US 20180374192A1 · Kunkel · 2018 [cited by examiner]
US 20190035431A1 · Attorre · 2019 [cited by examiner]
US 20190102908A1 · Yang et al. · 2019 [cited by applicant]
US 20200162643A1 · Park · 2020 [cited by examiner]
US 20210104014A1 · Kolb, V · 2021 [cited by examiner]
US 20210239863A1 · Tavitian · 2021 [cited by examiner]
CA 2547445A1 · 2005 [cited by applicant]
EP 2065244A2 · 2009 [cited by applicant]
WO 2015077493A1 · 2015 [cited by applicant]