IP Library › Granted Patent US 11,350,103
Granted Patent B2
US 11,350,103 · App. 17/197,741 · Granted May 31, 2022

Methods and systems for automated synchronization and optimization of audio-visual files

Inventor: Brian Hardy (Atlanta, GA)
Assignee: Videomentum Inc.
H04N19/139H04N19/119H04N19/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,350,103
App. No.
17/197,741
Granted
May 31, 2022
Kind
B2
Abstract

One variation of a method for autonomously generating an optimized audio-visual (AV) file from an original AV file comprises: a) generating a vector cube comprising a plurality of vector matrices for an original AV file; b) for each vector matrix within the vector cube, determining an optimal subframe having a subframe size larger than or equal to a predetermined minimum subframe size; and c) generating an optimized AV file based on the optimal subframes determined for each of the vector matrices within the vector cube.

Claims (41)

1. A computer-implemented method for autonomously generating an optimized audio-visual (AV) file from an original AV file, the method comprising:

a. generating a vector cube comprising a plurality of vector matrices for an original AV file;

b. for each vector matrix within the vector cube:

i. identifying a plurality of possible subframes within the vector matrix;

ii. generating a subframe score for each possible subframe of the plurality of possible subframes; and

iii. selecting, from the plurality of possible subframes, the possible subframe having the highest subframe score as an optimal subframe for the vector matrix; and

c. generating an optimized AV file based on the optimal subframes determined for each of the vector matrices within the vector cube.

2. The method of claim 1 , wherein at least one of the optimal subframes has a subframe size smaller than the frame size of the original AV file.

3. The method of claim 1 , wherein the optimal subframe determined for each vector matrix within the vector cube must have a subframe score higher than each other possible subframe of the same subframe size within the vector matrix.

4. The method of claim 1 , wherein the optimal subframe determined for each vector matrix within the vector cube must have an activity ratio higher than that of each other possible subframe of the same subframe size within the vector matrix.

5. The method of claim 1 , further comprising applying a clustering filter to the vector cube.

6. The method of claim 1 , further comprising applying a normalizing filter to the vector cube.

7. The method of claim 1 , further comprising applying a characterizing filter to the vector cube.

8. The method of claim 1 , wherein generating the optimized AV file based on the optimal subframes determined for each of the vector matrices comprises cropping, panning, or zooming between the optimal subframes determined for two or more vector matrices representing two or more respective and consecutive segments of the original AV file.

9. The method of claim 1 , wherein generating the optimized AV file based on the optimal subframes determined for each of the vector matrices comprises cropping, panning, or zooming between the optimal subframes determined for two vector matrices representing consecutive segments of the original AV file only after a predetermined minimum number of consecutive segments since a previous cropping, panning, or zooming.

10. The method of claim 1 , wherein generating the optimized AV file based on the optimal subframes determined for each of the vector matrices comprises cropping, panning, or zooming between the optimal subframes determined for two vector matrices representing consecutive segments of the original AV file only if the optimal subframes have at least a predetermined minimum percentage of overlapping cells.

11. The method of claim 1 , wherein the optimal subframes must have the same aspect ratio of the original AV file.

12. The method of claim 1 , wherein the optimal subframes have a uniform and different aspect ratio than that of the original AV file.

13. The method of claim 1 , wherein the vector cube is generated using motion vectors.

14. The method of claim 1 , wherein the vector cube is generated using pixel deltas.

15. The method of claim 1 , wherein generating the vector cube for the original AV file comprises:

a. dividing the original AV file into a plurality of still images;

b. overlaying a grid of cells atop each of the still images within the plurality of still images;

c. generating the plurality of vector matrices by calculating a cell score between corresponding cells within the grids of each consecutive pair of still images; and

d. compiling the plurality of vector matrices into the vector cube.

16. The method of claim 15 , wherein the original AV file is divided into the plurality of still images based on a predetermined time interval between each still image.

17. The method of claim 15 , wherein the grid of cells overlaid atop each of the still images within the plurality of still images has a predetermined grid size.

18. A system for autonomously generating an optimized audio-visual (AV) file from an original AV file, the system comprising one or more processors configured to:

a. receive an original AV file recorded by a video source;

b. generate a vector cube comprising a plurality of vector matrices for an original AV file;

c. for each vector matrix within the vector cube:

i. identify a plurality of possible subframes within the vector matrix;

ii. generate a subframe score for each possible subframe of the plurality of possible subframes; and

iii. select, from the plurality of possible subframes, the possible subframe having the highest subframe score as an optimal subframe for the vector matrix; and

d. generate an optimized AV file based on the optimal subframes determined for each of the vector matrices within the vector cube.

19. The system of claim 18 , wherein the one or more processors are further configured to generate the optimized AV file based on the optimal subframes determined for each of the vector matrices by cropping, panning, or zooming between the optimal subframes determined for two or more vector matrices representing two or more respective consecutive segments of the original AV file.

20. The system of claim 18 , wherein the one or more processors are further configured to generate the vector cube for the original AV file by:

a. dividing the original AV file into a plurality of still images;

b. overlaying a grid of cells atop each of the still images within the plurality of still images;

c. generating the plurality of vector matrices by calculating a cell score between corresponding cells within the grids of each consecutive pair of still images; and

d. compiling the plurality of vector matrices into the vector cube.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2026
From: HARDY, BRIAN
To: EDG, LLC
Reel/Frame 075298/0498 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2022
From: VIDEOMENTUM/EDG LLC
To: VIDEOMENTUM INC
Reel/Frame 059256/0500 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2021
From: HARDY, BRIAN
To: VIDEOMENTUM/EDG LLC
Reel/Frame 055552/0490 →
Continuity (2)
Provisional Application 62988070 · Mar 11, 2020
Related Publication 20210289208A1 · Sep 16, 2021