Methods and systems for automated synchronization and optimization of audio-visual files
View Patent ↗One variation of a method for autonomously generating an optimized audio-visual (AV) file from an original AV file comprises: a) generating a vector cube comprising a plurality of vector matrices for an original AV file; b) for each vector matrix within the vector cube, determining an optimal subframe having a subframe size larger than or equal to a predetermined minimum subframe size; and c) generating an optimized AV file based on the optimal subframes determined for each of the vector matrices within the vector cube.
1. A computer-implemented method for processing a video file, the method comprising:
identifying a plurality of still images from an original video file;
identifying, based on a geometric framework applicable to respective ones of the plurality of still images, two or more first areas within a first still image of the plurality of still images;
identifying, based on the geometric framework, two or more second areas within a second still image of the plurality of still images, wherein the two or more second areas correspond to the two or more first areas;
identifying, based on the geometric framework, two or more third areas within a third still image of the plurality of still images, wherein the two or more third areas correspond to the two or more second areas;
determining, for each one of the two or more first areas relative to each corresponding one of the two or more second areas, a first value associated with a difference between the first still image and the second still image;
determining, for each one of the two or more second areas relative to each corresponding one of the two or more third areas, a second value associated with a difference between the second still image and the third still image;
determining, based on the first values, a first preferred subframe for a first segment associated with the first still image and the second still image;
determining, based on the second values, a second preferred subframe for a second segment associated with the second still image and the third still image;
modifying, based on the first preferred subframe, the first still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified first still image;
modifying, based on the second preferred subframe, the second still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified second still image; and
compiling the modified first still image and the modified second still image into a new video file.
2. The method of claim 1 , wherein the original video file also includes audio.
3. The method of claim 1 , wherein respective ones of the plurality of still images from the original video file are separated by the same time interval within a time period of the original video file.
4. The method of claim 1 , wherein the first values associated with the differences between the first still image and the second still image are determined based on motion vectors.
5. The method of claim 1 , wherein the first values associated with the differences between the first still image and the second still image are determined based on pixel deltas.
6. The method of claim 1 , wherein the first values associated with the differences between the first still image and the second still image are determined based on pixel RGB values.
7. The method of claim 1 , wherein the first values associated with the differences between the first still image and the second still image are determined using computer vision techniques.
8. The method of claim 1 , wherein each of the two or more first areas corresponds to a location of an object in the first still image.
9. The method of claim 1 , wherein the first preferred subframe has a size that is equal to or larger than a predetermined minimum subframe size.
10. The method of claim 1 , wherein the first preferred subframe has a size that is proportional to a size of the geometric framework.
11. A system configured to process a video file, the system comprising:
memory including machine-readable instructions; and
one or more processors configured, in response to executing the machine-readable instructions, to perform operations comprising:
identifying a plurality of still images from an original video file;
identifying, based on a geometric framework applicable to respective ones of the plurality of still images, two or more first areas within a first still image of the plurality of still images;
identifying, based on the geometric framework, two or more second areas within a second still image of the plurality of still images, wherein the two or more second areas correspond to the two or more first areas;
identifying, based on the geometric framework, two or more third areas within a third still image of the plurality of still images, wherein the two or more third areas correspond to the two or more second areas;
determining, for each one of the two or more first areas relative to each corresponding one of the two or more second areas, a first value associated with a difference between the first still image and the second still image;
determining, for each one of the two or more second areas relative to each corresponding one of the two or more third areas, a second value associated with a difference between the second still image and the third still image;
determining, based on the first values, a first preferred subframe for a first segment associated with the first still image and the second still image;
determining, based on the second values, a second preferred subframe for a second segment associated with the second still image and the third still image;
modifying, based on the first preferred subframe, the first still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified first still image;
modifying, based on the second preferred subframe, the second still image through one or more of (i) a cropping process, (ii) a zooming process, or (iii) a panning process to create a modified second still image; and
compiling the modified first still image and the modified second still image into a new video file.
12. The system of claim 11 , wherein the original video file also includes audio.
13. The system of claim 11 , wherein respective ones of the plurality of still images from the original video file are separated by the same time interval within a time period of the original video file.
14. The system of claim 11 , wherein the first values associated with the differences between the first still image and the second still image are determined based on motion vectors.
15. The system of claim 11 , wherein the first values associated with the differences between the first still image and the second still image are determined based on pixel deltas.
16. The system of claim 11 , wherein the first values associated with the differences between the first still image and the second still image are determined based on pixel RGB values.
17. The system of claim 11 , wherein the first values associated with the differences between the first still image and the second still image are determined using computer vision techniques.
18. The system of claim 11 , wherein each of the two or more first areas corresponds to a location of an object in the first still image.
19. The system of claim 11 , wherein the first preferred subframe has a size that is equal to or larger than a predetermined minimum subframe size.
20. The system of claim 11 , wherein the first preferred subframe has a size that is proportional to a size of the geometric framework.