Just-in-time distributed video cache

1. A method for streaming optimized video to a client device, the method comprising:

receiving a request to optimize an original source file from a client device, the original source file stored on an origin server and the request including a key specifying parameters for optimizing the original source file and uniquely identifying the original source file;

identifying, based on the key, a preview of an optimized version of the original source file in a local cache of a video optimization server, the preview corresponding to a first portion of the optimized version of the original source file;

generating a query, based on the key, to a cache database maintaining a plurality of reference keys corresponding to a plurality of optimized versions of source files stored on a plurality of other video optimization servers, each reference key specifying parameters of an optimized version of a source file and uniquely identifying the source file;

receiving, from the cache database, a response indicating whether the key matches a reference key maintained in the database;

receiving from the cache database, in response to a reference key matching the key, the address of another video optimizer storing a segment of the optimized version of the original source file;

stitching the first portion of the optimized version of the original source file with the segment of the optimized version of the original source file stored on the other video optimizer to generate a stitched optimized version of the original source file; and

streaming the stitched optimized version of the original source file for playback on the client device.

2. The method of claim 1 , further comprising:

storing a segment of the stitched optimized version of the original source file in the cache of the video optimizer; and

transmitting, to the cache database, instructions for updating the cache database in response to storing the segment of the stitched optimized version of the original source file stored in the video optimizer.

3. The method of claim 1 , wherein the received response indicates that different segments of the optimized version of the same original source file are stored on a plurality of different video optimizers.

4. The method of claim 3 , further comprising:

transmitting, to the plurality of different video optimizers, a request for the segment of the optimized version of the original source file stored on each video optimizer; and

stitching the different segments of the optimized version of the same original source file with the generated segment of the original source file.

5. The method of claim 1 , wherein the key comprises a source content signature, the source content signature being a hash of the original source file.

6. The method of claim 1 , wherein the cache database comprising data entries identifying a plurality of optimization server storing an optimized version of the original source file, the entries being modified through instructions transmitted to the cache database to update a location where the optimized version of the original source file is stored.

7. The method of claim 1 , further comprising:

determining a second segment of the optimized version of the original source file is not stored by the plurality of other video optimization servers;

responsive to the determination, transcoding the second segment of the original source file;

storing the transcoded second segment in the local cache of the video optimization server; and

stitching the transcoded second segment with the stitched optimized version of the original source file.

8. The method of claim 7 , further comprising transmitting to the cache database, instructions for updating the cache database with a reference key corresponding to the transcoded second segment of the optimized version of the source file stored at the video optimization server.

9. The method of claim 7 , wherein transcoding the second segment of the original source file comprises:

identifying a third segment of the optimized version of the original source file, subsequent to the second segment, that is stored by one of the plurality of other video optimization servers; and

transcoding the original source file from a start of the second segment to a start of the third segment.

10. The method of claim 1 , wherein the preview is maintained in the local cache of the video optimization server after one or more purges of the local cache.

11. A system for streaming optimized video to a client device, comprising:

at least one processor; and

a non-transitory computer-readable storage medium storing executable computer program instructions that when executed by the processor, cause the processor to:

receive a request to optimize an original source file from a client device, the original source file stored on an origin server and the request including a key specifying parameters for optimizing the original source file and uniquely identifying the original source file;

identify, based on the key, a preview of an optimized version of the original source file in a local cache of a video optimization server, the preview corresponding to a first portion of the optimized version of the original source file;

generate a query, based on the key, to a cache database maintaining a plurality of reference keys corresponding to a plurality of optimized versions of source files stored on a plurality of other video optimization servers, each reference key specifying parameters of an optimized version of a source file and uniquely identifying the source file;

receive, from the cache database, a response indicating whether the key matches a reference key maintained in the database;

receive from the cache database, in response to a reference key matching the key, the address of another video optimizer storing a segment of the optimized version of the original source file;

stitch the first portion of the optimized version of the original source file with the segment of the optimized version of the original source file stored on the other video optimizer to generate a stitched optimized version of the original source file; and

stream the stitched optimized version of the original source file for playback on the client device.

12. The system of claim 11 , wherein the storage medium further comprises instructions that when executed cause the processor to:

store a segment of the stitched optimized version of the original source file in the cache of the video optimizer; and

transmit, to the cache database, instructions for updating the cache database in response to storing the segment of the stitched optimized version of the original source file stored in the video optimizer.

13. The system of claim 11 , wherein the received response indicates that different segments of the optimized version of the same original source file are stored on a plurality of different video optimizers, and wherein the storage medium further comprises instructions that when executed cause the processor to:

transmit, to the plurality of different video optimizers, a request for the segment of the optimized version of the original source file stored on each video optimizer; and

stitch the different segments of the optimized version of the same original source file with the generated segment of the original source file.

14. The system of claim 11 , wherein the key comprises a source content signature, the source content signature being a hash of the original source file.

15. The system of claim 11 , wherein the cache database comprises data entries to identify a plurality of optimization servers storing an optimized version of the original source file, the entries being modified through instructions transmitted to the cache database to update a location where the optimized version of the original source file is stored.

16. The system of claim 11 , wherein the storage medium further comprises instructions that when executed cause the processor to:

determine a second segment of the optimized version of the original source file is not stored by the plurality of other video optimization servers;

transcode, responsive to the determination, the second segment of the original source file;

store the transcoded second segment in the local cache of the video optimization server; and

stitch the transcoded second segment with the stitched optimized version of the original source file.

17. The system of claim 16 , wherein the storage medium further comprises instructions that when executed cause the processor to transmit to the cache database, instructions for updating the cache database with a reference key corresponding to the transcoded second segment of the optimized version of the source file stored at the video optimization server.

18. The system of claim 16 , wherein the instructions on the computer readable storage medium to transcode the second medium further comprises instructions that when executed cause the processor to:

identify a third segment of the optimized version of the original source file, subsequent to the second segment, that is stored by one of the plurality of other video optimization servers; and

transcode the original source file from a start of the second segment to a start of the third segment.

19. The system of claim 11 , wherein the preview is maintained in the local cache of the video optimization server after one or more purges of the local cache.