Method and system of processing image sequences
A system or method for processing a variable bit rate representation of an image sequence can include segmenting a variable bit rate representation of an image sequence into a plurality of segments and creating a second representation of the image sequence where a block of information from a first segment of the plurality of segments is interlaced with blocks of information of a second segment of the plurality of segments. The second representation of the image sequence can include a fragment header indicating the block of information of the first segment of the plurality of segments interlaced with the blocks of information of the second segment of the plurality of segments.
1. A method, comprising:
segmenting, by a system comprising a processor, a variable bit rate representation of an image into a plurality of packets; and
interlacing, by the system, the plurality of packets, wherein the interlacing comprises:
removing blocks of information from a packet of the plurality of packets that comprises a number of blocks of information greater than a baseline value for the plurality of packets as a removed block of information;
forwarding the removed block of information to a next packet of the plurality of packets, wherein the next packet comprises a number of blocks of information less than the baseline value;
creating a second representation of the variable bit rate representation based on the removing and forwarding, wherein each packet of the second representation comprises reconstruction information to describe a reconstruction of the variable bit rate representation from the second representation; and
extending a size of each packet of the plurality of packets to cause each packet to have a size within an upper bound after creating the second representation,
wherein the reconstruction information comprises one of block number data identifying an original packet of the removed block, fragment number data to identify the removed block, length data indicating a length of the removed block, last fragment number data to indicate a sequence of the removed blocks, optional stuffing length data, peak size data indicating how many time-advance bytes are need to be buffered to reconstruct the variable bit representation, or any combination thereof.
2. The method of claim 1 , wherein each packet of the plurality of packets spans a same time interval, and wherein each packet of the second representation comprises a header that includes the reconstruction information.
3. The method of claim 1 , wherein, after creating the second representation, first and second packets of the plurality of packets comprise a same number of blocks of information.
4. The method of claim 1 , further comprising:
streaming the second representation of the variable bit rate representation; and
reconstructing frames of the variable bit rate representation.
5. The method of claim 4 , further comprising reconstructing frames of the variable bit rate representation based on reconstruction information and blocks of information received in real time.
6. A non-transitory, computer-readable storage medium, comprising a computer program, wherein responsive to executing the computer program, a processor performs operations comprising:
segmenting a variable bit rate representation of an image sequence into a plurality of packets;
interlacing the plurality of packets, wherein the interlacing comprises:
removing blocks of information from a packet of the plurality of packets that comprises a number of blocks of information greater than a baseline value for the plurality of packets as a removed block of information;
forwarding the removed block of information to a next packet of the plurality of packets, wherein the next packet comprises a number of blocks of information less than a baseline value, wherein the interlacing comprises creating a second representation of the image sequence, wherein each packet of the second representation comprises reconstruction information to describe a reconstruction of the variable bit rate representation from the second representation; and
extending a size of each packet of the plurality of packets to cause each packet to have a size within an upper bound after creating the second representation,
wherein the reconstruction information comprises one of block number data identifying an original packet of the removed block, fragment number data to identify the removed block, length data indicating a length of the removed block, last fragment number data to indicate a sequence of the removed blocks, optional stuffing length data, peak size data indicating how many time-advance bytes are need to be buffered to reconstruct the variable bit representation, or any combination thereof.
7. The non-transitory, computer-readable storage medium of claim 6 , wherein each packet of the plurality of packets spans a same time interval.
8. The non-transitory, computer-readable storage medium of claim 6 , wherein, after creating the second representation, first and second packets of the plurality of packets comprise a same number of blocks of information, and wherein each packet of the second representation comprises a header that includes the reconstruction information.
9. The non-transitory, computer-readable storage medium of claim 6 , further comprising:
streaming the second representation of the image sequence via a communication network; and
reconstructing frames of the image sequence in real time.
10. The non-transitory, computer-readable storage medium of claim 9 , wherein the operations further comprise reconstructing frames of the image sequence based on reconstruction information and blocks of information received in real time.
11. A system for processing a variable bit rate representation of an image sequence, the system comprising:
a computer readable medium storing a computer program; and
a processor coupled to the computer readable medium, wherein responsive to executing the computing program, the processor performs operations comprising:
segmenting the variable bit rate representation into a plurality of packets;
interlacing the plurality of packets, wherein the interlacing comprises:
removing blocks of information from a packet of the plurality of packets that comprises a number of blocks of information greater than a baseline value for the plurality of packets as a removed block of information; and
forwarding the removed block of information to a next packet of the plurality of packets, wherein the next packet comprises a number of blocks of information less than a baseline value,
wherein the interlacing comprises creating a second representation of the image sequence from a first representation, wherein the first representation comprises the plurality of packets, wherein each packet of the second representation comprises reconstruction information to reverse the removing and forwarding of packets,
wherein the reconstruction information comprises one of block number data identifying an original packet of the removed block, fragment number data to identify the removed block, length data indicating a length of the removed block, last fragment number data to indicate a sequence of the removed blocks, optional stuffing length data, and peak size data indicating how many time-advance bytes are need to be buffered to reconstruct the variable bit representation.
12. The system of claim 11 , wherein each packet of the plurality of packets spans a same time interval.
13. The system of claim 11 , wherein each packet of the second representation comprises a header that includes the reconstruction information, and further comprising:
streaming the second representation of the image sequence via a communication network; and
reconstructing frames of the image sequence.
14. The system of claim 13 , wherein the operations further comprise reconstructing frames of the image sequence based on reconstruction information and blocks of information received in real time.