Segmented video codec for high resolution and high frame rate video
Embodiments disclosed herein provide systems, methods, and computer readable media for a segmented video codec for high resolution and high frame rate video. In a particular embodiment, a method of encoding a composite video stream provides identifying a first portion of an image of a video stream for encoding using first parameters and a second portion of the image of the video stream for encoding using second parameters. The method further provides segmenting the first portion of the image into one or more first tiles and the second portion of the image into one or more second tiles. The method further provides encoding the first tiles using the first parameters and the second tiles using the second parameters and, after the encoding, combining the first tiles and the second tiles into the composite video stream.
1. A method of decoding a composite video stream, comprising:
in a decoder system:
receiving the composite video stream, wherein the composite video stream comprises a combination of one or more first tiles of an image of a video stream encoded using first parameters and one or more second tiles of the image of the video stream encoded using second parameters, wherein the first parameters comprise a first frame rate and a first resolution and the second parameters include a second frame rate and a second resolution;
after receiving, segmenting the composite video stream into the first and second tiles;
after segmenting, decoding the first tiles based on the first parameters and decoding the second tiles based on the second parameters; and
after decoding, combining the first tiles and the second tiles for display of the image of the video stream.
2. The method of claim 1 , comprising:
receiving tile segment information associated with the composite video stream; and
wherein segmenting the composite video stream is performed based on the tile segment information.
3. The method of claim 2 , wherein the tile segment information is received in a supplemental enhancement information (SEI) message.
4. The method of claim 1 , wherein the first frame rate is higher than the second frame rate and the first resolution is lower than the second resolution.
5. The method of claim 4 , wherein the composite video stream comprises a video having the first frame rate and the second resolution.
6. The method of claim 1 , comprising:
after combining, displaying the image of the video stream.
7. The method of claim 1 , wherein the composite video stream is transmitted from an encoder system, wherein, before transmitting the encoder system, the encoder system encodes the first tiles using the first parameters and the second tiles using the second, and then combines the first tiles and the second tiles into the composite video stream.
8. The method of claim 1 , wherein the decoding is performed using the H.265 codec.
9. An apparatus comprising:
one or more computer readable storage media;
a processing system operatively coupled with the one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media that, when read and executed by the processing system, direct the processing system to:
receive a composite video stream, wherein the composite video stream comprises a combination of one or more first tiles of an image of a video stream encoded using first parameters and one or more second tiles of the image of the video stream encoded using second parameters, wherein the first parameters comprise a first frame rate and a first resolution and the second parameters include a second frame rate and a second resolution;
after the composite video stream is received, segment the composite video stream into the first and second tiles;
after the composite video stream is segmented, decode the first tiles based on the first parameters and decode the second tiles based on the second parameters; and
after the first tiles and the second tiles are decoded, combine the first tiles and the second tiles for display of the image of the video stream.
10. The apparatus of claim 9 , wherein the program instructions direct the processing system to:
receive tile segment information associated with the composite video stream; and
wherein segmenting the composite video stream is performed based on the tile segment information.
11. The apparatus of claim 10 , wherein the tile segment information is received in a supplemental enhancement information (SEI) message.
12. The apparatus of claim 9 , wherein the first frame rate is higher than the second frame rate and the first resolution is lower than the second resolution.
13. The apparatus of claim 12 , wherein the composite video stream comprises a video having the first frame rate and the second resolution.
14. The apparatus of claim 9 , wherein the program instructions direct the processing system to:
after the first tiles and the second tiles are combined, display the image of the video stream.
15. An apparatus comprising:
one or more computer readable storage media;
a processing system operatively coupled with the one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media that, when read and executed by the processing system, direct the processing system to:
identify a first portion of an image of a video stream for encoding using first parameters and a second portion of the image of the video stream for encoding using second parameters, wherein the first parameters comprise a first frame rate and a first resolution and the second parameters include a second frame rate and a second resolution;
segment the first portion of the image into one or more first tiles and the second portion of the image into one or more second tiles;
after the first portion and the second portion are segmented, encode the first tiles using the first parameters and the second tiles using the second parameters; and
after first tiles and the second tiles are encoded, combine the first tiles and the second tiles into a composite video stream.
16. The apparatus of claim 15 , wherein the first frame rate is higher than the second frame rate and the first resolution is lower than the second resolution.
17. The apparatus of claim 16 , wherein the composite video stream comprises a video having the first frame rate and the second resolution.
18. The apparatus of claim 15 , wherein the program instructions direct the processing system to:
transfer the composite video stream to a decoder system, wherein the decoder system decodes the composite video stream for display.
19. The apparatus of claim 18 , wherein the program instructions direct the processing system to:
transfer tile segment information to the decoder system using a supplemental enhancement information (SEI) message, wherein the decoder system decodes the composite video stream based on the tile segment information.
20. The apparatus of claim 15 , wherein the encoding is performed using the H.265 codec.