Method and system for frame buffer compression and memory resource reduction for 3D video
View Patent ↗Systems, methods, and computer-readable storage media that may be used to encode and multiplex video are provided. One method includes receiving uncompressed three-dimensional (3D) video including a left view video and a right view video. The method further includes encoding the left view video and the right view video into a base view video and an enhancement view video. One or more pictures in the base view video that are not used to predict corresponding pictures in the enhancement view video are dropped based on available memory resources. The method further includes generating residual view video by subtracting base view pictures from corresponding enhancement view pictures, and multiplexing the base view video and the generated residual view video into a single transport stream.
1. A method, comprising:
receiving, by one or more processing circuits in a video processing system, uncompressed three-dimensional (3D) video comprising a left view video and a right view video;
encoding the left view video and the right view video into a base view video and an enhancement view video, wherein one or more pictures in the base view video that are not used to predict corresponding pictures in the enhancement view video are dropped based on available memory resources;
generating residual view video by subtracting base view pictures from corresponding enhancement view pictures; and
multiplexing the base view video and the generated residual view video into a single transport stream.
2. The method of claim 1 , further comprising storing the base view video and the generated residual view video for transmission.
3. The method of claim 1 , further comprising transmitting the single transport stream to a video receiving unit.
4. The method of claim 3 , further comprising receiving, at the video receiving unit, the transmitted single transport stream, demultiplexing the single transport stream to form the base view video and the residual view video, and decoding the base view video into the left view video, the right view video, or both left and right view videos.
5. The method of claim 4 , further comprising decoding the residual view video and producing pictures in the enhancement view video of the received single transport stream by adding pictures in the decoded residual view video to corresponding pictures in the decoded base view video.
6. The method of claim 5 , comprising decoding the produced pictures in the enhancement view video into the left view video, the right view video, or both left and right view videos.
7. The method of claim 4 , comprising using a motion vector to fetch a macroblock of a picture in the left view video for motion prediction for a macroblock of a picture in the right view video, wherein the macroblock of the picture in the right view video is disparity predicted from the macroblock of a picture in the left view video.
8. The method according to claim 7 , comprising using the motion vector to pre-fetch one or more adjacent macroblocks of the pictures in the left view video for motion prediction for corresponding one or more adjacent macroblocks of the picture in the right view video.
9. A system, comprising:
one or more circuits configured to:
receive uncompressed three-dimensional (3D) video comprising a left view video and a right view video;
encode the left view video and the right view video into a base view video and an enhancement view video, wherein one or more pictures in the base view video that are not used to predict corresponding pictures in the enhancement view video are dropped based on available memory resources;
generate residual view video by subtracting base view pictures from corresponding enhancement view pictures; and
multiplex the base view video and the generated residual view video into a single transport stream.
10. The system of claim 9 , wherein the video processing system is further configured to store the base view video and the generated residual view video for transmission.
11. The system of claim 9 , wherein the video processing system is further configured to transmit the single transport stream to a video receiving unit.
12. The system of claim 11 , further comprising the video receiving unit, wherein the video receiving unit is configured to receive the transmitted single transport stream, demultiplex the single transport stream to form the base view video and the residual view video, and decode the base view video into the left view video, the right view video, or both left and right view videos.
13. The system of claim 12 , wherein the video receiving unit is further configured to decode the residual view video and produce pictures in the enhancement view video of the received single transport stream by adding pictures in the decoded residual view video to corresponding pictures in the decoded base view video.
14. The system of claim 13 , wherein the video receiving unit is further configured to decode the produced pictures in the enhancement view video into the left view video, the right view video, or both left and right view videos.
15. The system of claim 9 , wherein the video processing system is further configured to use a motion vector to fetch a macroblock of a picture in the left view video for motion prediction for a macroblock of a picture in the right view video, wherein the macroblock of the picture in the right view video is disparity predicted from the macroblock of a picture in the left view video.
16. The system of claim 15 , wherein the video processing system is further configured to use the motion vector to pre-fetch one or more adjacent macroblocks of the picture in the left view video for motion prediction for corresponding one or more adjacent macroblocks of the picture in the right view video.
17. The system of claim 9 , wherein said one or more processors, said one or more circuits, or said combination thereof are operable to buffer received base view video and received residual view video.
18. A non-transitory computer readable medium having instructions stored thereon that, when executed by a one or more processors of a video processing system, cause the one or more processors to:
receive uncompressed three-dimensional (3D) video comprising a left view video and a right view video;
encode the left view video and the right view video into a base view video and an enhancement view video, wherein one or more pictures in the base view video that are not used to predict corresponding pictures in the enhancement view video are dropped based on available memory resources;
generate residual view video by subtracting base view pictures from corresponding enhancement view pictures; and
multiplex the base view video and the generated residual view video into a single transport stream.
19. The non-transitory computer readable medium of claim 18 , wherein the executable instructions further cause the computer processor circuitry to use a motion vector to fetch a macroblock of a picture in the left view video for motion prediction for a macroblock of a picture in the right view video, wherein the macroblock of the picture in the right view video is disparity predicted from the macroblock of a picture in the left view video.
20. The non-transitory computer readable medium of claim 19 , wherein the executable instructions further cause the computer processor circuitry to use the motion vector to pre-fetch one or more adjacent macroblocks of the picture in the left view video for motion prediction for corresponding one or more adjacent macroblocks of the picture in the right view video.