Method and system for processing 2D/3D video
A video processor decompresses stereoscopic left and right reference frames of compressed 3D video. New left and right frames are interpolated. The frames may be stored and/or communicated for display. The left and right frames are combined into a single frame of a single stream or may be sequenced in separate left and right streams. The left and right frames are interpolated based on the combined single stream and/or based on the separate left and right streams. Motion vectors are determined for one of the separate left or right streams. The frames are interpolated utilizing motion compensation. Areas of occlusion are determined in the separate left and right streams. Pixels are interpolated for occluded areas of left or right frames of separate streams from uncovered areas in corresponding opposite side frames. The left and right interpolated and/or reference frames are displayed as 3D and/or 2D video.
1. A method for processing video, the method comprising:
performing by one or more processors, one or more circuits, or any combination thereof:
receiving stereoscopic left and right reference fields or frames of compressed video data;
decompressing the left and right reference fields or frames of compressed video data;
determining areas of occlusion in separate left and right streams of fields or frames;
interpolating left and right fields or frames in the separate left and right streams of fields or frames based at least in part on said separate streams of decompressed left and right reference fields or frames and the areas of occlusion to produce a plurality of interpolated pixel values for each left and right fields or frames, the interpolated pixel values for the left fields or frames based on a left and right reference field or frame, the interpolated pixel values for the right fields or frames based on a left and right reference field or frame; and
storing or communicating for display, the interpolated left and right fields or frames or said left and right reference fields or frames, or both.
2. The method according to claim 1 , wherein the left and right reference fields or frames or said interpolated left and right fields or frames are combined in a single field or frame or in a single stream of fields or frames.
3. The method according to claim 1 , wherein said left and right reference fields or frames or said interpolated left and right fields or frames are sequenced in the separate left and right streams of fields or frames.
4. The method according to claim 1 , comprising interpolating said left and right fields or frames in a combined single stream of left and right fields or frames based on a combined said decompressed left and right reference fields or frames.
5. The method according to claim 1 , comprising determining motion vectors for at least one of said left and right streams of said separate left and right streams of fields or frames, wherein interpolating said left and right fields or frames in said separate left and right streams of fields or frames is based on at least the motion vectors.
6. The method according to claim 1 , comprising interpolating said left and right fields or frames in said separate left and right streams of fields or frames utilizing motion compensation.
7. The method according to claim 1 , comprising interpolating pixels in occluded areas of said left and right fields or frames in said separate left and right streams of fields or frames utilizing uncovered areas in corresponding opposite side fields or frames in said separate left and right streams.
8. The method according to claim 1 , comprising displaying said interpolated left and right fields or frames or said left and right reference fields or frames as 3D video or 2D video.
9. A system for processing video, the system comprising:
one or more processors, one or more circuits, or any combination thereof, in a video processing device, wherein the one or more processors, one or more circuits, or any combination thereof, are operable to:
receive stereoscopic left and right reference fields or frames of compressed video data;
decompress the left and right reference fields or frames of compressed video data;
determine areas of occlusion in separate left and right streams of fields or frames;
interpolate left and right fields or frames in the separate left and right streams of fields or frames based at least in part on separate streams of the decompressed left and right reference fields or frames and the areas of occlusion to produce a plurality of interpolated pixel values for each left and right fields or frames, the interpolated pixel values for the left fields or frames based on a left and right reference field or frame, the interpolated pixel values for the right fields or frames based on a left and right reference field or frame; and
store or display said interpolated left and right fields or frames or said left and right reference fields or frames, or both.
10. The system according to claim 9 , wherein said left and right reference fields or frames or said interpolated left and right fields or frames are combined in a single field or frame or in a single stream of fields or frames.
11. The system according to claim 9 , wherein said left and right reference fields or frames or said interpolated left and right fields or frames are sequenced in the separate left and right streams of fields or frames.
12. The system according to claim 9 , wherein the one or more processors or circuits are operable to interpolate the left and right fields or frames in a combined single stream of left and right fields or frames based on a combined decompressed left and right reference fields or frames.
13. The system according to claim 9 , wherein said one or more processors or circuits are operable to determine motion vectors for at least one of said left and right streams of said separate left and right streams of fields or frames, and wherein said one or more processors or circuits are operable to interpolate said left and right fields or frames in said separate left and right streams of fields or frames is based on at least the motion vectors.
14. The system according to claim 9 , wherein said one or more processors or circuits are operable to interpolate said left and right fields or frames in said separate left and right streams of fields or frames utilizing motion compensation.
15. The system according to claim 9 , wherein said one or more processors or circuits are operable to interpolate pixels in occluded areas of said left and right fields or frames in said separate left and right streams of fields or frames utilizing uncovered areas in corresponding opposite side fields or frames in said separate left and right streams.
16. The system according to claim 9 , wherein said one or more processors or circuits are operable to display said interpolated left and right fields or frames or said left and right reference fields or frames as 3D video or 2D video.
17. A non-transitory computer-readable medium embodying a program executable in a computing device, the program configured to at least:
receive stereoscopic left and right reference fields or frames of compressed video data;
decompress the left and right reference fields or frames of compressed video data;
determine areas of occlusion in separate left and right streams of fields or frames;
interpolate left and right fields or frames in the separate left and right streams of fields or frames based at least in part on separate streams of said decompressed left and right reference fields or frames and the areas of occlusion to produce a plurality of interpolated pixel values for each left and right fields or frames, the interpolated pixel values for the left fields or frames based on a left and right reference field or frame, the interpolated pixel values for the right fields or frames based on a left and right reference field or frame; and
store or display the interpolated left and right fields or frames or said left and right reference fields or frames, or both.
18. The computer-readable medium according to claim 17 , wherein the left and right reference fields or frames or the interpolated left and right fields or frames are combined in a single field or frame or in a single stream of fields or frames.
19. The computer-readable medium according to claim 17 , wherein said left and right reference fields or frames or said interpolated left and right fields or frames are sequenced in the separate left and right streams of fields or frames.
20. The computer-readable medium according to claim 17 , further comprising code that interpolates said left and right fields or frames in a combined single stream of left and right fields or frames based on a combined said decompressed left and right reference fields or frames.
21. The computer-readable medium according to claim 17 , wherein the program is further configured to:
determine motion vectors for at least one of the left and right streams of the separate left and right streams of fields or frames; and
interpolate the left and right fields or frames in the separate left and right streams of fields or frames is based on at least the motion vectors.
22. The computer-readable medium according to claim 17 , wherein the program is further configured to interpolate the left and right fields or frames in the separate left and right streams of fields or frames utilizing motion compensation.
23. The computer-readable medium according to claim 17 , wherein the program is further configured to interpolate pixels in occluded areas of the left and right fields or frames in the separate left and right streams of fields or frames utilizing uncovered areas in corresponding opposite side fields or frames in the separate left and right streams.
24. The computer-readable medium according to claim 17 , wherein the program is further configured to interpolate the left and right fields or frames or the left and right reference fields or frames as 3D video or 2D video.