Method and system for 3D video pre-processing and post-processing
View Patent ↗A 3-dimensional (3D) video transmitter may be operable to determine a modification process to be utilized for modifying an enhancement layer of a 3D video frame before encoding of the enhancement layer. The modification process may provide increased compression efficiency during the encoding. The enhancement layer may be modified utilizing the determined modification process. The modified enhancement layer may then be encoded by the 3D video transmitter. The 3D video transmitter may transmit the encoded base layer and the encoded enhancement layer as well as modification information associated with the modified enhancement layer to a 3D video receiver. The 3D video receiver may decode the transmitted encoded base layer and the transmitted encoded enhancement layer. The 3D video receiver may then modify the decoded enhancement layer, based on the transmitted modification information, so as to recover an original image of the enhancement layer of the 3D video frame.
1. A method for processing video, the method comprising:
determining, for each of a plurality of regions of a 3-dimensional (3D) video frame, a modification process to be utilized for modifying an enhancement layer of said 3D video frame based on coding information of a corresponding region of a base layer of said 3D video frame;
modifying, by at least one processor, circuit, or combination thereof in a 3D video transmitter, said enhancement layer of said 3D video frame according to said determining a modification process; and
encoding said modified enhancement layer of said 3D video frame.
2. The method according to claim 1 , wherein:
said modification process provides increased compression efficiency during said encoding; and
said determining a modification process further comprises determining said modification process based on video information associated with said enhancement layer of said 3D video frame.
3. The method according to claim 1 , comprising:
encoding each of a plurality of regions of said base layer of said 3D video frame to provide a base layer reference for inter-layer prediction and coding information for each of said plurality of regions of said base layer, wherein
determining a modification process further comprises determining said modification process based on said coding information for said plurality of regions of said base layer.
4. The method according to claim 1 , comprising determining one or more filters to be utilized on one or more regions of said enhancement layer of said 3D video frame.
5. The method according to claim 4 , comprising modifying said one or more regions of said enhancement layer of said 3D video frame utilizing said determined one or more filters.
6. The method according to claim 1 , comprising determining one or more filters to be utilized on one or more regions of said enhancement layer of said 3D video frame based on video information associated with each of said one or more regions of said enhancement layer of said 3D video frame.
7. The method according to claim 1 , comprising:
encoding each of a plurality of regions of said base layer of said 3D video frame to provide a base layer reference for inter-layer prediction and coding information for each of said plurality of regions of said base layer; and
determining a plurality of filters to be utilized on regions of said enhancement layer of said 3D video frame based on said coding information for said plurality of regions of said base layer.
8. The method according to claim 1 , wherein modifying said enhancement layer further comprises generating modification information including filter coefficients associated with said modified enhancement layer.
9. The method according to claim 8 , comprising transmitting an encoded base layer of said 3D video frame, said encoded modified enhancement layer of said 3D video frame, and said modification information to a 3D video receiver.
10. The method according to claim 9 , further comprising:
decoding, by said 3D video receiver, said transmitted encoded base layer of said 3D video frame and said transmitted encoded modified enhancement layer of said 3D video frame; and
modifying said decoded modified enhancement layer of said 3D video frame based on said transmitted modification information to recover an original image of said enhancement layer of said 3D video frame.
11. A system for processing video, the system comprising:
at least one processor, circuit, or combination thereof in a 3-dimensional (3D) video transmitter, said at least one processor, circuit, or combination thereof being operable to:
determine, for each of a plurality of regions of a 3D video frame, a modification process to be utilized for modifying an enhancement layer of said 3D video frame based on coding information of a corresponding region of a base layer of said 3D video frame;
modify said enhancement layer of said 3D video frame according to said determined modification process; and
encode said modified enhancement layer of said 3D video frame.
12. The system according to claim 11 , wherein:
said modification process provides increased compression efficiency during said encoding; and
said at least one processor, circuit, or combination thereof is further operable to determine said modification process based on video information associated with said enhancement layer of said 3D video frame.
13. The system according to claim 11 , wherein said at least one processor, circuit, or combination thereof is further operable to:
encode each of a plurality of regions of said base layer of said 3D video frame to provide a base layer reference for inter-layer prediction and coding information for each of said plurality of regions of said base layer; and
determine said modification process based on said coding information for said plurality of regions of said base layer.
14. The system according to claim 11 , wherein said at least one processor, circuit, or combination thereof is further operable to determine one or more filters to be utilized on one or more regions of said enhancement layer of said 3D video frame.
15. The system according to claim 14 , wherein said at least one processor, circuit, or combination thereof is further operable to modify said one or more regions of said enhancement layer of said 3D video frame utilizing said determined one or more filters.
16. The system according to claim 11 , wherein said at least one processor, circuit, or combination thereof is further operable to determine one or more filters to be utilized on one or more regions of said enhancement layer of said 3D video frame based on video information associated with each of said one or more regions of said enhancement layer of said 3D video frame.
17. The system according to claim 11 , wherein said at least one processor, circuit, or combination thereof is further operable to:
encode each of a plurality of regions of said base layer of said 3D video frame to provide a base layer reference for inter-layer prediction and coding information for each of said plurality of regions of said base layer; and
determine a plurality of filters to be utilized on regions of said enhancement layer of said 3D video frame based on said coding information for said plurality of regions of said base layer.
18. The system according to claim 11 , wherein said at least one processor, circuit, or combination thereof is further operable to generate modification information including filter coefficients associated with said modified enhancement layer.
19. The system according to claim 18 , wherein said at least one processor, circuit, or combination thereof is further operable to transmit an encoded base layer of said 3D video frame, said encoded modified enhancement layer of said 3D video frame, and said modification information to a 3D video receiver.
20. The system according to claim 19 , further comprising:
at least one processor, circuit, or combination thereof in said 3D video receiver, said at least one processor, circuit, or combination thereof in said 3D video receive being operable to:
decode said transmitted encoded base layer of said 3D video frame and said transmitted modified encoded enhancement layer of said 3D video frame; and
modify said decoded modified enhancement layer of said 3D video frame based on said transmitted modification information to recover an original image of said enhancement layer of said 3D video frame.
21. A method for processing video, the method comprising:
encoding each of a plurality of regions of a base layer of a 3D video frame to provide coding information for each of said plurality of regions of said base layer;
determining, for each of a plurality of regions of a 3D video frame, a modification process to be utilized for modifying an enhancement layer of said 3D video frame based on coding information for respective regions of said base layer; and
modifying, by at least one processor, circuit, or combination thereof, said enhancement layer of said 3D video frame according to said determining a modification process.
22. The method according to claim 21 , wherein modifying said enhancement layer further comprises generating modification information including filter coefficients associated with said modified enhancement layer.
23. The method according to claim 22 , comprising transmitting said encoded base layer of said 3D video frame, said modified enhancement layer of said 3D video frame, and said modification information to a 3D video receiver.