Method and system for processing 3-D video
View Patent ↗A video processing system may receive a first frame comprising pixel data for a first 3-D view of an image, which may be referred to as first 3-D view pixel data, and receive a second frame comprising pixel data for a second 3-D view of the image, which may be referred to as second 3-D view pixel data. The system may generate a multi-view frame comprising the first 3-D view pixel data and the second 3-D view pixel data. The system may make a decision for performing processing of the image, wherein the decision is generated based on one or both of the first 3-D view pixel data and/or the second 3-D view pixel data. The system may process the 3-D multi-view frame based on the decision. The image processing operation may comprise, for example, deinterlacing, filtering, and cadence processing such as 3:2 pulldown.
1. A method comprising:
in a 3-D video processing system:
receiving a first frame comprising pixel data for a first 3-D view of an image and receiving a second frame comprising pixel data for a second 3-D view of said image;
generating a 3-D multi-view frame comprising said pixel data for said first 3-D view and said pixel data for said second 3-D view, wherein said generation of said 3-D multi-view frame comprises:
generating a first preliminary decision based on said pixel data for said first 3-D view, wherein the first preliminary decision identifies processing for the first 3-D view, the identified processing comprising at least one of: sharpening the first 3-D view, adjust the color of the first 3-D view, scaling the first 3-D view, applying motion compensated temporal filtering to the first 3-D view, performing cadence processing, or performing digital noise reduction of the first 3-D view;
generating a second preliminary decision based on said pixel data for said second 3-D view, wherein the second preliminary decision identifies processing for the second 3-D view, the processing identified by the second preliminary decision comprising at least one of: sharpening the second 3-D view, adjusting the color of the second 3-D view, scaling the second 3-D view, applying motion compensated temporal filtering of the second 3-D view, performing cadence processing, or performing digital noise reduction of the second 3-D view;
generating a decision common between said first 3-D view and said second 3-D view for performing common processing of said image across said first 3-D view and said second 3-D view, based on an average or compromise between the processing identified by the first preliminary decision and the processing identified by the second preliminary decision; and
processing said 3-D multi-view frame based on said decision.
2. The method according to claim 1 , wherein said common processing of said image further comprises deinterlacing.
3. The method according to claim 1 , wherein said decision further comprises determining whether said pixel data for said first 3-D view or said pixel data for said second 3-D view originated as video or film.
4. The method according to claim 1 , wherein said common processing of said image comprises filtering.
5. The method according to claim 1 , wherein said multi-view frame is arranged such that a left portion of said multi-view frame comprises said pixel data for said first 3-D view and a right portion of said multi-view frame comprises said pixel data for said second 3-D view.
6. The method according to claim 1 , wherein said multi-view frame is arranged such that a top portion of said multi-view frame comprises said pixel data for said first 3-D view and a bottom portion of said multi-view frame comprises said pixel data for said second 3-D view.
7. The method according to claim 1 , wherein said multi-view frame is arranged such that said pixel data for said first 3-D view is interleaved with said pixel data for said second 3-D view.
8. The method according to claim 1 , wherein the average or compromise comprises weighting or blending the processing identified by the first preliminary decision and the processing identified by the second preliminary decision.
9. The method according to claim 1 , comprising generating said multi-view frame by:
writing said pixel data for said first 3-D view to one or more locations in memory identified by a first one or more pointers;
writing said pixel data for said second 3-D view to one or more locations in memory identified by a second one or more pointers; and
reading said pixel data for said first 3-D view and said pixel data for said second 3-D view from memory in an order that is different than an order in which said pixel data for said first 3-D view and said pixel data for said second 3-D view was written to memory.
10. A system comprising:
one or more circuits, one or more processors, or any combination thereof for use in a 3-D video processing system, said one or more circuits, one or more processors, or any combination thereof being operable to:
receive a first frame comprising pixel data for a first 3-D view of an image and receiving a second frame comprising pixel data for a second 3-D view of said image;
generate a 3-D multi-view frame comprising said pixel data for said first 3-D view and said pixel data for said second 3-D view, wherein said generation of said 3-D multi-view frame comprises:
generate a first preliminary decision based on said pixel data for said first 3-D view, wherein the first preliminary decision identifies processing for the first 3-D view, the identified processing comprising at least one of: sharpening the first 3-D view, adjusting the color of the first 3-D view, scaling the first 3-D view, applying motion compensated temporal filtering to the first 3-D view, performing cadence processing, or performing digital noise reduction of the first 3-D view;
generate a second preliminary decision based on said pixel data for said second 3-D view, wherein the second preliminary decision identifies processing for the second 3-D view, the processing identified by the second preliminary decision comprising at least one of sharpening the second 3-D view, adjusting the color of the second 3-D view, scaling the second 3-D view, applying motion compensated temporal filtering of the second 3-D view, performing cadence processing, or performing digital noise reduction of the second 3-D view;
generate a decision common between said first 3-D view and said second 3-D view for performing common processing of said image across said first 3-D view and said second 3-D view, based on an average or compromise between the processing identified by the first preliminary decision and the processing identified by the second preliminary decision; and
process the 3-D multi-view frame based on said decision.
11. The system according to claim 10 , wherein said common processing of said image further comprises deinterlacing.
12. The system according to claim 10 , wherein said decision includes a determination of whether said pixel data for said first 3-D view or said pixel data for said second 3-D view originated as video or film.
13. The system according to claim 10 , wherein said common processing of said image comprises filtering.
14. The system according to claim 10 , wherein said multi-view frame is arranged such that a left portion of said multi-view frame comprises said pixel data for said first 3-D view and a right portion of said multi-view frame comprises said pixel data for said second 3-D view.
15. The system according to claim 10 , wherein said multi-view frame is arranged such that a top portion of said multi-view frame comprises said pixel data for said first 3-D view and a bottom portion of said multi-view frame comprises said pixel data for said second 3-D view.
16. The system according to claim 10 , wherein said multi-view frame is arranged such that said pixel data for said first 3-D view is interleaved with said pixel data for said second 3-D view.
17. The system according to claim 10 , wherein the average or compromise comprises weighting or blending the processing identified by the first preliminary decision and the processing identified by the second preliminary decision.
18. The system according to claim 10 , wherein said one or more circuits, one or more processors, or any combination thereof are configured to generate said multi-view frame by:
writing said pixel data for said first 3-D view to one or more locations in memory identified by a first one or more pointers;
writing said pixel data for said second 3-D view to one or more locations in memory identified by a second one or more pointers; and
reading said pixel data for said first 3-D view and said pixel data for said second 3-D view from memory in an order that is different than an order in which said pixel data for said first 3-D view and said pixel data for said second 3-D view was written to memory.
19. A non-transitory computer readable medium having a program that, when executed by processing circuitry, causes the processing circuitry to:
generate a first preliminary decision based on pixel data for a first 3-D view, wherein the first preliminary decision identifies processing for the first 3-D view, the identified processing comprising at least one of: sharpening the first 3-D view, adjusting the color of the first 3-D view, scaling the first 3-D view, applying motion compensated temporal filtering to the first 3-D view, performing cadence processing, or performing digital noise reduction of the first 3-D view;
generate a second preliminary decision based on pixel data for a second 3-D view, wherein the second preliminary decision identifies processing for the second 3-D view, the processing identified by the second preliminary decision comprising at least one of sharpening the second 3-D view, adjusting the color of the second 3-D view, scaling the second 3-D view, applying motion compensated temporal filtering of the second 3-D view, performing cadence processing, or performing digital noise reduction of the second 3-D view;
generate a decision common between said first 3-D view and said second 3-D view for performing common processing across the first 3-D view and the second 3-D view based on an average or compromise between the processing identified by the first preliminary decision and the processing identified by the second preliminary decision; and
process the 3-D multi-view frame based on the decision.
20. The non-transitory computer readable medium of claim 19 , wherein the average or compromise comprises weighting or blending the processing identified by the first preliminary decision and the processing identified by the second preliminary decision.