METHOD AND SYSTEM FOR UTILIZING AN IMAGE SENSOR PIPELINE (ISP) FOR 3D IMAGING PROCESSING UTILIZING Z-DEPTH INFORMATION
A monoscopic video camera may capture, via at least one image sensor, two-dimensional video, and may capture, via at least one depth sensor, corresponding depth information for the captured two-dimensional video. The monoscopic video camera may then detect and/or track objects in the captured two-dimensional video based on the captured corresponding depth information; and processing of image related information corresponding to the objects may be configured based on the detecting and/or tracking of the objects. Type and/or characteristics of each of the objects may be determined during the detecting and/or tracking. Identification of the type and/or characteristics of the objects may be performed based on one or more object recognition algorithms programmed into the monoscopic video camera. Configuration of processing of object image related information may be performed based on preset criteria and/or parameters associated with identified types and/or characteristics of the objects.
1 . A method, comprising:
capturing via at least one image sensor of a monoscopic video camera, a two-dimensional video;
capturing via at least one depth sensor of said monoscopic video camera, corresponding depth information for said captured two-dimensional video;
detecting and/or tracking at least one object in said captured two-dimensional video based on said captured corresponding depth information; and
configuring processing of image related information corresponding to said at least one object based on said detecting and/or tracking of said at least one object.
2 . The method according to claim 1 , comprising performing said configuration of processing of image related information by adjusting and/or controlling one or more functions in an image sensor pipeline (ISP) utilized during image processing in said monoscopic video camera.
3 . The method according to claim 1 , comprising identifying type and/or characteristics of said at least one object during said detecting and/or tracking.
4 . The method according to claim 3 , comprising performing said identification of said type and/or characteristics of said at least one object based on one or more object recognition algorithms.
5 . The method according to claim 3 , comprising performing said configuration of processing of image related information based on preset criteria and/or parameters associated with said identified type and/or characteristics of said at least one object.
6 . The method according to claim 1 , wherein said configuration of said processing of image related information comprises setting and/or adjusting control parameters for use in determining brightness and/or color information associated with said at least one object during said processing.
7 . The method according to claim 1 , comprising performing scene detection based on said two-dimensional video and/or said corresponding depth information.
8 . The method according to claim 7 , comprising performing said detecting and/or tracking of said at least one object based on said scene detection.
9 . The method according to claim 1 , comprising synchronizing said captured corresponding depth information to said captured two-dimensional video.
10 . The method according to claim 1 , comprising composing three-dimensional video from said captured two-dimensional video based on said captured corresponding depth information.
11 . A system, comprising:
one or more circuits for use in a monoscopic video camera that comprises at least one image sensor and at least one depth sensor, said one or more circuits being operable to:
capture via said at least one image sensor of a monoscopic video camera, a two-dimensional video;
capture via said at least one depth sensor of said monoscopic video camera, corresponding depth information for said captured two-dimensional video;
detect and/or track at least one object in said captured two-dimensional video based on said captured corresponding depth information; and
configure processing of image related information corresponding to said at least one object based on said detecting and/or tracking of said at least one object.
12 . The system according to claim 11 , wherein said one or more circuits comprise an image sensor pipeline (ISP), and said one or more circuits are operable to perform said configuration of processing of image related information by adjusting and/or controlling one or more functions in said image sensor pipeline (ISP) utilized during image processing in said monoscopic video camera.
13 . The system according to claim 11 , wherein said one or more circuits are operable to identify type and/or characteristics of said at least one object during said detecting and/or tracking.
14 . The system according to claim 13 , wherein said one or more circuits are operable to perform said identification of said type and/or characteristics of said at least one object based on one or more object recognition algorithms.
15 . The system according to claim 13 , wherein said one or more circuits are operable to configure said processing of image related information based on preset criteria and/or parameters associated with said identified type and/or characteristics of said at least one object.
16 . The system according to claim 11 , wherein said configuration of said processing of image related information comprises setting and/or adjusting control parameters for use in determining brightness and/or color information associated with said at least one object during said processing.
17 . The system according to claim 11 , wherein said one or more circuits are operable to perform scene detection based on said two-dimensional video and/or said corresponding depth information.
18 . The system according to claim 17 , wherein said one or more circuits are operable to perform said detecting and/or tracking of said at least one object based on said scene detection.
19 . The system according to claim 11 , wherein said one or more circuits are operable to synchronize said captured corresponding depth information to said captured two-dimensional video.
20 . The system according to claim 11 , wherein said one or more circuits are operable to compose three-dimensional video from said captured two-dimensional video based on said captured corresponding depth information.