Depth calculation processor and mobile terminal
A depth calculation processor comprises: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.
1. A depth calculation processor, comprising:
an input port, configured to receive image data from an image sensor;
a demultiplexer (DEMUX), connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line;
a grayscale image engine, configured to receive and process the first image data from the first line to generate processed first image data;
a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data;
a multiplexer (MUX), configured to receive and output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and
an output port, configured to receive and output the processed first image data and the depth image data from the MUX.
2. The depth calculation processor according to claim 1 , wherein the input port and/or the output port is a Mobile Industry Processor Interface (MIPI) interface.
3. The depth calculation processor according to claim 1 , wherein the depth image engine comprises:
a buffer, configured to receive the second image data from the second line;
an image rotator, configured to perform, after the buffer receives the entire second image data from the second line, a rotation operation on the second image data from the second line to generate a rotated image; and
a depth value calculator, configured to receive the rotated image and a reference image to perform a matching calculation to generate the depth image data.
4. The depth calculation processor according to claim 3 , wherein the grayscale image engine and/or the depth image engine further comprises an automatic exposure (AE) module, wherein the AE module is configured to: receive the first image data from the first line and/or the second image data from the second line, and calculate a value reflecting an exposure amount.
5. The depth calculation processor according to claim 1 , wherein the second image data from the second line comprises infrared (IR) structured light image data.