IP Library Granted Patent US 11,756,220
Granted Patent B2
US 11,756,220 · App. 17/900,105 · Granted Sep 12, 2023

Depth calculation processor and mobile terminal

Inventors: Yuanhao Huang (Shenzhen, CN); Zhenzhong Xiao (Shenzhen, CN); Lianghong Zhong (Shenzhen, CN); Xiaolu Mei (Shenzhen, CN); Xing Xu (Shenzhen, CN); Xu Chen (Shenzhen, CN)
Assignee: Orbbec Inc.
G06T7/50G06T7/0002G06T7/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,756,220
App. No.
17/900,105
Granted
Sep 12, 2023
Kind
B2
Abstract

A depth calculation processor includes: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.

Claims (28)

1. A depth calculation processor, comprising:

an input port, configured to receive image data from an image sensor;

a depth image engine, configured to receive the image data from the input port, and calculate depth image data; and

an output port, configured to receive and output the depth image data, wherein

the depth image engine comprises:

a buffer, configured to receive the image data;

an image rotator, configured to perform, after the buffer receives the entire image data, a rotation operation on the image data to generate a rotated image; and

a depth value calculator, configured to receive the rotated image and a reference image to perform a matching calculation to generate the depth image data.

2. The depth calculation processor according to claim 1 , further comprising:

a grayscale image engine, configured to receive and process the image data from the input port, and output processed image data to the output port.

3. The depth calculation processor according to claim 2 , further comprising a demultiplexer (DEMUX), connected to the input port, and configured to receive the image data from the input port, and output the image data to the depth image engine and/or the grayscale image engine.

4. The depth calculation processor according to claim 2 , further comprising a multiplexer (MUX), connected to the output port, and configured to receive and output the depth image data from the depth image engine and/or the processed image data from the grayscale image engine through the output port.

5. A mobile terminal, comprising:

an application processor;

a projection module, configured to project a structured light image;

an acquisition module, configured to acquire the structured light image; and

a depth calculation processor, connected to the application processor, the projection module, and the acquisition module, and configured to: control working statuses of the acquisition module and the projection module, receive the structured light image from the acquisition module, calculate a depth image according to the structured light image, and output the depth image to the application processor, wherein

the depth calculation processor comprises:

an input port, configured to receive image data from an image sensor;

a depth image engine, configured to receive the image data from the input port, and calculate the depth image; and

an output port, configured to receive and output the depth image data, wherein the depth image engine comprises:

a buffer, configured to receive the image data;

an image rotator, configured to perform, after the buffer receives the entire image data, a rotation operation on the image data to generate a rotated image; and

a depth value calculator, configured to receive the rotated image and a reference image to perform a matching calculation to generate the depth image data.

6. The mobile terminal according to claim 5 , further comprising:

a grayscale image engine, configured to receive and process the image data from the input port, and output processed image data to the output port.

7. The mobile terminal according to claim 6 , further comprising a demultiplexer (DEMUX), connected to the input port, and configured to receive the image data from the input port, and output the image data to the depth image engine and/or the grayscale image engine.

8. The mobile terminal according to claim 6 , further comprising a multiplexer (MUX), connected to the output port, and configured to receive and output the depth image data from the depth image engine and/or the processed image data from the grayscale image engine through the output port.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: HUANG, YUANHAO; XIAO, ZHENZHONG; ZHONG, LIANGHONG; MEI, XIAOLU; XU, XING; CHEN, XU
To: SHENZHEN ORBBEC CO., LTD.
Reel/Frame 060953/0609 →
CHANGE OF NAME Recorded Aug 31, 2022
From: SHENZHEN ORBBEC CO., LTD.
To: ORBBEC INC.
Reel/Frame 060953/0842 →
Priority Claims (1)
CN 201810125080.1 · Feb 7, 2018 · national
Continuity (3)
Division 16985457 · Aug 5, 2020
Continuation PCTCN2018092836 · Jun 26, 2018
Related Publication 20220414905A1 · Dec 29, 2022