IP Library › Granted Patent US 11,423,557
Granted Patent B2
US 11,423,557 · App. 16/989,401 · Granted Aug 23, 2022

Depth processor and three-dimensional image device

Inventor: Xueyong Zhang (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
G06T7/521G01S17/87G01S17/894G06T7/55G01L1/20G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,557
App. No.
16/989,401
Granted
Aug 23, 2022
Kind
B2
Abstract

A depth processor and a three-dimensional image device. The depth processor comprises at least two input ports, an input switch, a data processing engine and at least one output port. The input port is used for receiving a first image, wherein the first image at least comprises a structured light image collected by a structured light depth camera. The input switch is connected to the output port, and is used for letting some or all of first images that come from the input ports pass. The data processing engine is connected to the input switch, and is used for processing the first image output via the input switch, so as to output a second image, wherein the second image at least comprises a depth image. The output port is connected to the data processing engine, and is used for outputting the second image to a main device.

Claims (40)

1. A depth processor, comprising:

at least two input ports, configured to receive first images, the first images comprising a structured-light image collected by a structured-light depth camera;

an input switch, coupled to the at least two input ports and configured to output a part or all of the first images received by the at least two input ports;

a data processing engine, coupled to the input switch and configured to process the first images outputted by the input switch to output second images, the second images comprising a depth image; and

at least one output port, coupled to the data processing engine and configured to output the second images to a main device,

wherein at least one of the at least two input ports is further configured to receive a detection electrical signal, the detection electrical signal comprises a detection electrical signal outputted by a drop detection circuit,

wherein the input switch is further configured to output the detection electrical signal,

wherein the data processing engine is further configured to determine whether a protective cover of the structured-light depth camera drops based on the detection electrical signal, and

wherein at least one of the at least two output ports is further configured to output a determined result to the main device.

2. The depth processor of claim 1 , wherein the depth processor further comprises an output switch coupled between the data processing engine and the output port, and the output switch is configured to output the determined result, a part or all of the second images to the main device.

3. The depth processor of claim 1 , wherein the data processing engine comprises a structured-light depth processing engine, and the structured-light depth processing engine is configured to calculate a structured-light depth image based on a reference image and the structured-light image.

4. The depth processor of claim 1 , wherein the data processing engine comprises a processing engine for the detection electrical signal, the processing engine for the detection electrical signal is configured to determine whether the detection electrical signal is within a preset range, and to determine that the protective cover drops in a case that the detection electrical signal is not within the preset range.

5. The depth processor of claim 1 , wherein the structured-light depth camera comprises a structured-light projector, the structured-light projector comprises a lens barrel and the protective cover, the drop detection circuit comprises a first electrode plate and a second electrode plate, the first electrode plate is disposed on the lens barrel, the second electrode plate is disposed on the protective cover and opposite to the first electrode plate at intervals, and the second electrode plate and the first electrode plate form a detection capacitor.

6. The depth processor of claim 1 , wherein the structured-light depth camera comprises a structured-light projector, the structured-light projector comprises a lens barrel and the protective cover, the drop detection circuit comprises a pressure sensor and a connection circuit, the pressure sensor is disposed between the lens barrel and the protective cover and is subjected to pressure, and the pressure sensor is coupled to the connection circuit to form a detection loop.

7. The depth processor of claim 1 , wherein the structured-light depth camera comprises a structured-light projector, the structured-light projector comprises a substrate assembly, a lens barrel disposed on the substrate assembly, and the protective cover, the protective cover comprises a protective top wall and a protective side wall extending from a periphery of the protective top wall, the drop detection circuit comprises a transmitter and a receiver, at least one of the transmitter and the receiver is disposed on the protective side wall and the other is disposed on the substrate assembly, and the transmitter and the receiver are oppositely disposed to form the drop detection circuit.

8. The depth processor of claim 2 , wherein the depth processor further comprises a first bus device and a second bus device, the first bus device is configured to control a peripheral device coupled to the depth processor and is coupled to the second bus device via a bridge, the second bus device is coupled to a control unit, and the control unit is configured to manage an interface of the input switch, an interface of the output switch and an interface of the peripheral device via the second bus device.

9. The depth processor of claim 8 , wherein the structured-light depth camera comprises a structured-light projector, and the main device is configured to control the structured-light projector to turn off in a case that the protective cover drops.

10. The depth processor of claim 1 , wherein the first images further comprise a TOF (time of flight) image collected by a TOF depth camera, and the depth image comprises a structured-light depth image and a TOF depth image.

11. The depth processor of claim 10 , wherein the depth processor further comprises an output switch coupled between the data processing engine and the output port, and the output switch is configured to output a part or all of the second images to the main device.

12. The depth processor of claim 10 , wherein the data processing engine comprises a structured-light depth processing engine, and the structured-light depth processing engine is configured to calculate a structured-light depth image based on a reference image and the structured-light image.

13. The depth processor of claim 10 , wherein the data processing engine comprises a TOF depth processing engine, and the TOF depth processing engine is configured to calculate the TOF depth image based on the TOF image.

14. The depth processor of claim 10 , wherein the first images further comprise a visible light image collected by a visible light camera, the data processing engine further comprises a visible-light image processing engine, and the visible-light image processing engine is configured to process the visible light image to recognize an object of which a capturing area is smaller than a preset area in the visible light image.

15. The depth processor of claim 14 , wherein the data processing engine further comprises a correction engine, the correction engine is configured to correct depth information of a pixel corresponding to the object in the structured-light depth image by utilizing the TOF depth image.

16. The depth processor of claim 11 , wherein the depth processor comprises a first bus device and a second bus device, the first bus device is configured to control a peripheral device coupled to the depth processor and is coupled to the second bus device via a bridge, the second bus device is coupled to a control unit, and the control unit is configured to manage an interface of the input switch, an interface of the output switch and an interface of the peripheral device via the second bus device.

17. The depth processor of claim 16 , wherein the first bus device is further configured to control the peripheral device to turn on based on a type of a depth image required by the main device.

18. A three-dimensional image device, comprising:

a depth processor; and

a structured-light depth camera, comprising a structured-light projector and a structured-light image collector, wherein the structured-light image collector is configured to collect a structured-light image in a target space projected by the structured-light projector, and

a TOF depth camera, comprising a TOF projector and a TOF image collector, wherein the TOF image collector is configured to receive an infrared light projected to a target space by the TOF projector and reflected by an object in the target space,

wherein, the depth processor comprises:

at least two input ports, configured to receive first images;

an input switch, coupled to the at least two input ports and configured to output a part or all of the first images;

a data processing engine, coupled to the input switch and configured to process the first images outputted by the input switch to output second images, the second images comprising a depth image; and

at least one output port, coupled to the data processing engine and configured to output the second images,

wherein at least one of the at least two input ports is further configured to receive a detection electrical signal, the detection electrical signal comprises a detection electrical signal outputted by a drop detection circuit,

wherein the input switch is further configured to output the detection electrical signal,

wherein the data processing engine is further configured to determine whether a protective cover of the structured-light depth camera drops based on the detection electrical signal, and

wherein the at least one output port is further configured to output a determined result to the main device.

19. The three-dimensional image device of claim 18 , wherein the structured-light depth camera is configured as a front device, the TOF depth camera is configured as a rear device, and the structured-light depth camera and the TOF depth camera are switched in response to a switching instruction, and

the first images comprise a structured-light image collected by the structured-light depth camera, and a TOF depth image collected by the TOF depth camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2020
From: ZHANG, XUEYONG
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 053459/0366 →
Priority Claims (2)
CN 201810689572.3 · Jun 28, 2018 · national
CN 201810690795.1 · Jun 28, 2018 · national
Continuity (2)
Continuation PCTCN2019075382 · Feb 18, 2019
Related Publication 20200372665A1 · Nov 26, 2020