IP Library › Granted Patent US 11,418,689
Granted Patent B2
US 11,418,689 · App. 17/149,655 · Granted Aug 16, 2022

Display device and electronic apparatus with 3D camera module

Inventors: Li Zhu (Shenzhen, CN); Fanglu Lyu (Shenzhen, CN); Bo Wang (Shenzhen, CN)
Assignee: Shenzhen Guangjian Technology Co., Ltd.
H04N5/2257G06T7/521H04N5/2254H04N13/25H04N13/254H04N13/296G02B27/10G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,418,689
App. No.
17/149,655
Granted
Aug 16, 2022
Kind
B2
Abstract

Display devices and electronic apparatuses with 3D camera modules are provided. An exemplary device comprises a display and a 3D camera module, wherein the 3D camera module comprises a depth camera module disposed at a backlight side of the display; the depth camera module comprises an edge-emitting laser and an imaging module; the edge-emitting laser is configured for emitting laser light, for the emitted laser light to penetrate the display to reach an object; and the imaging module is configured for receiving laser light reflected by the object that penetrates the display, and obtaining a depth image of the object based on the reflected laser light.

Claims (50)

1. A computer-implemented method for depth imaging, comprising:

displaying, in a display area of a display, images to a light-emerging side of the display, wherein a total transmittance rate of infrared laser light passing through the display twice is 9% or less;

controlling an edge-emitting laser at a backlight side of the display to emit infrared light through the display area by increasing an optical power of the laser at the backlight side of the display at least to an extent that the infrared light penetrates the display area of the display from the backlight side of the display to reach an object on the light-emerging side of the display, and that the infrared light reflected by the object re-penetrates the display area of the display again after being reflected by the object;

determining a pulse width amount;

reducing a pulse width of the laser by the determined pulse width amount to keep total pulse energy of the laser within a safety limit and substantially unchanged from the increased optical power;

receiving, at the backlight side of the display, the infrared light reflected by the object that re-penetrates the display through the display area from the light-emerging side of the display; and

determining a depth image of the object based on the received infrared light after the pulse width is reduced.

2. The method of claim 1 , wherein controlling the edge-emitting laser at the backlight side to emit the infrared light through the display area comprises:

controlling the laser to turn on.

3. The method of claim 1 , wherein:

the infrared light is split into multiple randomly distributed laser beams; and

increasing the optical power of the laser comprises increasing a drive current.

4. The method of claim 3 , wherein determining the depth image of the object comprises determining the depth image of a surface of the object based on a spot pattern of the received infrared light, the spot pattern corresponding to at least some of the multiple randomly distributed laser beams.

5. The method of claim 3 , wherein the multiple randomly distributed laser beams are aligned by an optical lens before penetrating the display from the backlight side of the display.

6. The method of claim 3 , wherein determining the depth image of the object comprises:

determining a time delay or phase shift of the received infrared light.

7. The method of claim 3 , wherein the multiple randomly distributed laser beams are diffused into flood light before penetrating the display from the backlight side of the display.

8. The method of claim 3 , wherein the infrared light is split into multiple randomly distributed laser beams using a nanophotonic chip, a diffractive optics element, or a coded structured light photomask.

9. The method of claim 1 , further comprising:

capturing a 2D image of the object; and

determining a 3D image of the object based on the depth image and the 2D image.

10. A system for depth imaging, comprising one or more processors and one or more non-transitory computer-readable memories coupled to the one or more processors and configured with instructions executable by the one or more processors to cause the system to perform operations comprising:

displaying, in a display area of a display, images to a light-emerging side of the display, wherein a total transmittance rate of infrared laser light passing through the display twice is 9% or less;

controlling an edge-emitting laser at a backlight side of the display to emit infrared light through the display area by increasing an optical power of the laser at the backlight side of the display at least to an extent that the infrared light penetrates the display area of the display from the backlight side of the display to reach an object on the light-emerging side of the display, and that the infrared light reflected by the object re-penetrates the display area of the display again after being reflected by the object;

determining a pulse width amount;

reducing a pulse width of the laser by the determined pulse width amount to keep total pulse energy of the laser within a safety limit and substantially unchanged from the increased optical power;

receiving, at the backlight side of the display, the infrared light reflected by the object that re-penetrates the display through the display area from the light-emerging side of the display; and

determining a depth image of the object based on the received infrared light after the pulse width is reduced.

11. The system of claim 10 , wherein controlling the edge-emitting laser at the backlight side to emit the infrared light through the display area comprises:

controlling the laser to turn on.

12. The system of claim 10 , wherein:

the infrared light is split into multiple randomly distributed laser beams; and

increasing the optical power of the laser comprises increasing a drive current.

13. The system of claim 12 , wherein determining the depth image of the object comprises determining the depth image of a surface of the object based on a spot pattern of the received infrared light, the spot pattern corresponding to at least some of the multiple randomly distributed laser beams.

14. The system of claim 12 , wherein the multiple randomly distributed laser beams are aligned by an optical lens before penetrating the display from the backlight side of the display.

15. The system of claim 12 , wherein determining the depth image of the object comprises:

determining a time delay or phase shift of the received infrared light.

16. A non-transitory computer-readable storage medium configured with instructions executable by one or more processors to cause the one or more processors to perform operations comprising:

displaying, in a display area of a display, images to a light-emerging side of the display, wherein a total transmittance rate of infrared laser light passing through the display twice is 9% or less;

controlling an edge-emitting laser at a backlight side of the display to emit infrared light through the display area by increasing an optical power of the laser at the backlight side of the display at least to an extent that the infrared light penetrates the display area of the display from the backlight side of the display to reach an object on the light-emerging side of the display, and that the infrared light reflected by the object re-penetrates the display area of the display again after being reflected by the object;

determining a pulse width amount;

reducing a pulse width of the laser by the determined pulse width amount to keep total pulse energy of the laser within a safety limit and substantially unchanged from the increased optical power;

receiving, at the backlight side of the display, the infrared light reflected by the object that re-penetrates the display through the display area from the light-emerging side of the display; and

determining a depth image of the object based on the received infrared light after the pulse width is reduced.

17. The non-transitory computer-readable storage medium of claim 16 , wherein controlling the edge-emitting laser at the backlight side to emit the infrared light through the display area comprises:

controlling the laser to turn on.

18. The non-transitory computer-readable storage medium of claim 16 , wherein:

the infrared light is split into multiple randomly distributed laser beams; and

increasing the optical power of the laser comprises increasing a drive current.

19. The non-transitory computer-readable storage medium of claim 18 , wherein determining the depth image of the object comprises determining the depth image of a surface of the object based on a spot pattern of the received infrared light, the spot pattern corresponding to at least some of the multiple randomly distributed laser beams.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2021
From: ZHU, LI; LYU, FANGLU; WANG, BO
To: SHENZHEN GUANGJIAN TECHNOLOGY CO., LTD.
Reel/Frame 054927/0811 →
Priority Claims (1)
CN 201910044209.0 · Jan 17, 2019 · national
Continuity (2)
Continuation 16669297 · Oct 30, 2019
Related Publication 20210136268A1 · May 6, 2021