IP Library Granted Patent US 11,332,145
Granted Patent B2
US 11,332,145 · App. 16/439,802 · Granted May 17, 2022

Apparatus, system and software for brightness control of vehicle display based on infrared camera

Inventors: Zhe Li (Mountain View, CA); Cheng Lu (Mountain View, CA); Tianpeng Feng (Mountain View, CA); Yandong Guo (Mountain View, CA); Jun Ma (Mountain View, CA)
Assignee: GUANGZHOU XIAOPENG AUTOPILOT TECHNOLOGY CO., LTD.
B60W40/02F21V5/007H01L27/14649B60W2420/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,332,145
App. No.
16/439,802
Granted
May 17, 2022
Kind
B2
Abstract

Apparatus for controlling a brightness of a display of a vehicle includes: an infrared illuminator, configured to emit infrared light in the vehicle; a near infrared (NIR) light sensing unit, configured to capture reflected infrared light; an image data processing unit, configured to analyze the reflected infrared light to generate a feedback; an imaging control unit, configured to adjust, in response to the feedback, one or more of a plurality of properties of the NIR light sensing unit, so that readouts of the NIR light sensing unit are within a first range, wherein the image data processing unit generates a calculated NIR intensity readout under the adjusted properties; a reconstruction unit, configured to reconstruct a human perceived brightness based on the calculated NIR intensity readout; and the display, configured to adjust the brightness. The NIR light sensing unit is a unit of a driver monitoring system (DMS).

Claims (51)

1. An apparatus for controlling a brightness of a display of a vehicle, comprising:

an infrared (IR) illuminator, configured to emit infrared light in the vehicle;

a near infrared (NIR) light sensing unit, configured to capture reflected infrared light;

an image data processing unit, configured to analyze the reflected infrared light captured by the NIR light sensing unit to generate a feedback;

an imaging control unit, configured to adjust, in response to the feedback, one or more properties of the NIR light sensing unit, so that readouts of the NIR light sensing unit are within a first range, wherein the image data processing unit generates a calculated NIR intensity readout under the adjusted one or more properties of the NIR light sensing unit;

a reconstruction unit, configured to reconstruct a human perceived brightness based on the calculated NIR intensity readout; and

the display, configured to adjust the brightness based on the human perceived brightness.

2. The apparatus of claim 1 , wherein the NIR light sensing unit is a unit of a driver monitoring system (DMS).

3. The apparatus of claim 1 , wherein the NIR light sensing unit is a focal plane array (FPA) NIR light sensing unit.

4. The apparatus of claim 1 , wherein the NIR light sensing unit is covered with a color filter, the color filter having a passing band between 825 nm and 875 nm.

5. The apparatus of claim 1 , wherein the one or more properties of the NIR light sensing unit are one or more of:

an analog gain;

a digital gain; and

an exposure time.

6. The apparatus of claim 1 , wherein the first range is associated with a dynamic range of the NIR light sensing unit.

7. The apparatus of claim 1 , wherein the image data processing unit takes an average over all the readouts of the NIR light sensing unit associated with pixels in one or more regions of interest (ROI) in the vehicle to calculate the calculated NIR intensity readout.

8. The apparatus of claim 1 , wherein the reconstruction unit correlates the calculated NIR intensity readout with the human perceived brightness based on a first set of prior psychophysical experiments.

9. The apparatus of claim 1 , wherein the display correlates the human perceived brightness with the brightness of the display based on a second set of prior psychophysical experiments.

10. The apparatus of claim 1 , wherein the display has a brightness change rate within a second range.

11. A method for controlling a brightness of a display of a vehicle, comprising:

emitting infrared (IR) light in the vehicle;

capturing, by a near infrared (NIR) light sensing unit, reflected infrared light;

analyzing, by an image data processing unit, the reflected infrared light captured by the NIR light sensing unit to generate a feedback;

adjusting, in response to the feedback, one or more properties of the NIR light sensing unit, so that readouts of the NIR light sensing unit are within a first range;

generating, by the image data processing unit, a calculated NIR intensity readout under the adjusted one or more properties of the NIR light sensing unit;

reconstructing a human perceived brightness based on the calculated NIR intensity readout; and

adjusting the brightness of the display based on the human perceived brightness.

12. The method of claim 11 , wherein the NIR light sensing unit is a unit of a driver monitoring system (DMS).

13. The method of claim 11 , wherein the NIR light sensing unit is a focal plane array (FPA) NIR light sensing unit.

14. The method of claim 11 , wherein the NIR light sensing unit is covered with a color filter, the color filter having a passing band between 825 nm and 875 nm.

15. The method of claim 11 , wherein the one or more properties of the NIR light sensing unit are one or more of:

an analog gain;

a digital gain; and

an exposure time.

16. The method of claim 11 , wherein the first range is associated with a dynamic range of the NIR light sensing unit.

17. The method of claim 11 , further comprising:

taking an average, by the image data processing unit, over all the readouts of the NIR light sensing unit associated with pixels in one or more regions of interest (ROI) in the vehicle to calculate the calculated NIR intensity readout.

18. The method of claim 11 , further comprising:

correlating the calculated NIR intensity readout with the human perceived brightness based on a first set of prior psychophysical experiments.

19. The method of claim 11 , further comprising:

correlating the human perceived brightness with the brightness of the display based on a second set of prior psychophysical experiments.

20. The method of claim 11 , wherein the display has a brightness change rate within a second range.

21. A non-transitory tangible computer-readable medium storing instructions which, when executed by one or more processors, cause a method for controlling a brightness of a display of a vehicle to be performed, the method comprising:

emitting infrared (IR) light in the vehicle;

capturing, by a near infrared (NIR) light sensing unit, reflected infrared light;

analyzing, by an image data processing unit, the reflected infrared light captured by the NIR light sensing unit to generate a feedback;

adjusting, in response to the feedback, one or more properties of the NIR light sensing unit, so that readouts of the NIR light sensing unit are within a first range;

generating, by the image data processing unit, a calculated NIR intensity readout under the adjusted one or more properties of the NIR light sensing unit;

reconstructing a human perceived brightness based on the calculated NIR intensity readout; and

adjusting the brightness of the display based on the human perceived brightness.

22. The non-transitory tangible computer-readable medium of claim 21 , wherein the NIR light sensing unit is a unit of a driver monitoring system (DMS).

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2022
From: XMOTORS.AI INC.
To: GUANGZHOU XIAOPENG AUTOPILOT TECHNOLOGY CO., LTD.
Reel/Frame 059544/0427 →
SECURITY INTEREST Recorded Nov 27, 2019
From: VYTRONUS, INC.
To: SILICON VALLEY BANK
Reel/Frame 051147/0163 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2019
From: LI, ZHE; LU, CHENG; FENG, TIANPENG; GUO, YANDONG; MA, JUN
To: XMOTORS.AI INC.
Reel/Frame 049455/0740 →