IP Library Patent Application 16179074
Patent Application
App. No. 16/179,074

CONFIGURABLE ILLUMINATION ON REGION OF INTEREST FOR AUTONOMOUS DRIVING

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/179,074
Abstract

A system included and a computer-implemented method performed in an autonomous-driving vehicle are described. The system performs: determining a region of interest (RoI) for processing images for an autonomous driving operation; determining an illumination condition for illuminating the determined RoI based on the determined RoI; and illuminating the determined RoI according to the determined illumination condition as the autonomous-driving vehicle travels.

Claims (61)

1 . A system for an autonomous-driving vehicle, comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:

determine a region of interest (RoI) for processing images for an autonomous driving operation;

determine an illumination condition for illuminating the determined RoI based on the determined RoI; and

cause illumination to illuminate the determined RoI according to the determined illumination condition as the autonomous-driving vehicle travels.

2 . The system of claim 1 , wherein the instructions cause the one or more processors to:

cause an image to be captured;

determine a potential object to be focused in the captured image;

determine a predicted traveling path of the autonomous-driving vehicle;

determine a predicted moving path of the potential object; and

determine the RoI and a shift of the RoI based on the predicted traveling path of the autonomous-driving vehicle and the predicted moving path of the potential object, such that the potential object stays within the RoI.

3 . The system of claim 2 , wherein the instructions cause the one or more processors to:

determine a type of the potential object to be focused; and

determine an intensity of illumination based on the type of the potential object.

4 . The system of claim 2 , wherein the instructions cause the one or more processors to:

determine a distance to the potential object; and

determine at least one of an intensity of illumination and an illumination angle based on the distance to the potential object.

5 . The system of claim 2 , wherein the instructions cause the one or more processors to determine an illumination direction, such that the illumination stays illuminating the RoI.

6 . The system of claim 2 , wherein the illumination includes a plurality of light emitting devices directed to different directions, and the instructions cause the one or more processors to select one or more light emitting devices to be activated from the plurality of light emitting devices, such that the illumination stays illuminating the RoI.

7 . The system of claim 1 , wherein the instructions cause the one or more processors to:

determine a shift of a field of view (FoV) of a camera as the camera pans and/or tilts; and

determine the RoI and a shift of the RoI, such that the RoI stays within the FoV of the camera.

8 . The system of claim 1 , wherein the instructions cause the one or more processors to:

images in the RoI illuminated according to the determined illumination condition to be captured;

detect one or more objects in the RoI;

determine a vehicle behavior based on the one or more detected objects; and

perform an autonomous driving operation according to the determined vehicle behavior.

9 . The system of claim 1 , wherein the vehicle behavior includes at least one of braking, accelerating, and steering of the autonomous-driving vehicle.

10 . The system of claim 1 , wherein the vehicle behavior includes at least one of light signaling and sound signaling.

11 . A computer-implemented method performed in an autonomous-driving vehicle comprising:

determining a region of interest (RoI) for processing images for an autonomous driving operation;

determining an illumination condition for illuminating the determined RoI based on the determined RoI; and

illuminating the determined RoI according to the determined illumination condition as the autonomous-driving vehicle travels.

12 . The computer-implemented method of claim 11 , wherein the determining the RoI for processing images for the autonomous driving operation comprises:

capturing an image;

determining a potential object to be focused in the captured image;

determining a predicted traveling path of the autonomous-driving vehicle;

determining a predicted moving path of the potential object; and

determining the RoI and a shift of the RoI based on the predicted traveling path of the autonomous-driving vehicle and the predicted moving path of the potential object, such that the potential object stays within the RoI.

13 . The computer-implemented method of claim 12 , wherein

the determining the potential object to be focused in the captured image comprises determining a type of the potential object to be focused, and

the determining the illumination condition comprises determining an intensity of illumination based on the type of the potential object.

14 . The computer-implemented method of claim 12 , wherein

the determining the RoI for processing images for the autonomous driving operation further comprises determining a distance to the potential object, and

the determining the illumination condition comprises determining at least one of an intensity of illumination and an illumination angle based on the distance to the potential object.

15 . The computer-implemented method of claim 12 , wherein

the determining the illumination condition comprises determining an illumination direction, such that the illumination stays illuminating the RoI.

16 . The computer-implemented method of claim 12 , wherein

illumination includes a plurality of light emitting devices directed to different directions, and

the determining the illumination condition comprises selecting one or more light emitting devices to be activated from the plurality of light emitting devices, such that the illumination stays illuminating the RoI.

17 . The computer-implemented method of claim 11 , wherein the determining the RoI for processing images for the autonomous driving operation comprises:

determining a shift of a field of view (FoV) of a camera as the camera pans and/or tilts; and

determining the RoI and a shift of the RoI, such that the RoI stays within the FoV of the camera.

18 . The computer-implemented method of claim 11 , further comprising:

capturing images in the RoI illuminated according to the determined illumination condition;

detecting one or more objects in the RoI;

determining a vehicle behavior based on the one or more detected objects; and

performing an autonomous driving operation according to the determined vehicle behavior.

19 . The computer-implemented method of claim 17 , wherein the vehicle behavior includes at least one of braking, accelerating, and steering of the autonomous-driving vehicle.

20 . The computer-implemented method of claim 17 , wherein the vehicle behavior includes at least one of light signaling and sound signaling.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2019
From: PONY.AI, INC.
To: PONY AI INC.
Reel/Frame 049434/0372 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2018
From: ZHENG, BOWEN; YU, XIANG; XIAO, SINAN; SONG, HAO; LOU, TIANCHENG; PENG, JUN
To: PONY.AI, INC.
Reel/Frame 047395/0362 →