IP Library Granted Patent US 10,558,873
Granted Patent B2
US 10,558,873 · App. 15/842,182 · Granted Feb 11, 2020

Methods and systems for controlling extent of light encountered by an image capture device of a self-driving vehicle

Inventors: Brendan Hermalyn (San Francisco, CA); Andreas Wendel (Mountain View, CA); Jeremy Dittmer (Mountain View, CA)
Assignee: Waymo LLC
G06K9/00825B60R1/00B60R11/04G06K9/00818H04N7/18B60R2300/102B60R2300/307
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,558,873
App. No.
15/842,182
Granted
Feb 11, 2020
Kind
B2
Abstract

Example implementations may relate to use of a light-control feature to control extent of light encountered by an image capture device of a self-driving vehicle. In particular, a computing system of the vehicle may make a determination that quality of image data generated by an image capture device is or is expected to be lower than a threshold quality due to external light encountered or expected to be encountered by the image capture device. In response to the determination, the computing system may make an adjustment to the light-control feature to control the extent of external light encountered or expected to be encountered by the image capture device. This adjustment may ultimately help improve quality of image data generated by the image capture device. As such, the computing system may operate the vehicle based at least on image data generated by the image capture device.

Claims (35)

1. A method comprising:

making a determination, by a computing system, that quality of image data generated by an image capture device is or is expected to be lower than a threshold quality due to external light encountered or expected to be encountered by the image capture device, wherein the image capture device is coupled to a vehicle, wherein the vehicle includes a light-control feature that is adjustable to control an extent of external light encountered by the image capture device, wherein the light-control feature comprises a wiper, and wherein the wiper is separate from the image capture device;

in response to the determination, making an adjustment, by the computing system, to the light-control feature to control the extent of external light encountered or expected to be encountered by the image capture device, wherein making the adjustment comprises adjusting a position of the wiper to reduce the extent of external light encountered or expected to be encountered by the image capture device; and

operating the vehicle based at least on image data generated by the image capture device.

2. The method of claim 1 , wherein making the determination comprises determining that a light source is or is expected to be proximate to an object within a field of view of the image capture device from a perspective of the image capture device.

3. The method of claim 1 , wherein making the determination comprises determining that the image capture device is encountering or is expected to encounter one or more of the following: (i) blooming, (ii) oversaturation, (iii) threshold high exposure to external light, (iv) threshold low exposure to external light, (v) generation of image data having threshold low resolution, and (vi) generation of image data unusable for detection or identification of an object.

4. The method of claim 1 , wherein adjusting position of the wiper comprises adjusting position of the wiper relative to the image capture device and relative to a light source generating external light.

5. The method of claim 1 , wherein the image capture device is disposed within a housing that is coupled to the vehicle, and wherein the wiper is coupled to the housing.

6. The method of claim 1 , wherein the light-control feature further comprises a light-control device having adjustable light transmission properties, and wherein making the adjustment further comprises adjusting light transmission properties of the light-control device to control the extent of external light encountered or expected to be encountered by the image capture device.

7. The method of claim 6 , wherein the light-control device is an electrochromic device.

8. The method of claim 1 , wherein the adjustment is based on causing quality of image data generated by the image capture device to be higher than the threshold quality.

9. A method comprising:

making a determination, by a computing system, that a light source is proximate to an object within a field of view of an image capture device from a perspective of the image capture device, wherein the image capture device is coupled to a vehicle, wherein the vehicle includes a light-control feature that is adjustable to control an extent of external light encountered by the image capture device, wherein the light-control feature comprises a wiper, and wherein the wiper is separate from the image capture device; and

in response to the determination, making an adjustment, by the computing system, to the wiper to block at least a portion of the light source in the field of view of the image capture device.

10. The method of claim 9 , wherein the light source is the sun.

11. The method of claim 9 , wherein the object is a traffic signal.

12. The method of claim 9 , further comprising:

operating, by the computing system, the image capture device to generate image data during the adjustment to the wiper, wherein the image data comprises a plurality of images; and

operating, by the computing system, the vehicle based at least on image data generated by the image capture device,

wherein operating the vehicle based at least on image data generated by the image capture device comprises operating the vehicle based at least on a particular image, from among the plurality of images, in which the wiper blocks at least a portion of the light source in the field of view of the image capture device.

13. The method of claim 12 , wherein the adjustment to the wiper moves the wiper incrementally across a field of view of the image capture device.

14. A vehicle comprising:

an image capture device configured to generate image data representative of an environment around the vehicle;

a wiper that is movable relative to a field of view of the image capture device, wherein the wiper is separate from the image capture device; and

a computing system configured to:

make a determination that a light source is proximate to an object within the field of view of the image capture device from a perspective of the image capture device;

in response to the determination, cause a movement of the wiper to block at least a portion of light from the light source in the field of view of the image capture device; and

operate the vehicle based on image data generated by the image capture device.

15. The vehicle of claim 14 , wherein causing a movement of the wiper to block at least a portion of the light source in the field of view of the image capture device comprises causing incremental movements of the wiper that alter the extent of external light encountered by the image capture device.

16. The vehicle of claim 14 ,

wherein the computing system is further configured to operate the image capture device to generate image data during the movement of the wiper, wherein the image data comprises a plurality of images, and

wherein operating the vehicle based on image data generated by the image capture device comprises operating the vehicle based at least on a particular image, from among the plurality of images, in which the wiper blocks at least a portion of the light source in the field of view of the image capture device.

17. The vehicle of claim 16 , wherein the object is visible in the particular image.

18. The method of claim 1 , wherein adjusting the position of the wiper blocks at least a portion of light from a light source that is or is expected to be proximate to an object within a field of view of the image capture device from a perspective of the image capture device.

19. The method of claim 18 , wherein the light source is the sun, and wherein the object is a traffic signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2017
From: HERMALYN, BRENDAN; WENDEL, ANDREAS; DITTMER, JEREMY
To: WAYMO LLC
Reel/Frame 044400/0067 →
Continuity (1)
Related Publication 20190188502A1 · Jun 20, 2019
Cited By (3)
US 12,332,113 US 12,518,543 US 12,581,200