IP Library Granted Patent US 11,115,646
Granted Patent B2
US 11,115,646 · App. 17/063,254 · Granted Sep 7, 2021

Exposure coordination for multiple cameras

Inventors: Forrest Samuel Briggs (Palo Alto, CA); James Allen-White Hoffacker (San Carlos, CA); Dhruv Lamba (San Mateo, CA); Phillip Sawbridge (Los Altos, CA)
Assignee: Woven Planet North America, Inc.
H04N13/296G05D1/0251G06K9/00791G06T7/593H04N5/2351H04N5/2353H04N13/239H04N13/243G05D2201/0213G06T2207/20081G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,115,646
App. No.
17/063,254
Granted
Sep 7, 2021
Kind
B2
Abstract

In particular embodiments, a computing system may detect a number of objects captured within an overlapping region between a first field of view associated with a first camera and a second field of view associated with a second camera. The system may determine a respective priority ranking for each of the objects. The system may select an object from the objects based on the respective priority ranking for the object. The system may determine, for the first camera, a first lighting condition associated with the first field of view. The system may determine, for the second camera, a second lighting condition associated with the second field of view. The system may determine a shared exposure time for the selected object based on the first lighting condition and the second lighting condition. The system may cause at least one image of the selected object to be captured using the shared exposure time.

Claims (47)

1. A method comprising, by a computing system:

detecting a plurality of objects captured within an overlapping region between a first field of view associated with a first camera and a second field of view associated with a second camera;

determining a respective priority ranking for each object of the plurality of objects;

selecting an object from the plurality of objects based on the respective priority ranking for the object;

determining, for the first camera, a first lighting condition associated with the first field of view;

determining, for the second camera, a second lighting condition associated with the second field of view;

determining a shared exposure time for the selected object based on the first lighting condition and the second lighting condition; and

causing at least one image of the selected object to be captured using the shared exposure time.

2. The method of claim 1 , wherein the selected object has a highest priority ranking among the plurality of objects.

3. The method of claim 1 , wherein the shared exposure time for the first camera and the second camera is based on a weighted average of the first lighting condition and the second lighting condition.

4. The method of claim 3 , wherein the shared exposure time for the first camera and the second camera is further based on a third lighting condition associated with the first field of view of the first camera outside the overlapping region, and wherein the third lighting condition has a lower weight that contributes to the weighted average than the first lighting condition and the second lighting condition.

5. The method of claim 1 , wherein the shared exposure time for the first camera and the second camera is different from independent exposure times of the first camera and the second camera, and wherein the respective independent exposure times of the first camera and the second camera are determined independently with respect to each other.

6. The method of claim 5 , wherein the shared exposure time of the first camera and the second camera is determined based on a weighted average of the respective independent exposure times of the first camera and the second camera.

7. The method of claim 5 , wherein the shared exposure time of the first camera and the second camera is determined in response to detecting a difference between the respective independent exposure times of the first camera and the second camera.

8. The method of claim 1 , wherein the first camera and the second camera are associated with a stereo camera pair or different stereo camera pairs.

9. The method of claim 1 , further comprising causing a subsequent image of a subsequent object of the plurality of objects to be captured using the shared exposure time.

10. The method of claim 1 , further comprising:

selecting a subsequent object from the plurality of objects based on the respective priority ranking for the subsequent object; and

determining a subsequent exposure time for the selected subsequent object based on the first lighting condition of the first field of view and the second lighting condition of the second field of view.

11. The method of claim 1 , wherein a region in the first field of view associated with the first camera excluding the selected object is over-exposed or under exposed to the first camera by using the shared exposure time of the first camera and the second camera.

12. The method of claim 1 , further comprising:

extracting stereo information of the selected object from the at least one captured image; and

determining three-dimensional perception information for the selected object based on the extracted stereo information.

13. A system comprising:

one or more non-transitory computer-readable storage media embodying instructions; and

one or more processors coupled to the non-transitory computer-readable storage media and operable to execute the instructions to:

detect a plurality of objects captured within an overlapping region between a first field of view associated with a first camera and a second field of view associated with a second camera;

determine a respective priority ranking for each object of the plurality of objects;

select an object from the plurality of objects based on the respective priority ranking for the object;

determine, for the first camera, a first lighting condition associated with the first field of view;

determine, for the second camera, a second lighting condition associated with the second field of view;

determine a shared exposure time for the selected object based on the first lighting condition and the second lighting condition; and

cause at least one image of the selected object to be captured using the shared exposure time.

14. The system of claim 13 , wherein the selected object has a highest priority ranking among the plurality of object.

15. The system of claim 13 , wherein the shared exposure time for the first camera and the second camera is based on a weighted average of the first lighting condition and the second lighting condition.

16. The system of claim 15 , wherein the shared exposure time for the first camera and the second camera is further based on a third lighting condition associated with the first field of view of the first camera outside the overlapping region, and wherein the third lighting condition has a lower weight that contributes to the weighted average than the first lighting condition and the second lighting condition.

17. One or more non-transitory computer-readable storage media embodying software that is operable, when executed by one or more processors of a computing system, to:

detect a plurality of objects captured within an overlapping region between a first field of view associated with a first camera and a second field of view associated with a second camera;

determine a respective priority ranking for each object of the plurality of objects;

select an object from the plurality of objects based on the respective priority ranking for the object;

determine, for the first camera, a first lighting condition associated with the first field of view;

determine, for the second camera, a second lighting condition associated with the second field of view;

determine a shared exposure time for the selected object based on the first lighting condition and the second lighting condition; and

cause at least one image of the selected object to be captured using the shared exposure time.

18. The one or more non-transitory computer-readable storage media of claim 17 , wherein the selected object has a highest priority ranking among the plurality of objects.

19. The one or more non-transitory computer-readable storage media of claim 17 , wherein the shared exposure time for the first camera and the second camera is based on a weighted average of the first lighting condition and the second lighting condition.

20. The one or more non-transitory computer-readable storage media of claim 19 , wherein the shared exposure time for the first camera and the second camera is further based on a third lighting condition associated with the first field of view of the first camera outside the overlapping region, and wherein the third lighting condition has a lower weight that contributes to the weighted average than the first lighting condition and the second lighting condition.

Assignments (2)
CHANGE OF NAME Recorded Jun 22, 2023
From: WOVEN PLANET NORTH AMERICA, INC.
To: WOVEN BY TOYOTA, U.S., INC.
Reel/Frame 064065/0601 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2021
From: LYFT, INC.; BLUE VISION LABS UK LIMITED
To: WOVEN PLANET NORTH AMERICA, INC.
Reel/Frame 056927/0001 →