IP Library Granted Patent US 11,909,944
Granted Patent B1
US 11,909,944 · App. 18/329,437 · Granted Feb 20, 2024

Dynamic calibration of cameras in a stereoscopic configuration

Inventors: Volkmar Uhlig (Cupertino, CA); Prannay Khosla (Mountain View, CA); Shaun M. Pacheco (Santa Clara, CA); Mohammadamin Khajehnejad (Hoboken, NJ); Ying Li (Palo Alto, CA); Bobak Farzin (Fraser, CO)
Assignee: GHOST AUTONOMY INC.
H04N13/246B60W60/001G06T7/593G06T7/85H04N23/61B60W2420/42H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,909,944
App. No.
18/329,437
Granted
Feb 20, 2024
Kind
B1
Abstract

Dynamic calibration of cameras in a stereoscopic configuration may include: determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration, and wherein the disparity comprises a difference in placement of one or more objects in the first image data relative to the second image data; and adjusting one or more of the first camera or the second camera, based on the disparity and sensor data from a sensor other than the first camera and the second camera, to calibrate the stereoscopic configuration of the first camera and the second camera to achieve stereoscopic camera distance functionality.

Claims (30)

1. A method comprising:

determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration, and wherein the disparity comprises a difference in placement of one or more objects in the first image data relative to the second image data;

adjusting one or more of the first camera or the second camera, based on the disparity and sensor data from a sensor other than the first camera or the second camera, to calibrate the stereoscopic configuration of the first camera and the second camera to achieve stereoscopic camera distance functionality;

identifying, after adjusting one or more of the first camera and the second camera, based on image data from the first camera and the second camera, a lateral positioning of an object; and

calibrating the sensor based on the lateral positioning of the object and a distance of the object determined via the sensor.

2. The method of claim 1 , wherein adjusting one or more of the first camera or the second camera comprises modifying, based on the disparity and the sensor data, data describing a relative positioning of the first camera and the second camera.

3. The method of claim 2 , wherein modifying the data comprises modifying the data based on the disparity in response to no objects being identified in the sensor data.

4. The method of claim 2 , wherein modifying the data comprises modifying the data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

5. The method of claim 1 , wherein adjusting one or more of the first camera or the second camera comprises providing, based on the disparity and the sensor data, a command to crop image data from one or more of the first camera or the second camera to generate cropped image data.

6. The method of claim 5 , wherein providing the command comprises determining an optical center of the cropped image data based on the disparity in response to no objects being identified in the sensor data.

7. The method of claim 5 , wherein providing the command comprises determining an optical center of the cropped image data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

8. The method of claim 1 , further comprising generating one or more autonomous driving decisions image data from the first camera and the second camera.

9. The method of claim 1 , wherein calculating the disparity and adjusting one or more of the first camera and the second camera are performed during an autonomous driving mode of an autonomous vehicle.

10. A method comprising:

determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration;

modifying, based on the disparity and sensor data from a sensor other than the first camera and the second camera, data describing a relative positioning of the first camera and the second cameral;

identifying, after modifying the data describing the relative positioning of the first camera and the second camera, based on image data from the first camera and the second camera, a lateral positioning of an object; and

calibrating the sensor based on the lateral positioning of the object and a distance of the object determined via the sensor.

11. The method of claim 10 , wherein modifying the data comprises modifying the data based on the disparity in response to no objects being identified in the sensor data.

12. The method of claim 10 , wherein modifying the data comprises modifying the data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

13. The method of claim 10 , further comprising generating one or more autonomous driving decisions based on the data and image data from the first camera and the second camera.

14. The method of claim 10 , wherein the data describing the relative positioning of the first camera and the second camera comprises data describing one or more angles between a direction of the first camera and a direction of the second camera.

15. A method comprising:

determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration;

providing, based on the disparity and sensor data from a sensor other than the first camera and the second camera, a command to crop image data from one or more of the first camera or the second camera to generate cropped image data;

identifying, after providing the command and based on image data from the first camera and the second camera, a lateral positioning of an object, wherein the image data comprises the cropped image data from the first camera or the second camera; and

calibrating the sensor based on the lateral positioning of the object and a distance of the object determined via the sensor.

16. The method of claim 15 , wherein providing the command comprises determining an optical center of the cropped image data based on the disparity in response to no objects being identified in the sensor data.

17. The method of claim 15 , wherein providing the command comprises determining an optical center of the cropped image data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

18. The method of claim 15 , further comprising generating one or more autonomous driving decisions based cropped image data from the first camera or the second camera.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2024
From: GHOST AUTONOMY, INC.
To: APPLIED INTUITION, INC.
Reel/Frame 068982/0647 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2023
From: UHLIG, VOLKMAR; KHOSLA, PRANNAY; PACHECO, SHAUN M.; KHAJEHNEJAD, MOHAMMADAMIN; LI, YING; FARZIN, BOBAK
To: GHOST AUTONOMY INC.
Reel/Frame 063858/0533 →
Continuity (2)
Continuation In Part 17660821 · Apr 26, 2022
Continuation In Part 17676569 · Feb 21, 2022
Cited By (3)
US 12,354,293 US 12,407,803 US 12,407,943