IP Library Granted Patent US 12,407,803
Granted Patent B1
US 12,407,803 · App. 18/502,253 · Granted Sep 2, 2025

Recalibrating stereoscopic cameras during vehicle operation

Inventors: Volkmar Uhlig (Cupertino, CA); Prannay Khosla (Mountain View, CA); Shaun M. Pacheco (Santa Clara, CA); Mohammadamin Khajehnejad (Hoboken, NJ); Ying Li (Palo Alto, CA); Bobak Farzin (Fraser, CO)
Assignee: Applied Intuition, Inc.
H04N13/246B60W60/001G06T7/593G06T7/85H04N23/61B60W2420/403H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,803
App. No.
18/502,253
Granted
Sep 2, 2025
Kind
B1
Abstract

Recalibrating stereoscopic cameras during vehicle operation may include: determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration, and wherein the disparity comprises a difference in placement of one or more objects in the first image data relative to the second image data; and adjusting one or more of the first camera or the second camera, based on the disparity and sensor data from a sensor other than the first camera or the second camera, to calibrate the stereoscopic configuration of the first camera and the second camera to achieve stereoscopic camera distance functionality.

Claims (26)

1. A method comprising:

determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration, and wherein the disparity comprises a difference in placement of one or more objects in the first image data relative to the second image data; and

adjusting one or more of the first camera or the second camera, based on the disparity and sensor data from a sensor other than the first camera or the second camera, to calibrate the stereoscopic configuration of the first camera and the second camera to achieve stereoscopic camera distance functionality.

2. The method of claim 1 , wherein adjusting one or more of the first camera or the second camera comprises modifying, based on the disparity and the sensor data, data describing a relative positioning of the first camera and the second camera.

3. The method of claim 2 , wherein modifying the data comprises modifying the data based on the disparity in response to no objects being identified in the sensor data.

4. The method of claim 2 , wherein modifying the data comprises modifying the data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

5. The method of claim 1 , wherein adjusting one or more of the first camera or the second camera comprises providing, based on the disparity and the sensor data, a command to crop image data from one or more of the first camera or the second camera to generate cropped image data.

6. The method of claim 5 , wherein providing the command comprises determining an optical center of the cropped image data based on the disparity in response to no objects being identified in the sensor data.

7. The method of claim 5 , wherein providing the command comprises determining an optical center of the cropped image data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

8. The method of claim 1 , further comprising generating one or more autonomous driving decisions based on image data from the first camera and the second camera.

9. The method of claim 1 , wherein calculating the disparity and adjusting one or more of the first camera and the second camera are performed during an autonomous driving mode of an autonomous vehicle.

10. An apparatus comprising at least one processor and memory storing instructions that, when executed, cause the at least one processor to perform steps comprising:

determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration, and wherein the disparity comprises a difference in placement of one or more objects in the first image data relative to the second image data; and

adjusting one or more of the first camera or the second camera, based on the disparity and sensor data from a sensor other than the first camera or the second camera, to calibrate the stereoscopic configuration of the first camera and the second camera to achieve stereoscopic camera distance functionality.

11. The apparatus of claim 10 , wherein adjusting one or more of the first camera or the second camera comprises modifying, based on the disparity and the sensor data, data describing a relative positioning of the first camera and the second camera.

12. The apparatus of claim 11 , wherein modifying the data comprises modifying the data based on the disparity in response to no objects being identified in the sensor data.

13. The apparatus of claim 11 , wherein modifying the data comprises modifying the data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

14. The apparatus of claim 10 , wherein adjusting one or more of the first camera or the second camera comprises providing, based on the disparity and the sensor data, a command to crop image data from one or more of the first camera or the second camera to generate cropped image data.

15. The apparatus of claim 14 , wherein providing the command comprises determining an optical center of the cropped image data based on the disparity in response to no objects being identified in the sensor data.

16. The apparatus of claim 14 , wherein providing the command comprises determining an optical center of the cropped image data based on a difference between a first distance of an object identified in the sensor data and a second distance of the object calculated as a function of the disparity.

17. The apparatus of claim 10 , wherein the steps further comprise comprising generating one or more autonomous driving decisions based on image data from the first camera and the second camera.

18. The apparatus of claim 10 , wherein calculating the disparity and adjusting one or more of the first camera and the second camera are performed during an autonomous driving mode of an autonomous vehicle.

19. A computer program product disposed upon a non-transitory computer readable medium, the computer program product comprising computer program instructions that, when executed, cause a computer system to carry out steps comprising:

determining a disparity between first image data from a first camera and second image data from a second camera, wherein the first camera and the second camera are in a stereoscopic configuration, and wherein the disparity comprises a difference in placement of one or more objects in the first image data relative to the second image data; and

adjusting one or more of the first camera or the second camera, based on the disparity and sensor data from a sensor other than the first camera or the second camera, to calibrate the stereoscopic configuration of the first camera and the second camera to achieve stereoscopic camera distance functionality.

20. The computer program product of claim 19 , wherein adjusting one or more of the first camera or the second camera comprises modifying, based on the disparity and the sensor data, data describing a relative positioning of the first camera and the second camera.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2024
From: GHOST AUTONOMY, INC.
To: APPLIED INTUITION, INC.
Reel/Frame 068982/0647 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2023
From: UHLIG, VOLKMAR; KHOSLA, PRANNAY; PACHECO, SHAUN M.; KHAJEHNEJAD, MOHAMMADAMIN; LI, YING; FARZIN, BOBAK
To: GHOST AUTONOMY INC.
Reel/Frame 065467/0262 →
Continuity (3)
Continuation 18329437 · Jun 5, 2023
Continuation In Part 17660821 · Apr 26, 2022
Continuation In Part 17676569 · Feb 21, 2022
References Cited (28)
US 9602806B1 · Stafford · 2017 [cited by examiner]
US 10489912B1 · Brailovskiy · 2019 [cited by examiner]
US 10582186B1 · Baldwin · 2020 [cited by examiner]
US 10832418B1 · Karasev et al. · 2020 [cited by applicant]
US 11805316B2 · Hayes · 2023 [cited by examiner]
US 11849225B2 · Uhlig et al. · 2023 [cited by applicant]
US 11909944B1 · Uhlig · 2024 [cited by examiner]
US 20050146621A1 · Tanaka · 2005 [cited by examiner]
US 20140146185A1 · Kannermark · 2014 [cited by examiner]
US 20170237937A1 · Motohashi · 2017 [cited by examiner]
US 20180070023A1 · Oh · 2018 [cited by examiner]
US 20190279440A1 · Ricci · 2019 [cited by examiner]
US 20190289282A1 · Briggs · 2019 [cited by examiner]
US 20190325580A1 · Lukac · 2019 [cited by examiner]
US 20200175326A1 · Shen · 2020 [cited by examiner]
US 20210099643A1 · Agrawal · 2021 [cited by examiner]
US 20210327092A1 · Jiang · 2021 [cited by examiner]
US 20210350137A1 · Imes · 2021 [cited by examiner]
US 20220050890A1 · Karantzis · 2022 [cited by examiner]
US 20220180131A1 · Oblak · 2022 [cited by examiner]
US 20220182551A1 · Fang · 2022 [cited by examiner]
US 20220188560A1 · Dharia · 2022 [cited by examiner]
US 20220210305A1 · Feng · 2022 [cited by examiner]
US 20220301188A1 · Yoon et al. · 2022 [cited by applicant]
US 20220365210A1 · Lind · 2022 [cited by examiner]
US 20220385816A1 · Jung · 2022 [cited by examiner]
US 20220388535A1 · Singh et al. · 2022 [cited by applicant]
US 20220392036A1 · Feng et al. · 2022 [cited by applicant]