IP Library Granted Patent US 12,462,428
Granted Patent B2
US 12,462,428 · App. 18/328,862 · Granted Nov 4, 2025

Sensor angular alignment

Inventors: Hongtao Wang (Madison Heights, MI); Wende Zhang (Birmingham, MI); Hao Yu (Troy, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G06T7/80G01C21/1656B60W10/18B60W10/20B60W60/00B60W2710/18B60W2710/20B60W2720/106
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,428
App. No.
18/328,862
Granted
Nov 4, 2025
Kind
B2
Abstract

Methods, apparatus, and systems for sensor alignment include acquiring a translational vector, a first calibration point location and a second calibration point location, determining an expected rotational orientation in response to the translational vector, the first calibration point location and the second calibration point location, capturing an image of the a first calibration point and the second calibration point, determining a first position of the first calibration point and a second position of the second calibration point in response to the image, calculating a calculated rotational orientation in response to the first position of the first calibration point and the second position of the second calibration point, determining a calibration value in response to the calculated rotational orientation, storing the calibration value and controlling a vehicle in response to the calibration value and a subsequent image.

Claims (35)

1 . An apparatus comprising:

a camera configured to capture a first image of a first field of view;

a data interface configured to receive a translational vector, a first location of a first calibration point and a second location of a second calibration point and wherein the first calibration point and the second calibration point are within the first field of view;

a processor configured to determine an expected rotational orientation in response to the first location of the first calibration point and the second location of the second calibration point, to determine a first position of the first calibration point within the first image and a second position of the second calibration point within the first image, to determine a calculated rotational orientation in response to the first position of the first calibration point within the first image and the second position of the second calibration point within the first image; and to generate a calibration value in response to the calculated rotational orientation;

a memory configured to store the calibration value; and

a vehicle controller configured to control a host vehicle in response to the calibration value and a subsequent image captured by the camera.

2 . The apparatus of claim 1 wherein the translational vector, the first location of the first calibration point and the second location of the second calibration point are coordinates within a three dimensional coordinate system and wherein the processor is further operative to convert the translational vector, the first location of the first calibration point and the second location of the second calibration point into a two dimensional coordinate system.

3 . The apparatus of claim 1 wherein the translational vector is transmitted from a calibration station to the data interface via a wireless network.

4 . The apparatus of claim 1 wherein the translational vector is determined in response to a vehicle design parameter and a vehicle orientation within a calibration environment.

5 . The apparatus of claim 1 wherein the first calibration point and the second the second calibration point are located on a calibration target within the first field of view.

6 . The apparatus of claim 1 wherein a two point algorithm is used to compute the calculated rotational orientation.

7 . The apparatus of claim 1 wherein the processor is further operative to determine a subsequent calculated rotational orientation in response to an error of the calculated rotational orientation being greater than a threshold value.

8 . The apparatus of claim 1 wherein the first position of the first calibration point and the second position of the second calibration point are determined within the two dimensional coordinate system.

9 . The apparatus of claim 1 further including an inertial measurement unit for measuring a vehicle attitude and wherein the vehicle attitude and the translational vector are used to calculate the expected rotational orientation.

10 . A method comprising:

capturing, by a first camera, a first image of a first field of view;

receiving, by a data interface, a translational vector, a first location of a first calibration point and a second location of a second calibration point and wherein the first calibration point and the second calibration point are within the first field of view;

determining, by a processor, an expected rotational orientation in response to the first location of the first calibration point and the second location of the second calibration point, to determine a first position of the first calibration point within the first image and a second position of the second calibration point within the first image, to determine a calculated rotational orientation in response to the first position of the first calibration point within the first image and the second position of the second calibration point within the first image; and to generate a calibration value in response to the calculated rotational orientation;

storing, in a memory, the calibration value; and

controlling, by a vehicle controller, a host vehicle in response to the calibration value and a subsequent image captured by the camera.

11 . The method of claim 10 further including translating the translational vector, the first calibration point location and the second calibration point location from a three dimensional coordinate system to a two dimensional coordinate system.

12 . The method of claim 10 including predetermining the translational vector in response to a vehicle dimension and a camera position.

13 . The method of claim 10 , including determining the translational vector in response to the image and a lidar depth map.

14 . The method of claim 10 , including determining the translational vector in response to a vehicle attitude value detected by an inertial measurement unit.

15 . The method of claim 10 , including determining the calculated rotational orientation in response to a two point algorithm.

16 . The method of claim 10 , including recalculating the calibration value in response a subsequent angular difference between a subsequent calculated rotational orientation and the calculated rotational orientation exceeding a threshold value.

17 . The method of claim 10 wherein the first calibration point and the second calibration point are located on a calibration target within a manufacturing calibration test station.

18 . The method of claim 10 , wherein the calculated rotational orientation is determined in response to a small angle approximation.

19 . A camera calibration system comprising:

an optical sensor for capturing a two dimensional image of a field of view;

a network interface for receiving a translational vector, a first location of a first calibration point and a second location of a second calibration point and wherein the first calibration point and the second calibration point are within the field of view;

a processor for determining an expected rotational orientation in response to the first location of the first calibration point and the second location of the second calibration point, for determining a first position of the first calibration point within the two dimensional image and a second position of the second calibration point within the two dimensional image, for determining a calculated rotational orientation in response to the first position of the first calibration point within the two dimensional image and the second position of the second calibration point within the two dimensional image; and for generating a calibration value in response to the calculated rotational orientation;

a memory for storing the calibration value; and

a vehicle controller for controlling a host vehicle in response to the calibration value and a subsequent two dimensional image captured by the optical sensor.

20 . The camera calibration system of claim 19 , wherein the translational vector, the first location of the first calibration point and the second location of the second calibration point are coordinates within a three dimensional coordinate system and wherein the processor is further operative to convert the translational vector, the first location of the first calibration point and the second location of the second calibration point into a two dimensional coordinate system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2023
From: WANG, HONGTAO; ZHANG, WENDE; YU, HAO
To: GM GLOBAL TECHNOLOGY OPERTAIONS LLC
Reel/Frame 063850/0363 →
Continuity (1)
Related Publication 20240404107A1 · Dec 5, 2024
References Cited (31)
US 9386302B2 · Zeng · 2016 [cited by examiner]
US 11538188B1 · Cejka · 2022 [cited by examiner]
US 20050280709A1 · Katayama · 2005 [cited by examiner]
US 20060290920A1 · Kampchen · 2006 [cited by examiner]
US 20080089611A1 · McFadyen · 2008 [cited by examiner]
US 20150049193A1 · Gupta · 2015 [cited by examiner]
US 20150341629A1 · Zeng · 2015 [cited by examiner]
US 20200294268A1 · Weng · 2020 [cited by examiner]
US 20220067967A1 · Luo · 2022 [cited by examiner]
US 20220276339A1 · Ma · 2022 [cited by examiner]
US 20220276360A1 · Ma · 2022 [cited by examiner]
US 20240070915A1 · Leeman · 2024 [cited by examiner]
CN 100573586C · 2009 [cited by examiner]
CN 109903341A · 2019 [cited by examiner]
CN 110363819A · 2019 [cited by examiner]
CN 113516722A · 2021 [cited by examiner]
CN 113661505A · 2021 [cited by examiner]
CN 113870357A · 2021 [cited by examiner]
CN 114092552A · 2022 [cited by examiner]
CN 110176036B · 2023 [cited by examiner]
CN 110363819B · 2023 [cited by examiner]
CN 116442909A · 2023 [cited by examiner]
DE 102021204363A1 · 2022 [cited by examiner]
EP 1615047A2 · 2006 [cited by examiner]
JP H10341458A · 1998 [cited by examiner]
JP 2004340840A · 2004 [cited by examiner]
JP 2010103730A · 2010 [cited by examiner]
JP 2013024712A · 2013 [cited by examiner]
JP 2020051932A · 2020 [cited by examiner]
KR 101419721B1 · 2014 [cited by examiner]
TW 201417042A · 2014 [cited by examiner]