IP Library Granted Patent US 11,508,089
Granted Patent B2
US 11,508,089 · App. 17/193,852 · Granted Nov 22, 2022

LiDAR assisted wheel encoder to camera calibration

Inventors: Yu Huang (Sunnyvale, CA); Ruihui Di (Castro Valley, CA); Zheng Qi (Cupertino, CA); Jizhang Shan (Los Gatos, CA)
Assignee: Black Sesame Technologies Inc.
G06T7/80G01S17/89H04N7/18G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,508,089
App. No.
17/193,852
Granted
Nov 22, 2022
Kind
B2
Abstract

A method of wheel encoder to camera calibration, including receiving a LiDAR (Light Detection and Ranging) signal, receiving a camera signal, receiving a wheel encoder signal, calibrating the camera signal to the LiDAR signal, calibrating the wheel encoder signal to the LiDAR signal and calibrating the camera signal to the wheel encoder signal based on the calibration of the camera signal to the LiDAR signal and the wheel encoder signal to the LiDAR signal.

Claims (13)

1. A method of wheel encoder to camera calibration, comprising:

receiving a LiDAR signal;

receiving a camera signal;

receiving a wheel encoder signal;

determining a camera signal to wheel encoder signal scaling factor;

determining a LiDAR signal to wheel encoder signal scaling factor;

estimating the wheel encoder signal indicating a rotation in an X-direction without a rotation about a Z-axis based on the camera signal to wheel encoder signal scaling factor and the LiDAR signal to wheel encoder signal scaling factor;

determining a wheel encoder translation in the X-direction without the rotation about the Z-axis; and

calibrating the camera signal to the wheel encoder signal based on the calibration of the camera signal to the LiDAR signal and die wheel encoder signal to the LiDAR signal, wherein the LiDAR signal is utilized as a bridge between the camera signal and the wheel encoder signal.

2. The method of wheel encoder to camera calibration of claim 1 , further comprising matching a LiDAR signal point cloud of the LiDAR signal to an image pixel of the camera signal for a scene point.

3. The method wheel encoder to camera calibration of claim 1 , wherein the camera sign LiDAR signal calibration is performed statically.

4. The method of wheel encoder to camera calibration of claim 1 , wherein the wheel encoder signal to Li DAR signal calibration is performed dynamically.

5. The method of wheel encoder to camera calibration of claim 1 , further comprising rotating a transport that receives the LiDAR signal, the camera signal and the wheel encoder signal via a rolling board.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: BLACK SESAME INTERNATIONAL HOLDING LIMITED
To: BLACK SESAME TECHNOLOGIES INC.
Reel/Frame 058301/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2021
From: HUANG, YU; DI, RUIHUI; QI, ZHENG; SHAN, JIZHANG
To: BLACK SESAME INTERNATIONAL HOLDING LIMITED
Reel/Frame 057908/0508 →
Continuity (1)
Related Publication 20220284626A1 · Sep 8, 2022