IP Library Granted Patent US 11,151,392
Granted Patent B2
US 11,151,392 · App. 16/716,353 · Granted Oct 19, 2021

Method and apparatus for camera calibration processing, device for vehicle control and storage medium

Inventors: Tong Wu (Beijing, CN); Gaifan Li (Beijing, CN); Xun Zhou (Beijing, CN); Shirui Li (Beijing, CN)
Assignee: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
G06K9/00791B60R1/00G06K9/209G06T7/80B60R2300/402G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,151,392
App. No.
16/716,353
Granted
Oct 19, 2021
Kind
B2
Abstract

Embodiments of the present disclosure provide a method and an apparatus for camera calibration processing, a device for vehicle control and a storage medium. In the method according to the embodiments of the present disclosure, at least one pair of images collected by a camera and a vehicle position at a collection time of each of the images are acquired during a process of a vehicle travelling along a straight line, where each pair of images includes images taken by the camera at two different positions, and two images in each pair of images include a common static feature point. A current installation angle of the camera is calculated according to the at least one pair of images and the vehicle position at the collection time of each of the images.

Claims (56)

1. A method for camera calibration processing, comprising:

acquiring, during a process of a vehicle travelling along a straight line, at least one pair of images collected by a camera, and a vehicle position at a collection time of each of the images, wherein each pair of images comprises images taken by the camera at two different positions, and two images in each pair of images comprise a common static feature point;

calculating a current installation angle of the camera, according to the at least one pair of images and the vehicle position at the collection time of each of the images;

determining whether an installation angle error of the camera is within a preset error range; and

taking a preset processing measure, when the installation angle error of the camera is not within the preset error range;

wherein the acquiring, during a process of a vehicle travelling along a straight line, at least one pair of images collected by a camera comprises:

acquiring original data collected by the camera, during the process of the vehicle travelling along the straight line; and

sampling the original data according to a preset sampling frequency to acquire the at least one pair of images, wherein each pair of images comprises images sampled at two different sampling times, and the two images in each pair of images comprise the common static feature point;

wherein the sampling the original data according to a preset sampling frequency to acquire the at least one pair of images comprises:

sampling the original data according to the preset sampling frequency to acquire 2N images, wherein N is a positive integer; and dividing the 2N images into N pairs to acquire N pairs of images, wherein each pair of images comprises images sampled at two adjacent sampling times, and two images in each pair of images comprise the common static feature point; or

repeating sampling processing on the original data for N times to acquire N pairs of images, wherein N is a positive integer, and wherein the sampling processing comprises: sampling out one pair of images from the original data, wherein a time interval between collection times of the pair of images is less than a preset time threshold, so that the pair of images comprises the common static feature point.

2. The method according to claim 1 , wherein the taking a preset processing measure, when the installation angle error of the camera is not within the preset error range comprises:

controlling the vehicle to issue warning information, when the installation angle error of the camera is not within the preset error range.

3. The method according to claim 1 , wherein the acquiring, during a process of a vehicle travelling along a straight line, a vehicle position at a collection time of each of the images comprises:

acquiring vehicle positioning data collected by a positioning apparatus in real time, during the process of the vehicle travelling along the straight line; and

determining the vehicle position at the collection time of each of the images, according to the collection time of each of the images and the vehicle positioning data collected by the positioning apparatus in real time.

4. The method according to claim 1 , wherein the calculating a current installation angle of the camera, according to the at least one pair of images and the vehicle position at the collection time of each of the images comprises:

calculating an installation angle of the camera respectively according to each pair of images and the vehicle position at the collection time of each of the images, to obtain at least one installation angle of the camera; and

calculating an average value of the at least one installation angle, to obtain the current installation angle of the camera.

5. A system, comprising:

a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein

the computer program when being executed by the processor, causes the processor to:

acquire, during a process of a vehicle travelling along a straight line, at least one pair of images collected by a camera, and a vehicle position at a collection time of each of the images, wherein each pair of images comprises images taken by the camera at two different positions, and two images in each pair of images comprise a common static feature point;

calculate a current installation angle of the camera, according to the at least one pair of images and the vehicle position at the collection time of each of the images; and

determine whether an installation angle error of the camera is within a preset error range; and

take a preset processing measure, when the installation angle error of the camera is not within the preset error range;

wherein the computer program further causes the processor to:

acquire original data collected by the camera, during the process of the vehicle travelling along the straight line; and

sample the original data according to a preset sampling frequency to acquire the at least one pair of images, wherein each pair of images comprises images sampled at two different sampling times, and the two images in each pair of images comprise the common static feature point; wherein the computer program further causes the processor to:

sample the original data according to the preset sampling frequency to acquire 2N images, wherein N is a positive integer; and divide the 2N images into N pairs to acquire N pairs of images, wherein each pair of images comprises images sampled at two adjacent sampling times, and two images in each pair of images comprise the common static feature point; or

repeat sampling processing on the original data for N times to acquire N pairs of images, wherein N is a positive integer, and wherein the sampling processing comprises: sampling out one pair of images from the original data, wherein a time interval between collection times of the pair of images is less than a preset time threshold, so that the pair of images comprises the common static feature point.

6. The system according to claim 5 , wherein the computer program further causes the processor to:

acquire vehicle positioning data collected by a positioning apparatus in real time, during the process of the vehicle travelling along the straight line; and

determine the vehicle position at the collection time of the data of each of the images, according to the collection time of the data of each of the images and the vehicle positioning data collected by the positioning apparatus in real time.

7. The system according to claim 5 , wherein the computer program further causes the processor to:

calculate an installation angle of the camera respectively according to each pair of images and the vehicle position at the collection time of each of the images, to obtain at least one installation angle of the camera; and

calculate an average value of the at least one installation angle, to obtain the current installation angle of the camera.

8. A non-transitory computer readable storage medium, having a computer program stored thereon,

wherein the computer program when being executed by a processor, causes the processor to:

acquire, during a process of a vehicle travelling along a straight line, at least one pair of images collected by a camera, and a vehicle position at a collection time of each of the images, wherein each pair of images comprises images taken by the camera at two different positions, and two images in each pair of images comprise a common static feature point;

calculate a current installation angle of the camera, according to the at least one pair of images and the vehicle position at the collection time of each of the images; and

determine whether an installation angle error of the camera is within a preset error range; and

take a preset processing measure, when the installation angle error of the camera is not within the preset error range;

wherein the computer program further causes the processor to:

acquire original data collected by the camera, during the process of the vehicle travelling along the straight line; and

sample the original data according to a preset sampling frequency to acquire the at least one pair of images, wherein each pair of images comprises images sampled at two different sampling times, and the two images in each pair of images comprise the common static feature point; wherein the computer program further causes the processor to:

sample the original data according to the preset sampling frequency to acquire 2N images, wherein N is a positive integer; and divide the 2N images into N pairs to acquire N pairs of images, wherein each pair of images comprises images sampled at two adjacent sampling times, and two images in each pair of images comprise the common static feature point; or

repeat sampling processing on the original data for N times to acquire N pairs of images, wherein N is a positive integer, and wherein the sampling processing comprises: sampling out one pair of images from the original data, wherein a time interval between collection times of the pair of images is less than a preset time threshold, so that the pair of images comprises the common static feature point.

9. The non-transitory computer readable storage medium according to claim 8 , wherein the computer program further causes the processor to:

control the vehicle to issue warning information, when the installation angle error of the camera is not within the preset error range.

10. The non-transitory computer readable storage medium according to claim 8 , wherein the computer program further causes the processor to:

acquire vehicle positioning data collected by a positioning apparatus in real time, during the process of the vehicle travelling along the straight line; and

determine the vehicle position at the collection time of each of the images, according to the collection time of each of the images and the vehicle positioning data collected by the positioning apparatus in real time.

11. The non-transitory computer readable storage medium according to claim 8 , wherein the computer program further causes the processor to:

calculate an installation angle of the camera respectively according to each pair of images and the vehicle position at the collection time of each of the images, to obtain at least one installation angle of the camera; and

calculate an average value of the at least one installation angle, to obtain the current installation angle of the camera.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058241/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2019
From: WU, TONG; LI, GAIFAN; ZHOU, XUN; LI, SHIRUI
To: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
Reel/Frame 051298/0677 →
Priority Claims (1)
CN 201811543203.X · Dec 17, 2018 · national
Continuity (1)
Related Publication 20200193171A1 · Jun 18, 2020