IP Library Granted Patent US 10,249,056
Granted Patent B2
US 10,249,056 · App. 14/251,058 · Granted Apr 2, 2019

Vehicle position estimation system

Inventor: Naoki Kojo (Sunnyvale, CA)
Assignee: Nissan North America, Inc.
G06T7/80G06T2207/10016G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,249,056
App. No.
14/251,058
Granted
Apr 2, 2019
Kind
B2
Abstract

A system for calculating the sensitivity of a camera in a vehicle control system includes an internal parameter system, a controller, and a storage device. The internal parameter system is configured to determine an image coordinate of a first pixel in an image. The controller is configured to determine a point on the ground corresponding to the first pixel in the image based on external parameters. The controller is further configured to move the vehicle in a virtual world a predetermined distance, identify a second pixel in the image to which the point of the ground corresponds after the vehicle is moved in the virtual world, and calculate the sensitivity of the camera based on the distance between the position of the first pixel and the position of the second pixel. The storage device is configured to store the sensitivity of the camera.

Claims (59)

1. A system for calculating a sensitivity of a camera in a vehicle control system, the system comprising:

an internal parameter system configured to determine an image coordinate of a first pixel in an image;

a controller configured to determine a point on the ground that corresponds to the first pixel in the image based on a positioning system, the controller configured to move a vehicle in a virtual world a predetermined distance or at a predetermined angle without actual movement of the vehicle, identify a second pixel in the image to which the point on the ground corresponds after the vehicle is moved in the virtual world, and calculate the sensitivity of the camera based on a distance between a position of the first pixel in the image and a position of the second pixel in the image, the sensitivity of the camera including a distance sensitivity and an angular sensitivity, the distance sensitivity (Sp) being calculated by a first formula:

Sp=A×d (where A is a first predetermined coefficient and d is the distance between the first and second pixels), and

the angular sensitivity (Sa) being calculated by a second formula:

Sa=B×d (where B is a second predetermined coefficient and d is the distance between first and second pixels); and

a storage device configured to store the sensitivity of the camera, and

the controller configured to update the sensitivity of the camera with an updated sensitivity.

2. The system according to claim 1 , wherein

the internal parameter system is an internal calibration unit.

3. The system according to claim 1 , wherein

the positioning system includes sensors.

4. The system according to claim 1 , wherein

the positioning system includes a global positioning system.

5. The system according to claim 1 , wherein

the first and second pixels are two pixels in an array of pixels, and the controller is configured to calculate the sensitivity of the camera based on a distance between two pixels for each of the pixels in the array of pixels.

6. The system according to claim 5 , wherein the controller is configured to apply a sensitivity of the pixel array in determining a position of the vehicle.

7. The system according to claim 1 , wherein

the controller is configured to calculate the sensitivity of the camera as the sensitivity relates to a position of the vehicle.

8. The system according to claim 1 , wherein

the controller is configured to calculate the sensitivity of the camera as the sensitivity relates to an angle of the vehicle.

9. The system according to claim 1 , wherein

the controller is configured to update the sensitivity of the camera each time the vehicle is started.

10. A system for calculating a sensitivity of a camera in a vehicle control system, the system comprising:

the camera disposed on a vehicle, the camera configured to capture an image of an object external to the vehicle, such that the image can be displayed using at least a first pixel and a second pixel in an array of pixels;

an internal parameter system configured to determine an image coordinate of the first pixel in the image;

a controller configured to determine a point on the ground that corresponds to the first pixel in the image based on a positioning system, move the vehicle in a virtual world a predetermined distance, identify the second pixel in the image to which the point of the ground corresponds after the vehicle is moved in the virtual world the predetermined distance without actual movement of the vehicle, and calculate the sensitivity of the camera based on a distance between the position of the first pixel in the image and the position of the second pixel in the image,

the sensitivity of the camera including a distance sensitivity and an angular sensitivity, the distance sensitivity (Sp) being calculated by a first formula:

Sp=A×d (where A is a first predetermined coefficient and d is the distance between the first and second pixels), and

the angular sensitivity (Sa) being calculated by a second formula:

Sa=B×d (where B is a second predetermined coefficient and d is the distance between first and second pixels); and

a storage device configured to store the sensitivity of the camera, and

the controller configured to update the sensitivity of the camera with an updated sensitivity.

11. The system of claim 10 , wherein

the internal parameter system is an internal calibration unit.

12. The system according to claim 10 , wherein

the positioning system includes sensors.

13. The system according to claim 10 , wherein

the positioning system includes a global positioning system.

14. The system according to claim 10 , wherein

the first and second pixels are two pixels in the array of pixels, and the controller is configured to calculate the sensitivity of the camera based on a distance between two pixels for each of the pixels in the array of pixels.

15. The system according to claim 14 , wherein the controller is configured to apply a sensitivity of the pixel array in determining a position of the vehicle.

16. A method of calculating a sensitivity of a camera in a vehicle control system, the method comprising:

determining, with an internal parameter system, an image coordinate of a first pixel in an image;

determining a point on the ground that corresponds to the first pixel in the image based on a positioning system;

moving a vehicle in a virtual world a predetermined distance without actual movement of the vehicle;

identifying a second pixel in the image to which the point of the ground corresponds after the vehicle is moved in the virtual world;

calculating the sensitivity of the camera based on a distance between a position of the first pixel in the image and a position of the second pixel in the image,

the sensitivity of the camera including a distance sensitivity and an angular sensitivity, the distance sensitivity (Sp) being calculated by a first formula:

Sp=A*d (where A is a first predetermined coefficient and d is the distance between the first and second pixels), and the angular sensitivity (Sa) being calculated by a second formula:

Sa=B*d (where B is a second predetermined coefficient and d is the distance between first and second pixels); and

storing the sensitivity of the camera in a storage device; and

updating the sensitivity of the camera with an updated sensitivity.

17. The method according to claim 16 , wherein

the positioning system includes sensors.

18. The method according to claim 16 , wherein

the positioning system includes a global positioning system.

19. The method according to claim 16 , wherein

the first and second pixels are two pixels in an array of pixels, and calculating the sensitivity of the camera based on a distance between two pixels for each of the pixels in the array of pixels.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2019
From: NISSAN NORTH AMERICA, INC.
To: NISSAN MOTOR CO., LTD.
Reel/Frame 050589/0642 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2019
From: KOJO, NAOKI
To: NISSAN NORTH AMERICA, INC.
Reel/Frame 048278/0485 →
Continuity (1)
Related Publication 20150294465A1 · Oct 15, 2015