IP Library › Granted Patent US 10,902,632
Granted Patent B2
US 10,902,632 · App. 16/587,382 · Granted Jan 26, 2021

Position detection apparatus and position detection method

Inventor: Masataka Ishizaki (Kariya, JP)
Assignee: KABUSHIKI KAISHA TOYOTA JIDOSHOKKI
G06T7/73H04N13/204B60Q9/008B60R11/04B60R2300/107B60R2300/8066B60Y2200/15G06T2207/10012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,902,632
App. No.
16/587,382
Granted
Jan 26, 2021
Kind
B2
Abstract

A parallax image in which a parallax is associated with each pixel is acquired from an image captured by a stereo camera. The parallax is voted to a two-dimensional matrix. A line is extracted from a coordinate system in which an X-axis indicates the parallax and a Y-axis indicates the pixel in the vertical direction. In the case where a first line and a second line are detected, an X-coordinate of the start point coordinates of the second line is larger than an X-coordinate of end point coordinates of the first line, and the difference between the slope of the first line and the slope of the second line falls within a permissible range, a determination section determines that a low position is present at a position farther from the movable body than a position in real space corresponding to a Y-coordinate of start point coordinates.

Claims (33)

1. A position detection apparatus that is mounted on a movable body and is configured to detect a low position that is a position lower than a road surface on which the movable body is present, the position detection apparatus comprising:

a stereo camera;

a parallax image acquisition section configured to acquire a parallax image in which a parallax is associated with each pixel from an image captured by the stereo camera;

a voting section configured to vote the parallax associated with each pixel in the parallax image to a two-dimensional matrix of the parallax and a pixel in a vertical direction in the parallax image;

a line extraction section configured to extract a line from a coordinate system in which the parallax having the number of votes by the voting section that is greater than or equal to a threshold value is plotted, and in which an X-axis indicates the parallax and a Y-axis indicates the pixel in the vertical direction; and

a determination section configured such that, in a case where

a first line and a second line are detected by the line extraction section,

an X-coordinate of the start point coordinates of the second line is greater than an X-coordinate of end point coordinates of the first line, and

a difference between a slope of the first line and a slope of the second line falls within a permissible range,

the determination section determines that the low position is present at a position farther from the movable body than a position in real space that corresponds to a Y-coordinate of start point coordinates of the second line.

2. The position detection apparatus according to claim 1 ,

wherein the determination section is configured to determine that the low position is a flat surface formed due to a step in a case where

(i) an intercept of the first line and an intercept of the second line are different from each other, and

(ii) a difference between the X-coordinate of the end point coordinates of the first line and the X-coordinate of the start point coordinates of the second line is greater than or equal to a predetermined value.

3. The position detection apparatus according to claim 1 ,

wherein the determination section is configured to determine that the low position is a ditch that is recessed from the road surface in a case where:

(vi) a difference between an intercept of the first line and an intercept of the second line falls within a permissible range,

(vii) a third line, which extends from the end point coordinates of the first line and in which an X-coordinate decreases as a Y-coordinate increases is present, and

(viii) a difference between an X-coordinate of end point coordinates of the third line and the X-coordinate of the start point coordinates of the second line is greater than or equal to a predetermined value.

4. A position detection method executed by a position detection apparatus mounted on a movable body, the position detection method comprising:

capturing an image with a stereo camera;

acquiring a parallax image in which a parallax is associated with each pixel from the image captured by the stereo camera;

voting the parallax associated with each pixel in the parallax image to a two-dimensional matrix of the parallax and a pixel in a vertical direction in the parallax image;

extracting a line from a coordinate system in which the parallax having the number of votes obtained by voting the parallax that is greater than or equal to a threshold value is plotted, and in which an X-axis indicates the parallax and a Y-axis indicates the pixel in the vertical direction;

detecting a first line and a second line by extracting the line, an X-coordinate of start point coordinates of the second line being greater than an X-coordinate of end point coordinates of the first line, a difference between a slope of the first line and a slope of the second line falling within a permissible range; and

determining, in a case where the first line and the second line are detected, that a low position that is a position lower than a road surface on which the movable body is present is present at a position farther from the movable body than a position in real space corresponding to a Y-coordinate of the start point coordinates of the second line.

5. A non-transitory computer-readable storage medium storing a program for causing a processor mounted on a movable body to execute a position detection process, the position detection process comprising:

capturing an image with a stereo camera;

acquiring a parallax image in which a parallax is associated with each pixel from the image captured by the stereo camera;

voting the parallax associated with each pixel in the parallax image to a two-dimensional matrix of the parallax and a pixel in a vertical direction in the parallax image;

extracting a line from a coordinate system in which the parallax having the number of votes obtained by voting the parallax that is greater than or equal to a threshold value is plotted, and in which an X-axis indicates the parallax and a Y-axis indicates the pixel in the vertical direction;

detecting a first line and a second line by extracting the line, an X-coordinate of start point coordinates of the second line being greater than an X-coordinate of end point coordinates of the first line, a difference between a slope of the first line and a slope of the second line falling within a permissible range; and

determining, in a case where the first line and the second line are detected, that a low position that is a position lower than a road surface on which the movable body is present is present at a position farther from the movable body than a position in real space corresponding to a Y-coordinate of the start point coordinates of the second line.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2020
From: ISHIZAKI, MASATAKA
To: KABUSHIKI KAISHA TOYOTA JIDOSHOKKI
Reel/Frame 051580/0785 →
Priority Claims (1)
JP 2018-188291 · Oct 3, 2018 · national
Continuity (1)
Related Publication 20200111229A1 · Apr 9, 2020