IP Library Granted Patent US 10,740,592
Granted Patent B2
US 10,740,592 · App. 16/145,361 · Granted Aug 11, 2020

Three-dimensional object ground-contact determining apparatus

Inventors: Naohide Uchida (Numazu, JP); Fumio Sugaya (Susono, JP); Ken Tanabe (Kariya, JP); Hirotake Ishigami (Okazaki, JP); Masaki Kuwahara (Nukata-gun, JP)
Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA; DENSO CORPORATION
G06K9/00201G06K9/00805G08G1/04H04N13/239G08G1/166H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,740,592
App. No.
16/145,361
Granted
Aug 11, 2020
Kind
B2
Abstract

An apparatus comprises three-dimensional object detecting means for detecting a three-dimensional object in a taken image, temporarily determining means for calculating, based on parallax information, a lower end height from a road surface to a lower end of the object, for temporarily determining that the object is a ground-contacting object when the lower end height is less than or equal to a threshold, and for temporarily determining that the object is a floating object when the lower end height exceeds the threshold, and finally determining means for finally determining whether the object is a ground-contacting object or a floating object. The finally determining means finally determines that the object is a ground-contacting object at the current computation timing when the object is determined to be a ground-contacting object in at least one of the temporary determination at the current computation timing and the final determination at the previous computation timing.

Claims (39)

1. A three-dimensional object ground-contact determining apparatus mounted on a vehicle comprising;

imaging means for taking an image of a region in front of said vehicle by means of a stereo camera;

parallax information calculating means for calculating, based on a taken image taken by said imaging means, parallax information including a parallax of each of pixels composing said taken image;

three-dimensional object detecting means for detecting a three-dimensional object in said taken image based on said parallax information;

temporarily determining means;

for calculating, based on said parallax information, a lower end height which is a height from a road surface to a lower end of said detected three-dimensional object; and

for making a temporary determination every time a predetermined computation interval elapses to temporarily determine that said three-dimensional object is a ground-contacting object which is ground-contacted with said road surface when said lower end height is less than or equal to a predetermined threshold, and to temporarily determine that said three-dimensional object is a floating object floating from said road surface when said lower end height exceeds said predetermined threshold; and

finally determining means for making a final determination every time said predetermined computation interval elapses to finally determine whether said three-dimensional object is a ground-contacting object or a floating object,

wherein,

said finally determining means is configured to;

finally determine that said three-dimensional object is a ground-contacting object at a current computation timing when it is determined that said three-dimensional object is a ground-contacting object in at least one of said temporary determination at a current computation timing and said final determination at a previous computation timing; and

finally determine that said three-dimensional object is a floating object at a current computation timing when it is determined that said three-dimensional object is a floating object in both of said temporary determination at a current computation timing and said final determination at a previous computation timing.

2. The three-dimensional object ground-contact determining apparatus according to claim 1 , wherein,

said finally determining means is configured to change a final determination result of said three-dimensional object from a ground-contacting object to a floating object when a temporary determination result that said three-dimensional object is a floating object continues for a predetermined reset time longer than said computation interval in a case when it is temporarily determined that said three-dimensional object which was finally determined to be a ground-contacting object at a previous computation timing is a floating object at a current computation timing.

3. A three-dimensional object ground-contact determining apparatus mounted on a vehicle comprising;

a stereo camera for taking a stereo image of a region in front of said vehicle;

a processor;

a non-transitory computer-readable storage medium; and

a set of computer-executable instructions stored on said computer-readable storage medium that cause said processor to implement:

calculating, based on said stereo image, parallax information including a parallax of each of pixels composing said stereo image;

detecting a three-dimensional object in said stereo image based on said parallax information;

calculating, based on said parallax information, a lower end height which is a height from a road surface to a lower end of said detected three-dimensional object;

making a temporary determination every time a predetermined computation interval elapses to temporarily determine that said three-dimensional object is a ground-contacting object which is ground-contacted with said road surface when said lower end height is less than or equal to a predetermined threshold, and to temporarily determine that said three-dimensional object is a floating object floating from said road surface when said lower end height exceeds said predetermined threshold; and

making a final determination every time said predetermined computation interval elapses to finally determine whether said three-dimensional object is a ground-contacting object or a floating object,

wherein,

said processor is configured to;

finally determine that said three-dimensional object is a ground-contacting object at a current computation timing when it is determined that said three-dimensional object is a ground-contacting object in at least one of said temporary determination at a current computation timing and said final determination at a previous computation timing; and

finally determine that said three-dimensional object is a floating object at a current computation timing when it is determined that said three-dimensional object is a floating object in both of said temporary determination at a current computation timing and said final determination at a previous computation timing.

4. A non-transitory computer-readable storage medium having computer-executable instructions, said instructions comprising;

acquiring a set of images of a region in front of a vehicle, said set of images being taken by a stereo camera;

calculating, based on said set of images, parallax information including a parallax of each of pixels composing said set of images;

detecting a three-dimensional object in said set of images based on said parallax information;

calculating, based on said parallax information, a lower end height which is a height from a road surface to a lower end of said detected three-dimensional object;

making a temporary determination every time a predetermined computation interval elapses to temporarily determine that said three-dimensional object is a ground-contacting object which is ground-contacted with said road surface when said lower end height is less than or equal to a predetermined threshold, and to temporarily determine that said three-dimensional object is a floating object floating from said road surface when said lower end height exceeds said predetermined threshold; and

making a final determination every time said predetermined computation interval elapses to finally determine whether said three-dimensional object is a ground-contacting object or a floating object,

wherein,

said making a final determination is configured to;

finally determine that said three-dimensional object is a ground-contacting object at a current computation timing when it is determined that said three-dimensional object is a ground-contacting object in at least one of said temporary determination at a current computation timing and said final determination at a previous computation timing; and

finally determine that said three-dimensional object is a floating object at a current computation timing when it is determined that said three-dimensional object is a floating object in both of said temporary determination at a current computation timing and said final determination at a previous computation timing.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2020
From: ISHIGAMI, HIROTAKE; UCHIDA, NAOHIDE; TANABE, KEN; KUWAHARA, MASAKI; SUGAYA, FUMIO
To: TOYOTA JIDOSHA KABUSHIKI KAISHA; DENSO CORPORATION
Reel/Frame 052473/0183 →
Priority Claims (1)
JP 2017-191579 · Sep 29, 2017 · national
Continuity (1)
Related Publication 20190102602A1 · Apr 4, 2019