IP Library Granted Patent US 9,767,367
Granted Patent B2
US 9,767,367 · App. 14/912,885 · Granted Sep 19, 2017

Object estimation apparatus and object estimation method

Inventors: Hirotake Ishigami (Susono, JP); Noriaki Shirai (Kariya, JP); Toshiyuki Matsubara (Gotenba, JP)
Assignees: DENSO CORPORATION; TOYOTA JIDOSHA KABUSHIKI KAISHA
G06K9/00805B60W30/06B60W30/08G06K9/00201G06K9/00335G06K9/6215G06K9/66G06T7/269G06T7/292G06T7/593G06T7/70G08G1/166G06T2200/04G06T2207/30196G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,767,367
App. No.
14/912,885
Granted
Sep 19, 2017
Kind
B2
Abstract

An object estimation apparatus estimates a position and a speed of an object in images based on the images taken by an image taking means from different positions. The object estimation apparatus includes a shift information taking means that takes temporal shift information of a position of a corresponding pixel from frames arranged in time series in a reference image, which is a reference between the images, a parallax information taking means that takes parallax information of each corresponding pixel from the images with reference to the reference image, an estimated value taking means that estimates estimated values of the position and the speed of the object in three-dimensional space by using a filter based on the shift information taken by the shift information taking means and the parallax information taken by the parallax information taking means, a determination means that determines whether or not each of the shift information taken by the shift information taking means and the parallax information taken by the parallax information taking means is an abnormal value, and a correction means that corrects the estimated value taken by the estimated value taking means based on a determination result of the determination means. The correction means corrects the estimated value taken by the estimated value taking means by using different methods between a case where the determination means determines that the shift information taken by the shift information taking means is an abnormal value and a case where the determination means determines that the parallax information taken by the parallax information taking means is an abnormal value.

Claims (32)

1. An object estimation apparatus, which estimates a position and a speed of an object in images based on the images taken by an image taking means from different positions, the object estimation apparatus comprising:

a shift information taking means that takes temporal shift information of a position of a corresponding pixel from frames arranged in time series in a reference image, which is a reference between the images;

a parallax information taking means that takes parallax information of each corresponding pixel from the images with reference to the reference image;

an estimated value taking means that estimates estimated values of the position and the speed of the object in three-dimensional space by using a filter based on the shift information taken by the shift information taking means and the parallax information taken by the parallax information taking means;

a determination means that determines whether or not each of the shift information taken by the shift information taking means and the parallax information taken by the parallax information taking means is an abnormal value; and

a correction means that corrects the estimated value taken by the estimated value taking means based on a determination result of the determination means, wherein

the correction means corrects the estimated value taken by the estimated value taking means by using different methods between a case where the determination means determines that the shift information taken by the shift information taking means is an abnormal value and a case where the determination means determines that the parallax information taken by the parallax information taking means is an abnormal value.

2. The object estimation apparatus according to claim 1 , wherein

when the determination means determines that the shift information taken by the shift information taking means is an abnormal value, the correction means voids the estimated value taken by the estimated value taking means and resets the filter to an initial state.

3. The object estimation apparatus according to claim 1 , wherein

the estimated value taking means takes predicted values of the position and the speed of the object from the estimated value obtained previously, assuming that the object follows a preset process model, and

when the determination means determines that the parallax information taken by the parallax information taking means is an abnormal value, the correction means corrects the estimated value taken by the estimated value taking means to the predicted value taken by the estimated value taking means.

4. The object estimation apparatus according to claim 3 , wherein

the determination means determines whether or not the shift information taken by the shift information taking means is an abnormal value based on a difference between the shift information and predicted shift information, which is calculated from the predicted value taken by the estimated value taking means and corresponds to the shift information.

5. The object estimation apparatus according to claim 3 , wherein

the determination means determines whether or not the parallax information taken by the parallax information taking means is an abnormal value based on a difference between the parallax information and predicted parallax information, which is calculated from the predicted value taken by the estimated value taking means and corresponds to the parallax information.

6. An object estimation method, which estimates a position and a speed of an object in images based on the images taken by an image taking means from different positions, the object estimation method comprising:

a step in which a shift information taking means takes temporal shift information of a position of a corresponding pixel from frames arranged in time series in a reference image, which is a reference between the images;

a step in which a parallax information taking means takes parallax information of each corresponding pixel from the images with reference to the reference image;

a step in which an estimated value taking means estimates estimated values of the position and the speed of the object in three-dimensional space by using a filter based on the shift information taken by the shift information taking means and the parallax information taken by the parallax information taking means:

a step in which a determination means determines whether or not each of the shift information taken by the shift information taking means and the parallax information taken by the parallax information taking means is an abnormal value; and

a step in which a correction means corrects the estimated value taken by the estimated value taking means based on a determination result of the determination means, wherein

the correction means corrects the estimated value taken by the estimated value taking means by using different methods between a case where the determination means determines that the shift information taken by the shift information taking means is an abnormal and a case where the determination means determines that the parallax information taken by the parallax information taking means is an abnormal.

7. The object estimation method according to claim 6 , wherein

when the determination means determines that the shift information taken by the shift information taking means is an abnormal value, the correction means voids the estimated value taken by the estimated value taking means and resets the filter to an initial state.

8. The object estimation method according to claim 6 , wherein

the estimated value taking means takes predicted values of the position and the speed of the object from the estimated value obtained previously, assuming that the object follows a preset process model, and

when the determination means determines that the parallax information taken by the parallax information taking means is an abnormal value, the correction means corrects the estimated value taken by the estimated value taking means to the predicted value taken by the estimated value taking means.

9. The object estimation method according to claim 8 , wherein

the determination means determines whether or not the shift information taken by the shift information taking means is an abnormal value based on a difference between the shift information and predicted shift information, which is calculated from the predicted value taken by the estimated value taking means and corresponds to the shift information.

10. The object estimation method according to claim 8 , wherein

the determination means determines whether or not the parallax information taken by the parallax information taking means is an abnormal value based on a difference between the parallax information and predicted parallax information, which is calculated from the predicted value taken by the estimated value taking means and corresponds to the parallax information.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE SECOND ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 037989 FRAME: 0995. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 6, 2017
From: ISHIGAMI, HIROTAKE; SHIRAI, NORIAKI; MATSUBARA, TOSHIYUKI
To: DENSO CORPORATION; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 044708/0094 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2016
From: ISHIGAMI, HIROTAKE; SHIRAI, NORIAKI; MATSUBARA, TOSHIYUKI
To: DENSO CORPORATION; TOYOTA JIDOSHA KABUSHIKI KAISHI
Reel/Frame 037989/0995 →
Priority Claims (1)
JP 2013-171774 · Aug 21, 2013 · national
Continuity (1)
Related Publication 20160203376A1 · Jul 14, 2016