IP Library Granted Patent US 12,254,701
Granted Patent B2
US 12,254,701 · App. 17/658,222 · Granted Mar 18, 2025

Vehicle periphery monitoring device and vehicle periphery monitoring method

Inventors: Yousuke Miyamoto (Kariya, JP); Akihiro Kida (Toyota, JP); Motonari Ohbayashi (Nagakute, JP)
Assignees: DENSO CORPORATION; TOYOTA JIDOSHA KABUSHIKI KAISHA
G06V20/58G06T7/70B60Q9/00G06T2207/30248
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,701
App. No.
17/658,222
Granted
Mar 18, 2025
Kind
B2
Abstract

A vehicle periphery monitoring device is configured to: specify positions of detection points of an obstacle with respect to a vehicle based on detection results of multiple periphery monitoring sensors equipped to the vehicle; update the positions of the detected detection points corresponding to a position change of the vehicle; storing the updated positions of the detection points in a memory that maintains stored information during a parked state of the vehicle; and estimate, at a start time of the vehicle from the parked state, a position of a detection point, which is located in a blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, using the positions of the detection points stored in the memory.

Claims (74)

1. A vehicle periphery monitoring device applied to a vehicle, the vehicle being equipped with multiple periphery monitoring sensors and a blind spot existing between two adjacent detection ranges of the multiple periphery monitoring sensors, the vehicle periphery monitoring device comprising:

a detection point position specifying unit that specifies positions of detection points of an obstacle with respect to the vehicle based on detection results of the multiple periphery monitoring sensors;

a position update unit that updates the positions of the detection points, which are successively detected by the detection point position specifying unit, corresponding to a position change of the vehicle;

a storing processing unit that stores the positions of the detection points, which are updated by the position update unit, in a memory that maintains stored information during a parked state of the vehicle;

a position estimation unit that estimates, at a start time of the vehicle from the parked state, a position of a detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, using the positions of the detection points stored in the memory by the storing processing unit; and

a grouping processing unit that classifies the positions of the detection points corresponding to a same obstacle in one position group,

wherein,

in a case where the positions of the detection points, which are classified by the grouping processing unit in one group and stored in the memory by the storing processing unit, are determined to be included in respective detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle,

the position estimation unit:

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by the multiple periphery monitoring sensors, estimates the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit; and

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by only one of the multiple periphery monitoring sensors, does not estimate the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit, and

in a case where the positions of the detection points of the obstacle stored in the storing processing unit is included in a travelling area of the vehicle, an alert device issues an alert to avoid the obstacle in response to a time to collision of the obstacle is less than a predetermined threshold or a distance to the obstacle is less than a predetermined distance.

2. A vehicle periphery monitoring device applied to a vehicle, the vehicle being equipped with multiple periphery monitoring sensors and a blind spot existing between two adjacent detection ranges of the multiple periphery monitoring sensors, the vehicle periphery monitoring device comprising:

a detection point position specifying unit that specifies positions of detection points of an obstacle with respect to the vehicle based on detection results of the multiple periphery monitoring sensors;

a position update unit that updates the positions of the detection points, which are successively detected by the detection point position specifying unit, corresponding to a position change of the vehicle;

a storing processing unit that stores the positions of the detection points, which are updated by the position update unit, in a memory that maintains stored information during a parked state of the vehicle;

a position estimation unit that estimates, at a start time of the vehicle from the parked state, a position of a detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, using the positions of the detection points stored in the memory by the storing processing unit; and

a grouping processing unit that classifies the positions of the detection points corresponding to a same obstacle in one position group,

wherein

in a case where the positions of the detection points, which are classified by the grouping processing unit in one group and stored in the memory by the storing processing unit, are determined to be included in a detection range of only one of the multiple periphery monitoring sensors at the start time of the vehicle,

the position estimation unit:

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by the only one of the multiple periphery monitoring sensors, estimates the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit; and

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being not actually detected at the start time of the vehicle by the only one of the multiple periphery monitoring sensors, does not estimate the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit, and

in a case where the positions of the detection points of the obstacle stored in the storing processing unit is included in a travelling area of the vehicle, an alert device issues an alert to avoid the obstacle in response to a time to collision of the obstacle is less than a predetermined threshold or a distance to the obstacle is less than a predetermined distance.

3. A vehicle periphery monitoring device applied to a vehicle, the vehicle being equipped with multiple periphery monitoring sensors and a blind spot existing between two adjacent detection ranges of the multiple periphery monitoring sensors, the vehicle periphery monitoring device comprising:

a detection point position specifying unit that specifies positions of detection points of an obstacle with respect to the vehicle based on detection results of the multiple periphery monitoring sensors;

a position update unit that updates the positions of the detection points, which are successively detected by the detection point position specifying unit, corresponding to a position change of the vehicle;

a storing processing unit that stores the positions of the detection points, which are updated by the position update unit, in a memory that maintains stored information during a parked state of the vehicle;

a position estimation unit that estimates, at a start time of the vehicle from the parked state, a position of a detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, using the positions of the detection points stored in the memory by the storing processing unit; and

a grouping processing unit that classifies the positions of the detection points corresponding to a same obstacle in one position group,

wherein

in a case where the positions of the detection points, which are classified by the grouping processing unit in one group and stored in the memory by the storing processing unit, are determined to be included in respective detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle,

the position estimation unit:

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by one of the multiple periphery monitoring sensors, estimates the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit; and

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being not actually detected at the start time of the vehicle by neither one of the multiple periphery monitoring sensors, does not estimate the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit, and

in a case where the positions of the detection points of the obstacle stored in the storing processing unit is included in a travelling area of the vehicle, an alert device issues an alert to avoid the obstacle in response to a time to collision of the obstacle is less than a predetermined threshold or a distance to the obstacle is less than a predetermined distance.

4. The vehicle periphery monitoring device according to claim 1 , wherein

in a case where the positions of the detection points, which are stored in the memory by the storing processing unit, are determined to be not included in either one of the detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle, the position estimation unit estimates the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit.

5. A vehicle periphery monitoring device applied to a vehicle, the vehicle being equipped with multiple periphery monitoring sensors and a blind spot existing between two adjacent detection ranges of the multiple periphery monitoring sensors, the vehicle periphery monitoring device comprising:

a detection point position specifying unit that specifies positions of detection points of an obstacle with respect to the vehicle based on detection results of the multiple periphery monitoring sensors;

a position update unit that updates the positions of the detection points, which are successively detected by the detection point position specifying unit, corresponding to a position change of the vehicle;

a storing processing unit that stores the positions of the detection points, which are updated by the position update unit, in a memory that maintains stored information during a parked state of the vehicle; and

a position estimation unit that estimates, at a start time of the vehicle from the parked state, a position of a detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, using the positions of the detection points stored in the memory by the storing processing unit, wherein

in a case where the positions of the detection points, which are stored in the memory by the storing processing unit, are determined to be not included in either one of the detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle, the position estimation unit estimates the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit,

in a case where the positions of the detection points, which are stored in the memory by the storing processing unit, are determined to be not included in either one of the detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle and a distance from the vehicle to the detection points at the start time of the vehicle is shorter than a predetermined distance, the position estimation unit estimates the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit,

in a case where the positions of the detection points, which are stored in the memory by the storing processing unit, are determined to be not included in either one of the detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle and a distance from the vehicle to the detection points at the start time of the vehicle is equal to or longer than the predetermined distance, the position estimation unit does not estimate the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, with the position stored in the memory by the storing processing unit, and

in a case where the positions of the detection points of the obstacle stored in the storing processing unit is included in a travelling area of the vehicle, an alert device issues an alert to avoid the obstacle in response to a time to collision of the obstacle is less than a predetermined threshold or a distance to the obstacle is less than a predetermined distance.

6. A vehicle periphery monitoring method applied to a vehicle, the vehicle being equipped with multiple periphery monitoring sensors and a blind spot existing between two adjacent detection ranges of the multiple periphery monitoring sensors, the vehicle periphery monitoring method comprising:

specifying positions of detection points of an obstacle with respect to the vehicle based on detection results of the multiple periphery monitoring sensors;

updating the positions of the detections points, which are successively detected, corresponding to a position change of the vehicle;

storing the updated positions of the detection points in a memory that maintains stored information during a parked state of the vehicle; and

estimating, at a start time of the vehicle from the parked state, a position of a detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, using the positions of the detection points stored in the memory;

classifying the positions of the detection points corresponding to a same obstacle in one position group,

wherein,

in a case where the positions of the detection points, which are classified in one group and stored in the memory, are determined to be included in respective detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle,

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by the multiple periphery monitoring sensors, the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, is estimated with the position stored in the memory; and

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by only one of the multiple periphery monitoring sensors, does not estimate the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, is not estimated with the position stored in the memory, and

in a case where the positions of the detection points of the obstacle stored in the memory is included in a travelling area of the vehicle, an alert device issues an alert to avoid the obstacle in response to a time to collision of the obstacle is less than a predetermined threshold or a distance to the obstacle is less than a predetermined distance.

7. A vehicle periphery monitoring device applied to a vehicle, the vehicle being equipped with multiple periphery monitoring sensors and a blind spot existing between two adjacent detection ranges of the multiple periphery monitoring sensors, the vehicle periphery monitoring device comprising:

a computer-readable non-transitory storage medium; and

a microcomputer, by executing a program stored in the computer-readable non-transitory storage, configured to:

specify positions of detection points of an obstacle with respect to the vehicle based on detection results of the multiple periphery monitoring sensors;

update the positions of the detections points, which are successively detected, corresponding to a position change of the vehicle;

store the updated positions of the detection points in a memory that maintains stored information during a parked state of the vehicle; and

estimate, at a start time of the vehicle from the parked state, a position of a detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, using the positions of the detection points stored in the memory; and

classifying the positions of the detection points corresponding to a same obstacle in one position group,

wherein,

in a case where the positions of the detection points, which are classified in one group and stored in the memory, are determined to be included in respective detection ranges of the multiple periphery monitoring sensors at the start time of the vehicle,

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by the multiple periphery monitoring sensors, the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, is estimated with the position stored in the memory; and

in response to the detection points, which are determined to be the same as the corresponding detection points included in the position group, being actually detected at the start time of the vehicle by only one of the multiple periphery monitoring sensors, does not estimate the position of the detection point, which is located in the blind spot and is not detected by all of the multiple periphery monitoring sensors at the start time of the vehicle, is not estimated with the position stored in the memory, and

in a case where the positions of the detection points of the obstacle stored in the memory is included in a travelling area of the vehicle, an alert device issues an alert to avoid the obstacle in response to a time to collision of the obstacle is less than a predetermined threshold or a distance to the obstacle is less than a predetermined distance.

8. The vehicle periphery monitoring device according to claim 1 , wherein

the alert device issues comprises a vibrator configured to vibrate a portion of the vehicle that contacts the driver, and

in the case where the positions of the detection points of the obstacle stored in the memory is included in the travelling area of the vehicle, the alert device vibrates the portion of the vehicle that contacts the driver to notify the driver in a tactile manner.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2022
From: MIYAMOTO, YOUSUKE; KIDA, AKIHIRO; OHBAYASHI, MOTONARI
To: DENSO CORPORATION; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 059522/0128 →
Priority Claims (1)
JP 2019-188086 · Oct 11, 2019 · national
Continuity (2)
Continuation PCTJP2020031837 · Aug 24, 2020
Related Publication 20220230446A1 · Jul 21, 2022
References Cited (15)
US 20100034426A1 · Takiguchi · 2010 [cited by examiner]
US 20130010074A1 · Takiguchi et al. · 2013 [cited by applicant]
US 20130011013A1 · Takiguchi et al. · 2013 [cited by applicant]
US 20130162826A1 · Zhang · 2013 [cited by examiner]
US 20130223686A1 · Shimizu · 2013 [cited by examiner]
US 20160203377A1 · Irie et al. · 2016 [cited by applicant]
US 20180089538A1 · Graham · 2018 [cited by examiner]
US 20180370566A1 · Kojo et al. · 2018 [cited by applicant]
US 20210323538A1 · Takahashi · 2021 [cited by examiner]
JP 2011150633A · 2011 [cited by applicant]
JP 2015229400A · 2015 [cited by applicant]
JP 201812451A · 2018 [cited by applicant]
JP 2018012451A · 2018 [cited by examiner]
JP 201989476A · 2019 [cited by applicant]
JP 2019089476A · 2019 [cited by examiner]
Cited By (4)
US 12,377,814 US 12,505,744 US 12,589,804 US 12,668,182