IP Library › Granted Patent US 12,731,274
Granted Patent B2
US 12,731,274 · App. 18/712,361 · Granted Sep 8, 2026

External environment recognition device

Inventors: Hideaki Kido (Tokyo, JP); Hirotomo Sai (Hitachinaka, JP)
Assignee: HITACHI ASTEMO, LTD.
G06T7/50G06T7/11G06V20/588G06T2207/30256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,731,274
App. No.
18/712,361
Granted
Sep 8, 2026
Kind
B2
Abstract

An external environment recognition device includes: a road surface height estimation unit that estimates a height of a road surface on which an object is positioned in an image captured by a monocular camera installed in a vehicle; a road surface height reliability estimation unit that calculates reliability of a height of the road surface estimated by the road surface height estimation unit; and an object distance information estimation unit that estimates a distance to the object in accordance with the reliability calculated by the road surface height reliability estimation unit, in which the road surface height reliability estimation unit calculates the reliability based on a determination result as to whether the road surface is same as a grounding contact surface of the vehicle.

Claims (13)

1 . An external environment recognition device, comprising:

a road surface height estimation unit that estimates a height of a road surface on which an object is positioned in an image captured by a monocular camera installed in a vehicle;

a road surface height reliability estimation unit that calculates reliability of a height of the road surface estimated by the road surface height estimation unit; and

an object distance information estimation unit that estimates a distance to the object in accordance with the reliability calculated by the road surface height reliability estimation unit, wherein the road surface height reliability estimation unit calculates the reliability based on a determination result as to whether the road surface is same as a grounding contact surface of the vehicle.

2 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit enhances reliability of a height of the road surface when the road surface is same as a grounding contact surface of the vehicle.

3 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit divides the captured image into a road region attribute and a non-road region attribute, and enhances reliability of a height of the road surface when an attribute of the road surface on which the object is positioned is the road region attribute.

4 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit determines whether there is a road surface marking on the road surface on which the object of the captured image is positioned, and enhances reliability of a height of the road surface when there is the road surface marking.

5 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit collates whether the captured image includes the captured image of a traveling road surface on which the vehicle has traveled in past, and when the captured image in past is included, calculates reliability of a height of the road surface with reference to the captured image in the past.

6 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit determines whether another object is present on a traveling road surface of the vehicle in the captured image, and when another object is present, calculates reliability of a height of the road surface to be high.

7 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit determines a type of measurement in which a height of the road surface is obtained by the road surface height estimation unit, and calculates reliability of a height of the road surface in accordance with the type of the measurement.

8 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit determines whether a grounding contact point between the vehicle and a traveling road surface is included in the captured image, divides the captured image into a road region attribute and a non-road region attribute, determines an attribute of the road surface on which the object is positioned, determines whether there is a road surface marking on the road surface on which the object is positioned in the captured image, and calculates the reliability based on at least one determination result of these determinations.

9 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit determines whether the captured image includes the captured image of a traveling road surface on which the vehicle has traveled in past, determines whether another object is present on the traveling road surface of the vehicle in the captured image, and calculates the reliability based on at least one determination result of these determinations.

10 . The external environment recognition device according to claim 1 , wherein the road surface height reliability estimation unit determines a type of measurement in which a height of the road surface is obtained by the road surface height estimation unit, and in a case where accuracy of the measurement is high, uses a height of the road surface based on a captured image of a measurement device with high accuracy of the measurement as a height of the road surface based on an image captured by the monocular camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2024
From: KIDO, HIDEAKI; SAI, HIROTOMO
To: HITACHI ASTEMO, LTD.
Reel/Frame 067490/0609 →
Priority Claims (1)
JP 2021-192396 · Nov 26, 2021 · national
Continuity (1)
Related Publication 20250005775A1 · Jan 2, 2025
References Cited (35)
US 10692379B2 · Aoki · 2020 [cited by examiner]
US 11024051B2 · Gomezcaballero · 2021 [cited by examiner]
US 20050110620A1 · Takeichi · 2005 [cited by examiner]
US 20080219505A1 · Morimitsu · 2008 [cited by examiner]
US 20140142837A1 · Takaki · 2014 [cited by examiner]
US 20150088378A1 · Sugai · 2015 [cited by examiner]
US 20150165972A1 · Takemae · 2015 [cited by examiner]
US 20170220877A1 · Kakegawa · 2017 [cited by examiner]
US 20180189599A1 · Sano · 2018 [cited by examiner]
US 20180225526A1 · Nanri · 2018 [cited by examiner]
US 20180281757A1 · Matsuo · 2018 [cited by examiner]
US 20190026572A1 · Theodosis · 2019 [cited by examiner]
US 20190266745A1 · Gomezcaballero · 2019 [cited by examiner]
US 20200302192A1 · Ogata et al. · 2020 [cited by applicant]
US 20200349366A1 · Takemura · 2020 [cited by examiner]
US 20210335000A1 · Kanetake · 2021 [cited by examiner]
US 20210350150A1 · An · 2021 [cited by examiner]
US 20220366700A1 · Endo · 2022 [cited by examiner]
US 20230070221A1 · Shigemura · 2023 [cited by examiner]
US 20230130001A1 · Kim · 2023 [cited by examiner]
US 20240046409A1 · An · 2024 [cited by examiner]
US 20240412537A1 · Ninomiya · 2024 [cited by examiner]
US 20240428556A1 · Lee · 2024 [cited by examiner]
US 20250005775A1 · Kido · 2025 [cited by examiner]
US 20250029401A1 · Gomezcaballero · 2025 [cited by examiner]
US 20250368480A1 · Saito · 2025 [cited by examiner]
EP 3246877A1 · 2017 [cited by applicant]
JP 2013109455A · 2013 [cited by applicant]
JP 2017096777A · 2017 [cited by applicant]
JP 2017207881A · 2017 [cited by applicant]
JP 2019066333A · 2019 [cited by applicant]
JP 2021043141A · 2021 [cited by applicant]
International Search Report with English Translation in corresponding International Application No. PCT/JP2022/031944, dated Nov. 8, 2022. [cited by applicant]
Japanese Office Action issued in corresponding JP Application No. 2021-192396 dated Nov. 18, 2025 with English translation (12 Pages). [cited by applicant]
Extended European Search Report issued in corresponding EP Patent Application No. 22898188.2, dated May 23, 2025 (9 pages). [cited by applicant]