IP Library Granted Patent US 12,415,514
Granted Patent B2
US 12,415,514 · App. 17/961,580 · Granted Sep 16, 2025

Vehicle control device, vehicle control method, and storage medium for determining the lane to which an object in the vicinity of a vehicle belongs

Inventors: Naoto Hiramatsu (Wako, JP); Yoshimitsu Murahashi (Wako, JP)
Assignee: HONDA MOTOR CO., LTD.
B60W30/12G06T7/13G06T7/70G06V20/58G06V20/588B60W2420/403B60W2552/53B60W2710/20B60W2720/10G06T2207/30256G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,415,514
App. No.
17/961,580
Granted
Sep 16, 2025
Kind
B2
Abstract

A vehicle control device according to an embodiment includes an imager configured to image surroundings of a host vehicle, a recognizer configured to recognize a surroundings situation of the host vehicle, a driving controller configured to control one or both of speed and steering of the host vehicle, and a controller configured to control the driving controller, wherein the controller determines a lane to which the object belongs, based on a positional relationship between left and right demarcation lines defining a host lane in which the host vehicle travels and left and right edges of an object present around the host vehicle, which are present on a two-dimensional image captured by the imager, and determines the lane to which the object belongs, based on the positional relationship between the recognized demarcation line and the edge of the object when one of the left and right demarcation lines is not recognized.

Claims (26)

1. A vehicle control device comprising:

a processor that executes instructions to:

recognize a surroundings situation of a host vehicle using an image captured by a first imager among a plurality of imagers that capture images of an area surrounding the host vehicle;

control one or both of speed and steering of the host vehicle based on the images of the area surrounding the host vehicle; and

control a driving control based on image content captured by the first imager and a second imager of the plurality of imagers, wherein the second imager is different from the first imager,

wherein the processor determines a lane to which an object belongs, based on a positional relationship between left and right demarcation lines defining a host lane in which the host vehicle travels and left and right edges of the object present around the host vehicle, which are present on a two-dimensional image of the image captured by the second imager, and determines the lane to which the object belongs, based on the positional relationship between the left and right demarcation lines and the left and right edges of the object when one of the left and right demarcation lines is not recognized,

wherein the processor corrects a position of the object using the image captured by the first imager based on information on a lane to which the object belongs based on the two-dimensional image captured by the second imager, and

controls the driving control based on the position of the object.

2. The vehicle control device according to claim 1 , wherein, when one of the left and right demarcation lines is not recognized in the two-dimensional image and edges of the object are present on the left and right sides of the demarcation line, the processor determines that the object belongs to at least the host lane.

3. The vehicle control device according to claim 1 , wherein, when one of the left and right demarcation lines is not recognized in the two-dimensional image and the left and right edges of the object are present on either the left or the right side with respect to the demarcation line, the processor determines that the object does not belong to a lane on the side in which the edge is not present with respect to the demarcation line.

4. The vehicle control device according to claim 1 , wherein, when one of the left and right demarcation lines is not recognized and a part of an other demarcation line is recognized, the processor determines the lane to which the object belongs, based on a positional relationship between either the left edge or right edge of the object and a part of the other demarcation line present in a lateral direction of the edge on the two-dimensional image.

5. The vehicle control device according to claim 1 , wherein, when both of the left and right demarcation lines are partially recognized, the processor determines the lane to which the object belongs, based on a positional relationship between each of the left and right edges of the object and a partially recognized left and right demarcation lines present in a lateral direction of the edge on the two-dimensional image.

6. A vehicle control method causing a computer to perform acts, comprising:

recognizing, by the computer, a surroundings situation of a host vehicle using an image captured by a first imager among a plurality of imagers that capture images of an area surrounding the host vehicle;

executing, by the computer, driving control to control one or both of speed and steering of the host vehicle based on the images of the area surrounding the host vehicle;

controlling, by the computer, driving control based on imaging content captured by the first imager and a second imager of the plurality of imagers, wherein the second imager is different from the first imager; and

determining, by the computer, a lane to which an object belongs, based on a positional relationship between left and right demarcation lines defining a host lane in which the host vehicle travels and left and right edges of the object present around the host vehicle, which are present on a two-dimensional image of the image captured by the second imager, and determining the lane to which the object belongs, based on the positional relationship between the left and right demarcation lines and the left and right edges of the object when one of the left and right demarcation lines is not recognized,

correcting, by the computer, a position of the object using the image captured by the first imager based on information on a lane to which the object belongs based on the two-dimensional image captured by the second imager, and

controlling, by the computer, the driving control based on the position of the object.

7. A computer-readable non-transitory storage medium having a program stored therein, the program causing a computer to:

recognize a surroundings situation of a host vehicle using an image captured by a first imager among a plurality of imagers that capture images of an area surrounding the host vehicle;

execute driving control to control one or both of speed and steering of the host vehicle based on the images of the area surrounding the host vehicle;

control a driving control based on image content captured by the first imager and a second imager of the plurality of imagers, wherein the second imager is different from the first imager; and

determine a lane to which an object belongs, based on a positional relationship between left and right demarcation lines defining a host lane in which the host vehicle travels and left and right edges of the object present around the host vehicle, which are present on a two-dimensional image of the image captured by the second imager, and determine the lane to which the object belongs, based on the positional relationship between the left and right demarcation lines and the left and right edges of the object when one of the left and right demarcation lines is not recognized,

correct a position of the object using the image captured by the first imager based on information on a lane to which the object belongs based on the two-dimensional image captured by the second imager, and

control the driving control based on the position of the object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2022
From: HIRAMATSU, NAOTO; MURAHASHI, YOSHIMITSU
To: HONDA MOTOR CO., LTD.
Reel/Frame 061527/0405 →
Priority Claims (1)
JP 2021-167279 · Oct 12, 2021 · national
Continuity (1)
Related Publication 20230114781A1 · Apr 13, 2023
References Cited (14)
US 6590521B1 · Saka · 2003 [cited by examiner]
US 20180151066A1 · Oba · 2018 [cited by examiner]
US 20190251845A1 · Kosaka et al. · 2019 [cited by applicant]
US 20200193174A1 · Machii et al. · 2020 [cited by applicant]
JP 11153406 · 1999 [cited by applicant]
JP 2002029348A · 2002 [cited by examiner]
JP 200308599 · 2003 [cited by applicant]
JP 2003308599 · 2003 [cited by applicant]
JP 2018067062 · 2018 [cited by applicant]
WO 2018109999 · 2018 [cited by applicant]
Merged Foreign Patent and PE2E English Translation of JP H11153406 A (Year: 1999). [cited by examiner]
PE2E English Translation of JP H11153406 A with Numbered Paragraphs of Description (Year: 1999). [cited by examiner]
Espacenet English Translation of JP2002029348A Description (Year: 2002). [cited by examiner]
Japanese Office Action for Japanese Patent Application No. 2021-067279 mailed May 30, 2023. [cited by applicant]