IP Library › Granted Patent US 12,296,862
Granted Patent B2
US 12,296,862 · App. 18/112,528 · Granted May 13, 2025

Vehicle control device, vehicle control method, and storage medium

Inventors: Sho Tamura (Wako, JP); Yoshihiro Mori (Wako, JP); Takao Tamura (Wako, JP); Daichi Inoue (Wako, JP)
Assignee: HONDA MOTOR CO., LTD.
B60W60/0053B60W10/06B60W10/08B60W10/18B60W10/20B60W30/12B60W30/16B60W30/165B60W50/0205B60W60/0051B60W60/0059B60W30/143B60W2420/403B60W2552/53
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,296,862
App. No.
18/112,528
Granted
May 13, 2025
Kind
B2
Abstract

A vehicle control device acquires a camera image obtained by capturing an image of surrounding circumstances of a vehicle, controls steering and acceleration/deceleration of the vehicle without depending on an operation of a driver of the vehicle on the basis of the camera image and map information, determines any of a plurality of driving modes including a first driving mode and a second driving mode as a driving mode of the vehicle, judges whether or not a preceding vehicle is present in front of the vehicle when it is judged that an abnormality has occurred, calculates, when it is judged that the preceding vehicle is present, a margin for the vehicle to continue traveling in the second driving mode, and causes the vehicle to continue traveling in the second driving mode for a period of time indicated based on the margin.

Claims (54)

1. A vehicle control device comprising:

a storage medium which stores a command able to be read by a computer; and

at least one processor which is connected to the storage medium,

wherein at least the one processor, by executing the command able to be read by the computer,

acquires a camera image obtained by capturing an image of surrounding circumstances of a vehicle;

controls steering and acceleration/deceleration of the vehicle without depending on an operation of a driver of the vehicle on the basis of the camera image and pre-stored map information relating to boundaries of lanes;

determines any of a plurality of driving modes including a first driving mode and a second driving mode as a driving mode of the vehicle, and changes the driving mode of the vehicle to a driving mode imposing heavier tasks when tasks related to the determined driving mode are not being executed by the driver, the second driving mode being a driving mode in which tasks imposed on the driver are lighter than in the first driving mode, some of the plurality of driving modes including at least the second driving mode being performed by controlling steering and acceleration/deceleration of the vehicle without depending on an operation of the driver of the vehicle;

judges whether or not an abnormality has occurred in road demarcation lines indicated in the camera image or road demarcation lines indicated in the map information, and judges whether or not a preceding vehicle is present in front of the vehicle when it is judged that the abnormality has occurred;

calculates, when it is judged that the preceding vehicle is present, a margin for the vehicle to continue traveling in the second driving mode on the basis of a distance from the vehicle to the preceding vehicle, a distance from the preceding vehicle to where the preceding vehicle intersects a road demarcation line indicated in the camera image or a road demarcation line indicated in the map information, and a speed of the vehicle; and

causes the vehicle to continue traveling in the second driving mode for a period of time indicated based on the margin,

wherein the at least one processor calculates the margin by adding the distance from the vehicle to the preceding vehicle and the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line, and dividing the distance from the vehicle to the preceding vehicle and the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line by the speed of the vehicle.

2. The vehicle control device according to claim 1 ,

wherein when it is judged as the abnormality that a discrepancy is present on both sides of the road demarcation lines indicated in the camera image and the road demarcation lines indicated in the map information, at least the one processor causes traveling in the second driving mode to continue for the period of time indicated based on the margin and changes the second driving mode to the first driving mode after the period of time has elapsed using the road demarcation lines indicated in the camera image as reference lines.

3. The vehicle control device according to claim 1 ,

wherein when it is judged as the abnormality that a discrepancy is present on both sides of the road demarcation lines indicated in the camera image and the road demarcation lines indicated in the map information, at least the one processor judges whether or not a state in which the road demarcation lines on both sides indicated in the camera image are discrepant from the road demarcation lines on both sides indicated in the map information at the same angle and a curvature change rate equal to or larger than a threshold continues for a predetermined period of time,

wherein when it is judged that the state continues for the predetermined period of time, it is judged that there is misrecognition in the road demarcation lines indicated in the camera image, and

wherein when it is judged that there is misrecognition in the road demarcation lines indicated in the camera image, the second driving mode is changed to the first driving mode using the road demarcation lines indicated in the map information.

4. The vehicle control device according to claim 1 ,

wherein when it is judged as the abnormality that a discrepancy is present on only one of the road demarcation lines indicated in the camera image and the road demarcation lines indicated in the map information, at least the one processor causes traveling in the second driving mode to continue using the road demarcation line in which the discrepancy has not occurred as a reference line.

5. The vehicle control device according to claim 1 ,

wherein when it is judged as the abnormality that both sides of the road demarcation lines indicated in the camera image have disappeared, at least the one processor causes traveling in the second driving mode to continue for the period of time indicated based on the margin and changes the second driving mode to manual driving in stages via the first driving mode after the period of time has elapsed using the road demarcation lines indicated in the map information as reference lines.

6. The vehicle control device according to claim 1 ,

wherein when it is judged as the abnormality that misrecognition has occurred due to disappearance of one of the road demarcation lines indicated in the camera image and a discrepancy in the other of the road demarcation lines indicated in the camera image, at least the one processor causes traveling in the second driving mode to continue for the period of time indicated based on the margin and changes the second driving mode to manual driving in stages via the first driving mode after the period of time has elapsed using the road demarcation lines indicated in the map information as reference lines.

7. The vehicle control device according to claim 1 ,

wherein the second driving mode is a driving mode in which a task of grasping an operation piece receiving a steering operation of the vehicle is not imposed on the driver, and

wherein the first driving mode is a driving mode in which at least only the task of grasping the operation piece is imposed on the driver.

8. A vehicle control method,

wherein a computer

acquires a camera image obtained by capturing an image of surrounding circumstances of a vehicle;

controls steering and acceleration/deceleration of the vehicle without depending on an operation of a driver of the vehicle on the basis of the camera image and map information;

determines any of a plurality of driving modes including a first driving mode and a second driving mode as a driving mode of the vehicle, and changes the driving mode of the vehicle to a driving mode imposing heavier tasks when tasks related to the determined driving mode are not being executed by the driver, the second driving mode being a driving mode in which tasks imposed on the driver are lighter than in the first driving mode, some of the plurality of driving modes including at least the second driving mode being performed by controlling steering and acceleration/deceleration of the vehicle without depending on an operation of the driver of the vehicle;

judges whether or not an abnormality has occurred in road demarcation lines indicated in the camera image or road demarcation lines indicated in the map information, and judges whether or not a preceding vehicle is present in front of the vehicle when it is judged that the abnormality has occurred;

calculates, when it is judged that the preceding vehicle is present, a margin for the vehicle to continue traveling in the second driving mode on the basis of a distance from the vehicle to the preceding vehicle, a distance from the preceding vehicle to where the preceding vehicle intersects a road demarcation line indicated in the camera image or a road demarcation line indicated in the map information, and a speed of the vehicle; and

causes the vehicle to continue traveling in the second driving mode for a period of time indicated based on the margin,

wherein the computer calculates the margin by adding the distance from the vehicle to the preceding vehicle and the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line, and dividing the distance from the vehicle to the preceding vehicle and the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line by the speed of the vehicle.

9. A computer readable non-transitory storage medium storing a program for causing a computer

to acquire a camera image obtained by capturing an image of surrounding circumstances of a vehicle;

to control steering and acceleration/deceleration of the vehicle without depending on an operation of a driver of the vehicle on the basis of the camera image and map information;

to determine any of a plurality of driving modes including a first driving mode and a second driving mode as a driving mode of the vehicle, and change the driving mode of the vehicle to a driving mode imposing heavier tasks when tasks related to the determined driving mode are not being executed by the driver, the second driving mode being a driving mode in which tasks imposed on the driver are lighter than in the first driving mode, some of the plurality of driving modes including at least the second driving mode being performed by controlling steering and acceleration/deceleration of the vehicle without depending on an operation of the driver of the vehicle;

to judge whether or not an abnormality has occurred in road demarcation lines indicated in the camera image or road demarcation lines indicated in the map information, and judge whether or not a preceding vehicle is present in front of the vehicle when it is judged that the abnormality has occurred;

to calculate, when it is judged that the preceding vehicle is present, a margin for the vehicle to continue traveling in the second driving mode on the basis of a distance from the vehicle to the preceding vehicle, a distance from the preceding vehicle to where the preceding vehicle intersects a road demarcation line indicated in the camera image or a road demarcation line indicated in the map information, and a speed of the vehicle; and

to cause the vehicle to continue traveling in the second driving mode for a period of time indicated based on the margin,

wherein the computer calculates the margin by adding the distance from the vehicle to the preceding vehicle and the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line, and dividing the distance from the vehicle to the preceding vehicle and the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line by the speed of the vehicle.

10. A vehicle control device comprising:

a storage medium which stores a command able to be read by a computer; and

at least one processor which is connected to the storage medium,

wherein at least the one processor, by executing the command able to be read by the computer,

acquires a camera image obtained by capturing an image of surrounding circumstances of a vehicle;

controls steering and acceleration/deceleration of the vehicle without depending on an operation of a driver of the vehicle on the basis of the camera image and pre-stored map information relating to boundaries of lanes;

determines any of a plurality of driving modes including a first driving mode and a second driving mode as a driving mode of the vehicle, and changes the driving mode of the vehicle to a driving mode imposing heavier tasks when tasks related to the determined driving mode are not being executed by the driver, the second driving mode being a driving mode in which tasks imposed on the driver are lighter than in the first driving mode, some of the plurality of driving modes including at least the second driving mode being performed by controlling steering and acceleration/deceleration of the vehicle without depending on an operation of the driver of the vehicle;

judges whether or not an abnormality has occurred in road demarcation lines indicated in the camera image or road demarcation lines indicated in the map information, and judges whether or not a preceding vehicle is present in front of the vehicle when it is judged that the abnormality has occurred;

calculates, when it is judged that the preceding vehicle is present, a margin for the vehicle to continue traveling in the second driving mode on the basis of a distance from the vehicle to the preceding vehicle, a distance from the preceding vehicle to where the preceding vehicle intersects a road demarcation line indicated in the camera image or a road demarcation line indicated in the map information, and a speed of the vehicle; and

causes the vehicle to continue traveling in the second driving mode for a period of time indicated based on the margin,

wherein when it is judged that the abnormality involves disappearance of at least one of the road demarcation lines indicated in the camera image, at least the one processor calculates the margin on the basis of the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line indicated in the map information, or when it is judged that the abnormality does not involve disappearance of at least one of the road demarcation line indicated in the camera image, the at least one processor calculates the margin on the basis of the distance from the preceding vehicle to where the preceding vehicle intersects the road demarcation line indicated in the camera image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2023
From: TAMURA, SHO; MORI, YOSHIHIRO; TAMURA, TAKAO; INOUE, DAICHI
To: HONDA MOTOR CO., LTD.
Reel/Frame 062762/0225 →
Priority Claims (1)
JP 2022-050640 · Mar 25, 2022 · national
Continuity (1)
Related Publication 20230303126A1 · Sep 28, 2023
References Cited (29)
US 9308914B1 · Sun · 2016 [cited by examiner]
US 10640122B2 · Kishi · 2020 [cited by examiner]
US 20150151757A1 · De Bruin · 2015 [cited by examiner]
US 20150241878A1 · Crombez · 2015 [cited by examiner]
US 20160214612A1 · Kashiba · 2016 [cited by examiner]
US 20170028995A1 · Mori · 2017 [cited by examiner]
US 20170203770A1 · Kondo · 2017 [cited by examiner]
US 20170313319A1 · Kishi · 2017 [cited by examiner]
US 20180039268A1 · Mangal · 2018 [cited by examiner]
US 20190049972A1 · Prasad · 2019 [cited by examiner]
US 20190101916A1 · Sen · 2019 [cited by examiner]
US 20190111922A1 · Nath · 2019 [cited by examiner]
US 20190129417A1 · Noto · 2019 [cited by examiner]
US 20190138002A1 · Mimura et al. · 2019 [cited by applicant]
US 20200183411A1 · Oba · 2020 [cited by examiner]
US 20200264606A1 · Kuwahara · 2020 [cited by examiner]
US 20210291830A1 · Tamura · 2021 [cited by applicant]
US 20220067398A1 · Tamura et al. · 2022 [cited by applicant]
US 20220219692A1 · Taniguchi · 2022 [cited by applicant]
JP 2019038289 · 2019 [cited by applicant]
JP 2020050086 · 2020 [cited by applicant]
JP 2021149321 · 2021 [cited by applicant]
JP 2022039951 · 2022 [cited by applicant]
WO WO2017056224A1 · 2017 [cited by examiner]
WO WO2017169386A1 · 2017 [cited by examiner]
WO 2017187622 · 2017 [cited by applicant]
WO 2020230551 · 2020 [cited by applicant]
WO 2021033312 · 2021 [cited by applicant]
Japanese Office Action for Japanese Patent Application No. 2022-050640 mailed Oct. 24, 2023. [cited by applicant]