IP Library › Granted Patent US 12,503,112
Granted Patent B2
US 12,503,112 · App. 18/672,928 · Granted Dec 23, 2025

Driving assistance device, driving assistance method, and recording medium

Inventors: Takaaki Seki (Osaka Fu, JP); Koichi Emura (Kanagawa Ken, JP); Masataka Kato (Kanagawa Ken, JP)
Assignee: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
B60W30/18009B60Q9/00B60W40/08B60W50/14G06F3/013G06T7/70G06V10/44G06V10/98G06V20/56B60W2040/0818B60W2520/10B60W2540/225G06T2207/30201G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,503,112
App. No.
18/672,928
Granted
Dec 23, 2025
Kind
B2
Abstract

A driving assistance device includes a processor connected to a memory. The processor detects a latent recognition region that is unconsciously recognized by a human in an entire imaging region of a captured image. The captured image is captured by an external camera that is provided in a mobile body. The captured image is an image of at least a traveling direction in which the mobile body travels. The latent recognition region is detected based on a predetermined feature value included in the captured image. The processor presents predetermined driving assistance information in a region on a display device. The region is estimated in accordance with the detected latent recognition region.

Claims (40)

1 . A driving assistance device comprising:

a hardware processor connected to a memory and configured to:

detect a latent recognition region being unconsciously recognized by a human in an entire imaging region of a captured image captured by an external camera provided in a mobile body, the captured image being an image of at least a traveling direction in which the mobile body travels, the latent recognition region being detected based on a predetermined feature value included in the captured image;

present predetermined driving assistance information in a region on a display device, the region being estimated in accordance with the detected latent recognition region;

detect a gaze of a driver; and

present the driving assistance information in a divided region where a dwell time of the detected gaze is equal to or longer than a predetermined dwell time and a prediction error is less than the threshold value.

2 . The driving assistance device according to claim 1 , wherein the hardware processor is configured to detect, as the latent recognition region, a divided region having a predetermined feature value exceeding a predetermined threshold value out of divided regions obtained by dividing the entire imaging region into a plurality of regions.

3 . The driving assistance device according to claim 2 , wherein the hardware processor is configured to present the driving assistance information separately between a period of time during which the feature value is less than the threshold value and a period of time during which the feature value exceeds the threshold value.

4 . The driving assistance device according to claim 2 , wherein the hardware processor is configured to:

present the driving assistance information while the feature value exceeds the threshold value, or

present the driving assistance information for a given period of time after the feature value exceeds the threshold value.

5 . The driving assistance device according to claim 2 , wherein the hardware processor is configured to:

detect, for each of the divided regions, a prediction error being a difference between pixels of a predicted image predicted from a past image captured in a past by the external camera and pixels of an actual captured image actually captured by the external camera at a time of the predicted image; and

detect, as the latent recognition region, a divided region having the prediction error exceeding a predetermined threshold value.

6 . The driving assistance device according to claim 2 , wherein the hardware processor is configured to:

detect an edge of an object from a captured image captured by the external camera; and

detect, as the latent recognition region, a divided region where a ratio of the edge exceeds a predetermined threshold value out of the divided regions.

7 . The driving assistance device according to claim 2 , wherein the hardware processor is configured to:

detect, for each of the divided regions, a prediction error indicating a difference between pixels of a predicted current image corresponding to a current captured image generated by prediction from a captured image captured in a past by the external camera, and pixels of a current captured image captured by the external camera;

detect a divided region including an edge of an object from the captured image captured by the external camera; and

detect, as the latent recognition region, a divided region from which a prediction error exceeding a predetermined threshold value is detected and in which the edge exceeding a predetermined threshold value is included.

8 . The driving assistance device according to claim 1 , wherein the hardware processor is configured to change one or more items in accordance with the detected latent recognition region, the items including:

presence or absence of the presentation of the driving assistance information,

a position of the presentation of the driving assistance information,

a number of the presentation of the driving assistance information, and

a type of the driving assistance information.

9 . The driving assistance device according to claim 8 , further comprising a speed detection sensor configured to detect a movement speed of the mobile body,

wherein the hardware processor is configured to change at least the type of the driving assistance information to be presented, the type being changed between a case where a movement speed of the mobile body detected by the speed detection sensor is equal to or more than a predetermined threshold value and a case where the movement speed is less than the predetermined threshold value.

10 . The driving assistance device according to claim 1 , further comprising a speed detection sensor configured to detect a movement speed of the mobile body,

wherein the hardware processor is configured to control operation of the mobile body in accordance with a movement speed of the mobile body detected by the speed detection sensor.

11 . A driving assistance method implemented by a computer, the method comprising:

detecting a latent recognition region being unconsciously recognized by a human in an entire imaging region of a captured image captured by an external camera provided in a mobile body, the captured image being an image of at least a traveling direction in which the mobile body travels, the latent recognition region being detected based on a predetermined feature value included in the captured image;

presenting predetermined driving assistance information in a region on a display device, the region being estimated in accordance with the detected latent recognition region;

detecting a gaze of a driver; and

presenting the driving assistance information in a divided region where a dwell time of the detected gaze is equal to or longer than a predetermined dwell time and a prediction error is less than the threshold value.

12 . A non-transitory computer-readable recording medium on which programmed instructions are recorded, the instructions causing a computer to execute processing, the processing comprising:

detecting a latent recognition region being unconsciously recognized by a human in an entire imaging region of a captured image captured by an external camera provided in a mobile body, the captured image being an image of at least a traveling direction in which the mobile body travels, the latent recognition region being detected based on a predetermined feature value included in the captured image;

presenting predetermined driving assistance information in a region on a display device, the region being estimated in accordance with the detected latent recognition region;

detecting a gaze of a driver; and

presenting the driving assistance information in a divided region where a dwell time of the detected gaze is equal to or longer than a predetermined dwell time and a prediction error is less than the threshold value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2024
From: SEKI, TAKAAKI; EMURA, KOICHI; KATO, MASATAKA
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 068776/0888 →
Priority Claims (1)
JP 2021-195012 · Nov 30, 2021 · national
Continuity (2)
Continuation PCTJP2022035540 · Sep 22, 2022
Related Publication 20240308516A1 · Sep 19, 2024
References Cited (12)
US 20190340496A1 · Kim et al. · 2019 [cited by applicant]
US 20200047747A1 · An · 2020 [cited by examiner]
US 20200404272A1 · Abe · 2020 [cited by examiner]
US 20220324328A1 · Kato et al. · 2022 [cited by applicant]
JP 2006231962 · 2006 [cited by applicant]
JP 2010205117 · 2010 [cited by applicant]
JP 2016086355 · 2016 [cited by applicant]
JP 2018173944 · 2018 [cited by applicant]
JP 2019096109 · 2019 [cited by applicant]
WO 2021132566 · 2021 [cited by applicant]
Translation of WO 2021132566 A1 (Year: 2021). [cited by examiner]
International Search Report issued in International Pat. Appl. No. PCT/JP2022/035540, dated Dec. 13, 2022, along with an English translation thereof. [cited by applicant]