IP Library Granted Patent US 12,400,460
Granted Patent B2
US 12,400,460 · App. 17/976,125 · Granted Aug 26, 2025

Monitoring device, storage medium storing computer program for monitoring, and monitoring method

Inventor: Shunichiroh Sawai (Tokyo-to, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
G06V20/597B60Q9/00G06V10/25G06V20/588B60W50/14B60W60/0053B60W2540/229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,400,460
App. No.
17/976,125
Granted
Aug 26, 2025
Kind
B2
Abstract

A monitoring device comprises a processor configured to estimate whether or not a non-stimulating environment has appeared in front of a driver which may cause the driver to have a lower alertness level or to engage in unfocused driving, based on multiple images taken of an environment ahead of a vehicle across a predetermined time period, and to act on the driver via a notification unit to increase a level of contribution to driving when the non-stimulating environment has appeared ahead.

Claims (38)

1. A monitoring device comprising:

a processor configured to

estimate whether or not a non-stimulating environment has appeared in front of a driver which may cause the driver to have a lower alertness level or to engage in unfocused driving, based on multiple images taken of an environment ahead of a vehicle across a predetermined time period,

calculate an environment index representing the environment in front of the vehicle based on the multiple images,

estimate whether or not the non-stimulating environment has appeared in front of the driver based on the environment index,

calculate a number of other vehicles appearing in the multiple front images as the environment index,

estimate that the non-stimulating environment has appeared in front of the driver when the number of other vehicles appearing in the multiple front images is equal to or below a reference number within a reference time, and

act on the driver via a notification unit to increase a level of contribution to driving when the non-stimulating environment has appeared ahead.

2. The monitoring device according to claim 1 , wherein the processor is further configured to

calculate change in side regions of the multiple images as the environment index, and

estimate that the non-stimulating environment has appeared in front of the driver when degree of change in the side regions is equal to or below a first reference value or the side regions periodically change.

3. The monitoring device according to claim 2 , wherein the processor is further configured to

calculate the degree of change in the side regions based on colors or sizes of objects in the side regions.

4. The monitoring device according to claim 1 , wherein the processor is further configured to

calculate changes in lower regions of the multiple images as the environment index, and

estimate that the non-stimulating environment has appeared in front of the driver when degree of change in the lower regions is equal to or below a second reference value or the lower regions periodically change.

5. The monitoring device according to claim 4 , wherein the processor is further configured to

calculate the degree of change in the lower regions based on locations of road features in the lower region.

6. The monitoring device according to claim 1 , wherein the processor is further configured to

estimate whether or not the non-stimulating environment has appeared in front of the driver based on the environment index using different conditions for daytime and nighttime.

7. The monitoring device according to claim 1 , wherein the processor is further configured to

determine whether or not an alertness level of the driver has fallen,

act on the driver via a notification unit to increase a level of contribution to driving when the alertness level of the driver has fallen, and

estimate whether or not the non-stimulating environment has appeared in front of the driver when the alertness level of the driver has not fallen.

8. A computer-readable, non-transitory storage medium storing a computer program for monitoring, which causes a processor execute a process, the process comprising:

estimating whether or not a non-stimulating environment has appeared in front of a driver which may cause the driver to have a lower alertness level or to engage in unfocused driving, based on multiple images taken of an environment ahead of a vehicle across a predetermined time period;

calculating an environment index representing the environment in front of the vehicle based on the multiple images;

estimating whether or not the non-stimulating environment has appeared in front of the driver based on the environment index;

calculating a number of other vehicles appearing in the multiple front images as the environment index;

estimating that the non-stimulating environment has appeared in front of the driver when the number of other vehicles appearing in the multiple front images is equal to or below a reference number within a reference time; and

acting on the driver via a notification unit to increase a level of contribution to driving when the non-stimulating environment has appeared in front of the driver.

9. A monitoring method carried out by a monitoring device and the method comprising:

estimating whether or not a non-stimulating environment has appeared in front of a driver which may cause the driver to have a lower alertness level or to engage in unfocused driving, based on multiple images taken of an environment ahead of a vehicle across a predetermined time period;

calculating an environment index representing the environment in front of the vehicle based on the multiple images;

estimating whether or not the non-stimulating environment has appeared in front of the driver based on the environment index;

calculating a number of other vehicles appearing in the multiple front images as the environment index;

estimating that the non-stimulating environment has appeared in front of the driver when the number of other vehicles appearing in the multiple front images is equal to or below a reference number within a reference time; and

acting on the driver via a notification unit to increase a level of contribution to driving when the non-stimulating environment has appeared in front of the driver.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2022
From: SAWAI, SHUNICHIROH
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 061581/0882 →
Priority Claims (1)
JP 2021-200697 · Dec 10, 2021 · national
Continuity (1)
Related Publication 20230186653A1 · Jun 15, 2023
References Cited (20)
US 9925872B1 · Alasry · 2018 [cited by examiner]
US 20090231146A1 · Fujita · 2009 [cited by applicant]
US 20120326914A1 · Nagy · 2012 [cited by examiner]
US 20190051165A1 · Harer · 2019 [cited by examiner]
US 20190326669A1 · Gaines · 2019 [cited by examiner]
US 20200198465A1 · Tanabe · 2020 [cited by examiner]
US 20200225343A1 · Lee · 2020 [cited by examiner]
US 20210188289A1 · Oba · 2021 [cited by examiner]
US 20210253111A1 · Iwase · 2021 [cited by examiner]
US 20210291837A1 · Aizawa et al. · 2021 [cited by applicant]
US 20220161813A1 · Oba · 2022 [cited by examiner]
JP H10315800A · 1998 [cited by applicant]
JP 2006318159A · 2006 [cited by applicant]
JP 2009018777A · 2009 [cited by applicant]
JP 2009208739A · 2009 [cited by applicant]
JP 2009230506A · 2009 [cited by applicant]
JP 2018151907A · 2018 [cited by applicant]
JP 2019046068A · 2019 [cited by applicant]
WO 2007029455A1 · 2007 [cited by applicant]
WO 2017134876A1 · 2017 [cited by applicant]