IP Library › Granted Patent US 12,462,570
Granted Patent B2
US 12,462,570 · App. 18/183,166 · Granted Nov 4, 2025

Information processing device, driving diagnosis method, and program

Inventor: Yukiya Kushibiki (Gifu, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
G06V20/56G07C5/02G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,570
App. No.
18/183,166
Granted
Nov 4, 2025
Kind
B2
Abstract

An information processing device includes: an acquisition unit that acquires travel information related to travel of a vehicle and information as to whether a target has been recognized from a captured image captured by a camera mounted on the vehicle; a preprocessing unit that updates, when information indicating that the target has been recognized is included in the information acquired during a certain section including a certain time, information indicating that the target is not recognized at the certain time with the information indicating that the target has been recognized; and a diagnosis unit that diagnoses that an event requiring attention has occurred at each time when there is the information indicating that the target has been recognized and a detection condition based on a state of the target and the travel information is satisfied.

Claims (43)

1 . An information processing device, comprising:

a processor configured to

acquire travel information related to travel of a vehicle and information as to whether a signal of a traffic light has been recognized from a captured image captured by a camera mounted on the vehicle,

when information indicating that the signal of the traffic light has been recognized is included in the information acquired during a certain section including a certain time, update information indicating that the signal of the traffic light is not recognized at the certain time with the information indicating that the signal of the traffic light has been recognized, and

generate a diagnosis that an event requiring attention has occurred each time there is the information indicating that the signal of the traffic light has been recognized, wherein the signal represents a red light, and the travel information indicates that the vehicle is not stopping.

2 . The information processing device according to claim 1 , wherein

the processor is configured to extract the captured image when a detection condition is satisfied.

3 . The information processing device according to claim 2 , wherein

the processor is configured to terminate extraction of the captured image when the detection condition is no longer satisfied.

4 . The information processing device according to claim 2 , wherein

the processor is configured to delete the extracted captured image when a predetermined detection cancellation condition based on the travel information is satisfied.

5 . The information processing device according to claim 1 , wherein

the processor is configured to,

in response to the vehicle being constantly 10 m or more away from the traffic light while recognizing the red light, delete the diagnosis that the event requiring attention has occurred, and

in response to the traffic light being immediately switched from red to green, delete the diagnosis that the event requiring attention has occurred.

6 . The information processing device according to claim 1 , wherein

the information processing device is a server configured to wirelessly communicate with the vehicle over a network, to acquire the travel information and the information as to whether a signal of a traffic light has been recognized, and

the processor is configured to generate the diagnosis that an event requiring attention has occurred, without using or acquiring the captured image captured by the camera mounted on the vehicle, thereby reducing an amount of communication with the vehicle over the network.

7 . The information processing device according to claim 6 , wherein the processor is configured to

in response to the generated diagnosis, perform image extraction comprising requesting the captured image from the vehicle, and storing the captured imaged in a database at the server, and

in response to a predetermined detection cancellation condition being satisfied based on the travel information, delete the captured imaged stored in a database and the diagnosis that an event requiring attention has occurred.

8 . A non-transitory computer readable medium storing a program that causes a computer to execute processes comprising:

acquiring travel information related to travel of a vehicle and information as to whether a signal of the traffic light has been recognized from a captured image captured by a camera mounted on the vehicle;

when information indicating that the signal of the traffic light has been recognized is included in the information acquired during a certain section including a certain time, updating information indicating that the signal of the traffic light is not recognized at the certain time with the information indicating that the signal of the traffic light has been recognized; and

generating a diagnosis that an event requiring attention has occurred each time there is the information indicating that the signal of the traffic light has been recognized, wherein the signal represents a red light, and the travel information indicates that the vehicle is not stopping.

9 . The non-transitory computer readable medium according to claim 8 , wherein

the processes further comprise:

in response to the vehicle being constantly 10 m or more away from the traffic light while recognizing the red light, deleting the diagnosis that the event requiring attention has occurred, and

in response to the traffic light being immediately switched from red to green, deleting the diagnosis that the event requiring attention has occurred.

10 . A system, comprising: a vehicle and an information processing device, wherein

the information processing device comprises a processor configured to

acquire travel information related to travel of a vehicle and information as to whether a signal of a traffic light has been recognized from a captured image captured by a camera mounted on the vehicle,

when information indicating that the signal of the traffic light has been recognized is included in the information acquired during a certain section including a certain time, update information indicating that the signal of the traffic light is not recognized at the certain time with the information indicating that the signal of the traffic light has been recognized, and

generate a diagnosis that an event requiring attention has occurred each time there is the information indicating that the signal of the traffic light has been recognized, wherein the signal represents a red light, and the travel information indicates that the vehicle is not stopping,

the information processing device is a server configured to wirelessly communicate with the vehicle over a network, to acquire the travel information and the information as to whether a signal of a traffic light has been recognized, and

the processor is configured to generate the diagnosis that an event requiring attention has occurred, without using or acquiring the captured image captured by the camera mounted on the vehicle, thereby reducing an amount of communication with the vehicle over the network.

11 . The system according to claim 10 , wherein the processor is configured to

in response to the generated diagnosis, perform image extraction comprising requesting the captured image from the vehicle, and storing the captured imaged in a database at the server, and

in response to a predetermined detection cancellation condition being satisfied based on the travel information, delete the captured imaged stored in a database and the diagnosis that an event requiring attention has occurred.

12 . The system according to claim 11 , wherein

the processor is configured to,

in response to the vehicle being constantly 10 m or more away from the traffic light while recognizing the red light, delete the diagnosis that the event requiring attention has occurred, and

in response to the traffic light being immediately switched from red to green, delete the diagnosis that the event requiring attention has occurred.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2023
From: KUSHIBIKI, YUKIYA
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 062969/0158 →
Priority Claims (1)
JP 2022-076207 · May 2, 2022 · national
Continuity (1)
Related Publication 20230351762A1 · Nov 2, 2023
References Cited (32)
US 10306190B1 · Schofield · 2019 [cited by examiner]
US 12230132B2 · Kushibiki · 2025 [cited by examiner]
US 20100198488A1 · Groitzsch et al. · 2010 [cited by applicant]
US 20140225749A1 · Saka · 2014 [cited by applicant]
US 20160101785A1 · Takahashi · 2016 [cited by examiner]
US 20160210857A1 · Gao et al. · 2016 [cited by applicant]
US 20160349072A1 · Yoshitomi et al. · 2016 [cited by applicant]
US 20170161567A1 · Satomura · 2017 [cited by applicant]
US 20170174132A1 · Yokochi et al. · 2017 [cited by applicant]
US 20170243483A1 · Kaneshige et al. · 2017 [cited by applicant]
US 20170262709A1 · Wellington · 2017 [cited by examiner]
US 20170308761A1 · Gillet et al. · 2017 [cited by applicant]
US 20200234587A1 · Girond et al. · 2020 [cited by applicant]
US 20200256695A1 · Girond et al. · 2020 [cited by applicant]
US 20200265250A1 · Oe · 2020 [cited by examiner]
US 20200294401A1 · Kerecsen · 2020 [cited by examiner]
US 20210024085A1 · Kitagawa · 2021 [cited by applicant]
US 20210182572A1 · Kanno · 2021 [cited by applicant]
US 20210224560A1 · Kim et al. · 2021 [cited by applicant]
US 20220317443A1 · Matsui et al. · 2022 [cited by applicant]
JP 2006321354A · 2006 [cited by applicant]
JP 2007172487A · 2007 [cited by applicant]
JP 2014010674A · 2014 [cited by applicant]
JP 2015014988A · 2015 [cited by applicant]
JP 2016206970A · 2016 [cited by applicant]
JP 2020052634A · 2020 [cited by applicant]
JP 2021056575A · 2021 [cited by applicant]
JP 2021118002A · 2021 [cited by applicant]
Wang et al, Traffic Light Recognition with Hight Dynamic Range Imaging and Deep Learning, 2019, IEEE Transactions on Intelligent Transportation Systems, 20(4) 1341-1352. (Year: 2019). [cited by examiner]
Bao et al, Safe Driving at Traffic Lights: An Image Recognition based Approach, 2019, 20th IEEE International Conference on Mobile Data Management, pp. 1-7. (Year: 2019). [cited by examiner]
Notice of Allowance in U.S. Appl. No. 18/181,576, mailed Nov. 14, 2024, 5pp. [cited by applicant]
Office Action in U.S. Appl. No. 18/181,576, mailed Sep. 27, 2024, 22pp. [cited by applicant]