IP Library › Granted Patent US 12,536,807
Granted Patent B2
US 12,536,807 · App. 18/281,637 · Granted Jan 27, 2026

Apparatus, method, and recording medium

Inventors: Yosuke Kimura (Tokyo, JP); Nana Jumonji (Tokyo, JP); Chisato Sugawara (Tokyo, JP)
Assignee: NEC CORPORATION
G06V20/56B60W50/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,807
App. No.
18/281,637
Granted
Jan 27, 2026
Kind
B2
Abstract

In order to acquire an image suitable for driving instruction while reducing the image acquisition load, and to use the acquired image to output information relating to the driving of the driver of a vehicle, a driving information output device according to the present invention comprises: a communication means that communicates with an image acquisition device mounted on a vehicle; an information acquisition means that acquires, from the image acquisition device via the communication means, an image that satisfies image acquisition conditions including at least one of an image acquisition position, an image acquisition time, and a vehicle operating status and a vehicle surrounding environment at the time of image acquisition; a driving information generation means that generates driving information, which is information regarding the driving of the driver of the vehicle, on the basis of the acquired image; and an output means that outputs the driving information.

Claims (71)

1 . An apparatus comprising:

a communication interface configured to communicate with an image acquisition device mounted on a vehicle;

a memory; and

at least one processor coupled to the memory,

the processor performing operations, the operations comprising:

acquiring, from the image acquisition device via the communication interface, an image that satisfies an image acquisition condition including an image acquisition position, an image acquisition time, and at least one of an operating state of the vehicle and a surrounding environment of the vehicle at time of image acquisition;

generating driving information based on the acquired image, the driving information being related to driving by a driver of the vehicle; and

outputting the driving information, wherein the operations further comprise:

acquiring, from the image acquisition device, driving-related information including an image acquisition position, an image acquisition time, and at least one of the operating state of the vehicle and surrounding environment of the vehicle at the time of image acquisition;

outputting information related to the driving-related information to a display device that displays the information related to the driving-related information;

acquiring, from an input device, an item selected by a user from among the information related to the driving-related information;

generating the image acquisition condition based on the item selected by the user; and

outputting the generated image acquisition condition to the image acquisition device.

2 . The apparatus according to claim 1 , wherein the operations further comprise:

generating at least one of a state of the driver and a state of the vehicle as the driving information.

3 . The apparatus according to claim 2 , wherein the operations further comprise:

generating an index of safe driving for the driver by using at least one of the state of the driver and the state of the vehicle.

4 . The apparatus according to claim 1 , wherein the operations further comprise:

acquiring a plurality of images from a plurality of the image acquisition devices, and

generating a plurality of pieces of the driving information using the plurality of acquired images and generating information for comparing the plurality of pieces of generated driving information.

5 . The apparatus according to claim 1 , wherein the operations further comprise:

generating the driving information by using a diagnostic criterion associated to the image acquisition condition.

6 . The apparatus according to claim 1 , wherein the operations further comprise:

acquiring at least some of the image acquisition conditions from a predetermined device, or acquiring a user instruction related to generation of the image acquisition conditions from a predetermined device, and generating the image acquisition conditions associated to the acquired instruction.

7 . A method comprising:

acquiring, from an image acquisition device mounted on a vehicle, an image that satisfies an image acquisition condition including an image acquisition position, an image acquisition time, and at least one of an operating state of the vehicle and a surrounding environment of the vehicle at time of image acquisition;

generating driving information based on the acquired image, the driving information being related to driving by a driver of the vehicle; and

outputting the driving information, wherein the method further comprises:

acquiring, from the image acquisition device, driving-related information including an image acquisition position, an image acquisition time, and at least one of the operating state of the vehicle and surrounding environment of the vehicle at the time of image acquisition;

outputting information related to the driving-related information to a display device that displays the information related to the driving-related information;

acquiring, from an input device, an item selected by a user from among the information related to the driving-related information;

generating the image acquisition condition based on the item selected by the user; and

outputting the generated image acquisition condition to the image acquisition device.

8 . The method according to claim 7 , further comprising:

generating at least one of a state of the driver and a state of the vehicle as the driving information.

9 . The method according to claim 8 , further comprising:

generating an index of safe driving for the driver by using at least one of the state of the driver and the state of the vehicle.

10 . The method according to claim 7 , further comprising:

acquiring a plurality of images from a plurality of the image acquisition devices; and

generating a plurality of pieces of the driving information using the plurality of acquired images and generating information for comparing the plurality of pieces of generated driving information.

11 . The method according to claim 7 , further comprising:

generating the driving information by using a diagnostic criterion associated to the image acquisition condition.

12 . The method according to claim 7 , further comprising:

acquiring at least some of the image acquisition conditions from a predetermined device, or acquiring a user instruction related to generation of the image acquisition conditions from a predetermined device, and generating the image acquisition conditions associated to the acquired instruction.

13 . A non-transitory computer-readable recording medium that embodies a program for causing a computer to perform a method, the method comprising:

acquiring, from an image acquisition device mounted on a vehicle, an image that satisfies an image acquisition condition including an image acquisition position, an image acquisition time, and at least one of an operating state of the vehicle and a surrounding environment of the vehicle at time of image acquisition;

generating driving information based on the acquired image, the driving information being related to driving by a driver of the vehicle; and

outputting the driving information, wherein the method further comprises

acquiring, from the image acquisition device, driving-related information including an image acquisition position, an image acquisition time, and at least one of the operating state of the vehicle and surrounding environment of the vehicle at the time of image acquisition;

outputting information related to the driving-related information to a display device that displays the information related to the driving-related information;

acquiring, from an input device, an item selected by a user from among the information related to the driving-related information;

generating the image acquisition condition based on the item selected by the user; and

outputting the generated image acquisition condition to the image acquisition device.

14 . The recording medium according to claim 13 that embodies a program for causing a computer to perform a method, the method comprising:

generating at least one of a state of the driver and a state of the vehicle as the driving information.

15 . The recording medium according to claim 14 that embodies a program for causing a computer to perform a method, the method comprising:

generating an index of safe driving for the driver by using at least one of the state of the driver and the state of the vehicle.

16 . The recording medium according to claim 13 that embodies a program for causing a computer to perform a method, the method comprising:

acquiring a plurality of images from a plurality of the image acquisition devices; and

generating a plurality of pieces of the driving information using the plurality of acquired images, and generating information for comparing the plurality of pieces of generated driving information.

17 . The recording medium according to claim 13 that embodies a program for causing a computer to perform a method, the method comprising:

generating the driving information by using a diagnostic criterion associated to the image acquisition condition.

18 . The apparatus according to claim 1 , wherein the operations further comprise:

acquiring, from the image acquisition device, a quantity of the images that satisfy the image acquisition condition; and

outputting the quantity of the images that satisfy the image acquisition condition.

19 . The method according to claim 7 , wherein the method further comprises:

acquiring, from the image acquisition device, a quantity of the images that satisfy the image acquisition condition; and

outputting the quantity of the images that satisfy the image acquisition condition.

20 . The recording medium according to claim 13 that embodies a program for causing a computer to perform a method, the method comprising:

acquiring, from the image acquisition device, a quantity of the images that satisfy the image acquisition condition; and

outputting the quantity of the images that satisfy the image acquisition condition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2023
From: KIMURA, YOSUKE; JUMONJI, NANA; SUGAWARA, CHISATO
To: NEC CORPORATION
Reel/Frame 064880/0301 →
Continuity (1)
Related Publication 20240169739A1 · May 23, 2024
References Cited (16)
US 20090318121A1 · Marumoto · 2009 [cited by examiner]
US 20100157061A1 · Katsman et al. · 2010 [cited by applicant]
US 20130093888A1 · Kim · 2013 [cited by examiner]
US 20180357484A1 · Omata · 2018 [cited by applicant]
US 20180370433A1 · Huang · 2018 [cited by examiner]
US 20190325667A1 · Kim · 2019 [cited by examiner]
US 20200066146A1 · Ichikawa et al. · 2020 [cited by applicant]
JP 2011217116A · 2011 [cited by applicant]
JP 2015038773A · 2015 [cited by applicant]
JP 2018045303A · 2018 [cited by applicant]
JP 2019149016A · 2019 [cited by applicant]
WO 2019146522A1 · 2019 [cited by applicant]
JP Office Action for JP Application No. 2023-506400, mailed on Aug. 6, 2024 with English Translation. [cited by applicant]
Extended European Search Report for EP Application No. 21931431.7, dated on Jan. 15, 2024. [cited by applicant]
International Search Report for PCT Application No. PCT/JP2021/010374, mailed on May 18, 2021. [cited by applicant]
English translation of Written opinion for PCT Application No. PCT/JP2021/010374, mailed on May 18, 2021. [cited by applicant]