Granted Patent B2

US 12,340,601 · App. 17/617,089 · Granted Jun 24, 2025

Inventor: Kazuki Inagaki (Tokyo, JP)

Assignee: NEC CORPORATION

G06V20/597G06T7/73G06V40/168G06V40/18

Abstract

Claims (35)

1. An image processing device comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to:

acquire sensing information indicating a state of a moving body;

acquire a plurality of captured images that capture a driver driving the moving body;

identify, from the plurality of acquired captured images, a plurality of captured images as being captured in a state of the moving body traveling forward based on the sensing information;

set a reference line of sight direction in a case of the driver facing forward, based on a statistical value of a line of sight direction of the driver indicated by each of the plurality of identified captured images; and

record the reference line of sight direction calculated based on captured images captured by an in-vehicle device in the moving body, in association with the ID of the in-vehicle device.

2. The image processing device according to claim 1 , wherein the sensing information is an acceleration rate of the moving body, and

wherein the at least one processor is configured to execute the instructions to identify, from the plurality of acquired captured images, a plurality of captured images captured in a state of the acceleration rate being equal to or higher than a predetermined threshold value.

3. The image processing device according to claim 1 , wherein the sensing information is a velocity of the moving body and a rotation angle of a steering wheel, and

wherein the at least one processor is configured to execute the instructions to identify, from the plurality of acquired captured images, a plurality of captured images captured in a state of the velocity being equal to or higher than a predetermined velocity and the rotation angle of the steering wheel being an angle indicating forward.

4. The image processing device according to claim 1 , wherein the sensing information is a velocity of the moving body, and

wherein the at least one processor is configured to execute the instructions to identify, from the plurality of acquired captured images, a plurality of captured images captured in a state of the velocity being equal to or higher than a predetermined threshold value.

5. The image processing device according to claim 1 , wherein the at least one processor is configured to execute the instructions to acquire, as the sensing information, information indicating a state of the moving body being traveling forward, from an in-vehicle device of the moving body.

6. The image processing device according to claim 1 , wherein the at least one processor is configured to execute the instructions to determine whether or not the driver is looking away, based on a difference between: a reference line of sight direction in the case of the driver facing forward; and a current line of sight direction.

7. The image processing device according to claim 1 , wherein the at least one processor is configured to execute the instructions to notify an in-vehicle device of the moving body, of information indicating a reference line of sight direction in the case of the driver facing forward.

8. An image processing method comprising:

acquiring sensing information indicating a state of a moving body;

acquiring a plurality of captured images that capture a driver driving the moving body;

identifying, from the plurality of acquired captured images, a plurality of captured images as being captured in a state of the moving body traveling forward based on the sensing information;

setting a reference line of sight direction in a case of the driver facing forward, based on a statistical value of a line of sight direction of the driver indicated by each of the plurality of identified captured images; and

recording the reference line of sight direction calculated based on captured images captured by an in-vehicle device in the moving body, in association with the ID of the in-vehicle device.

9. A non-transitory recording medium storing a program, which if executed, causes a computer of an image processing device to execute:

acquiring sensing information indicating a state of a moving body;

acquiring a plurality of captured images that capture a driver driving the moving body;

identifying, from the plurality of acquired captured images, a plurality of captured images as being captured in a state of the moving body traveling forward based on the sensing information;

setting a reference line of sight direction in a case of the driver facing forward, based on a statistical value of a line of sight direction of the driver indicated by each of the plurality of acquired captured images; and

recording the reference line of sight direction calculated based on captured images captured by an in-vehicle device in the moving body, in association with the ID of the in-vehicle device.

10. The image processing device according to claim 7 , wherein the at least one processor is configured to execute the instructions to notify a dash cam, which is in the vehicle, of information indicating a reference line of sight direction in the case of the driver facing forward.

11. The image processing device according to claim 1 , wherein the at least one processor is configured to execute the instructions to determine whether or not the driver is looking away based on a difference between a previously presentedly detected line of sight direction from previously presented captured images and the reference line of sight direction recorded in association with the ID of the in-vehicle device capturing the previously presented captured images.

12. The image processing device according to claim 1 , wherein the at least one processor is configured to execute the instructions to:

determine whether the moving body is travelling straight and forward based on the sensing information; and

identify, from the plurality of acquired captured images, the plurality of captured images as being captured in the state of the moving body traveling forward in a case where the moving body is determined to be travelling straight and forward.

13. The image processing device according to claim 12 , wherein the at least one processor is configured to execute the instructions to determine whether the moving body is travelling straight and forward in a case where a velocity of the moving body is equal to or higher than a predetermined velocity and a rotation angle of a steering wheel of the moving body is an angle indicating forward.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (25)