IP Library Granted Patent US 10,957,028
Granted Patent B2
US 10,957,028 · App. 16/331,629 · Granted Mar 23, 2021

Image generation device, image generation method and recording medium

Inventors: Osamu Shibata (Hyogo, JP); Hiroshi Iwai (Osaka, JP); Kazuko Nishimura (Kyoto, JP); Yasuo Miyake (Osaka, JP); Yoshiaki Satou (Kyoto, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06T5/50B60R2300/101B60R2300/105B60R2300/302B60R2300/303
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,957,028
App. No.
16/331,629
Granted
Mar 23, 2021
Kind
B2
Abstract

An image generation device includes a first reception unit and a control unit. The first reception unit receives travel information about the travel state of a moving body. The control unit sets, based on the travel information, a multiple-exposure region in an imaging region of an image sensor used on the moving body, and generates image data in which the multiple-exposure region in the imaging region is formed through a multiple exposure and a region other than the multiple-exposure region is not formed through the multiple exposure.

Claims (48)

1. An image generation device comprising:

a receiver which receives travel information about a travel state of a moving body; and

a controller which sets, based on the travel information received by receiver, a multiple-exposure region in an imaging region obtained by imaging a region in front of the moving body by an image sensor, and generates image data in which the multiple-exposure region in said imaging region is formed through a multiple exposure and a region other than the multiple-exposure region is not formed through the multiple exposure, the image sensor being mounted on the moving body and performing the multiple exposure,

wherein the multiple-exposure region in said imaging region includes an image indicating the trajectory of movement of an object existing around the moving body.

2. The image generation device according to claim 1 , wherein:

the image sensor includes a plurality of pixels each belonging to a corresponding one of a plurality of segments that are predetermined and obtained by dividing a region of an image captured by the image sensor; and

the controller determines at least one of the plurality of segments as the multiple exposure region based on the travel information.

3. The image generation device according to claim 2 , wherein:

the controller determines, as the multiple-exposure region, a segment including a pixel that receives light from a side with respect to a traveling direction of the moving body.

4. The image generation device according to claim 3 , wherein:

the controller determines from the travel information whether or not the moving body is traveling straight, and when the controller determines that the moving body is traveling straight, the controller excludes, from the segment to be determined as the multiple-exposure region, a segment including a pixel that receives at least light from straight ahead.

5. The image generation device according to claim 3 , wherein: the controller determines from the travel information whether or not the moving body is steering through a turn, and when the controller determines that the moving body is steering through a turn, the controller excludes, from the segment to be determined as the multiple-exposure region, a segment including a pixel that receives at least light from a steering direction of the moving body.

6. The image generation device according to claim 3 , wherein:

the side with respect to the traveling direction of the moving body is a vicinity of a travel path of the moving body.

7. The image generation device according to claim 3 , wherein:

the side with respect to the traveling direction of the moving body includes at least a traffic lane adjacent to a traffic lane in which the moving body is traveling.

8. The image generation device according to claim 1 , wherein:

the travel information includes at least one of a steering angle of the moving body, an angular velocity around a pitch axis of the moving body, and a slope angle ahead of a traveling spot of the moving body.

9. An image generation method comprising:

receiving travel information about a travel state of a moving body;

setting, based on the travel information received in the receiving, a multiple-exposure region in an imaging region obtained by imaging a region in front of the moving body by an image sensor which is mounted on the moving body and performs a multiple exposure; and

generating image data in which the multiple-exposure region in said imaging region is formed through the multiple exposure and a region other than the multiple-exposure region is not formed through the multiple exposure,

wherein the multiple-exposure region in said imaging region includes an image indicating the trajectory of movement of an object existing around the moving body.

10. A non-transitory recording medium having a program recorded thereon which causes a computer to execute:

receiving travel information about a travel state of a moving body;

setting, based on the travel information received in the receiving, a multiple-exposure region in an imaging region obtained by imaging a region in front of the moving body by an image sensor which is mounted on the moving body and performs a multiple exposure; and

generating image data in which the multiple-exposure region in said imaging region is formed through the multiple exposure and a region other than the multiple-exposure region is not formed through the multiple exposure,

wherein the multiple-exposure region in said imaging region includes an image indicating the trajectory of movement of an object existing around the moving body.

11. An image processing system comprising:

an image generation device including:

a receiver which receives travel information about a travel state of a moving body; and

a controller which sets, based on the travel information received by the receiver, a multiple-exposure region in an imaging region obtained by imaging a region in front of the moving body by an image sensor, and generates image data in which the multiple exposure region in said imaging region is formed through a multiple exposure and a region other than the multiple-exposure region is not formed through the multiple exposure, the image sensor being mounted on the moving body and performing the multiple exposure; and

an image processor which converts a resolution of the image data,

wherein the multiple-exposure region in said imaging region includes an image indicating the trajectory of movement of an object existing around the moving body.

12. The image processing system according to claim 11 , wherein:

the image processor is connected to an active sensor so as to be capable of communicating with the active sensor, and the active sensor detects a predetermined object near the moving body based on a return wave resulting from a predetermined wave, the predetermined wave being emitted from the active sensor and returning to the active sensor as the return wave; and

when the image processor detects the predetermined object in the image data having a converted resolution, the image processor controls the active sensor based on a detection result.

13. The image processing system according to claim 11 , wherein: the controller controls the image sensor based on the multiple-exposure region that has been set.

14. The image processing system according to claim 11 , wherein:

the image sensor includes a plurality of pixels each belonging to a corresponding one of a plurality of segments that are predetermined and obtained by dividing a region of an image captured by the image sensor; and

the controller determines at least one of the plurality of segments as the multiple exposure region based on the travel information.

15. The image processing system according to claim 14 , wherein:

the controller further generates image format information of the image data; and

the image format information includes at least a resolution of an image obtained from the image sensor, the resolution of the image data, a total number of the plurality of segments, and a resolution of each of the plurality of segments.

16. The image processing system according to claim 15 , wherein:

the image generation device transmits the image format information to a transmission path in a vertical blanking period for the image data.

17. The image processing system according to claim 11 , wherein:

the travel information includes at least one of a steering angle of the moving body, an angular velocity around a pitch axis of the moving body, and a slope angle ahead of a traveling spot of the moving body.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 066703/0139 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2019
From: SHIBATA, OSAMU; IWAI, HIROSHI; NISHIMURA, KAZUKO; MIYAKE, YASUO; SATOU, YOSHIAKI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 050408/0560 →
Priority Claims (1)
JP JP2016-193050 · Sep 30, 2016 · national
Continuity (1)
Related Publication 20190362479A1 · Nov 28, 2019
Cited By (1)
US 12,375,826