IP Library Granted Patent US 11,034,305
Granted Patent B2
US 11,034,305 · App. 16/992,691 · Granted Jun 15, 2021

Image processing device, image display system, and image processing method

Inventor: Tadashi Yoshida (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
B60R1/12B60K35/00B60R1/04B60R11/04G06K9/00791G06K9/00845G06T7/74B60K2370/744B60R2001/1215B60R2001/1253B60R2300/105B60R2300/202B60R2300/303B60R2300/8026G06T2207/20132G06T2207/30201G06T2207/30252G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,034,305
App. No.
16/992,691
Granted
Jun 15, 2021
Kind
B2
Abstract

An image processing device includes: an obtainer which obtains, from an imaging device provided in a vehicle so as to be oriented to capture an image of an area behind the vehicle, an image captured by the imaging device; a position detector which detects a face position of a driver; and an image processor which performs image processing to clip, according to the face position detected by the position detector, an image having a range corresponding to the face position, out of a combined image including the image, and superimpose a position image indicating a position in the vehicle, on the image at a position corresponding to the face position, and outputs an image resulting from the image processing.

Claims (52)

1. An image processing device, comprising:

an obtainer which obtains a first image from an imaging device provided in a vehicle, the first image being captured by the imaging device, the imaging device being oriented to capture an image of an area behind the vehicle;

a position detector which detects a face position of a driver; and

an image processor which performs image processing to clip, according to the face position detected by the position detector, a second image having a range corresponding to the face position, out of a target image including the first image, and superimpose a position image on the second image at a position corresponding to the face position, and outputs a third image resulting from the image processing, the position image indicating a position in the vehicle, wherein

when the position detector detects that the face position has moved in one of left and right directions of the vehicle, the image processor moves a range in which the second image is to be clipped out of the target image to a position located in the other of the left and right directions of the vehicle relative to the range before the movement of the face position, and moves a position at which the position image is to be superimposed to a position located in the one of the left and right directions of the vehicle relative to the position before the movement of the face position.

2. The image processing device according to claim 1 , wherein

the image processor clips, out of the target image, a range estimated to be visible to the driver from the face position detected by the position detector via a display screen of a display device when the display screen is assumed to be a mirror, the display device being disposed in an interior of the vehicle.

3. The image processing device according to claim 1 , wherein

when the face position moves, the image processor sets a greater distance for a first distance of travel of the position at which the position image is to be superimposed than for a second distance of travel of the range in which the second image is to be clipped out of the target image.

4. The image processing device according to claim 1 , wherein

the image processor changes transparency of the position image according to predetermined input.

5. The image processing device according to claim 4 , further comprising:

an illuminance sensor which detects illuminance of an area around the vehicle, wherein

the predetermined input is the illuminance detected by the illuminance sensor, and

the image processor increases the transparency as the illuminance decreases.

6. The image processing device according to claim 1 , further comprising:

a storage in which a plurality of the position images of different types are stored, wherein

the image processor superimposes, on the second image, one or more position images selected in advance from among the plurality of the position images of the different types stored in the storage.

7. The image processing device according to claim 1 , further comprising:

a determiner which determines whether or not a following vehicle behind the vehicle is within a predetermined distance from the vehicle, wherein

when the determiner determines that the following vehicle is within the predetermined distance, the image processor does not superimpose the position image in the image processing.

8. An image display system, comprising:

the image processing device according to claim 1 ;

the imaging device; and

a display device which displays the third image output by the image processing device.

9. An image processing device, comprising:

an obtainer which obtains a first image from an imaging device provided in a vehicle, the first image being captured by the imaging device, the imaging device being oriented to capture an image of an area behind the vehicle;

a position detector which detects a face position of a driver; and

an image processor which performs image processing to clip, according to the face position detected by the position detector, a second image having a range corresponding to the face position, out of a target image including the first image, and superimpose a position image on the second image at a position corresponding to the face position, and outputs a third image resulting from the image processing, the position image indicating a position in the vehicle, wherein

the position image is smaller than the second image and is a schematic diagram illustrating an accessory of the vehicle, the accessory being located behind the driver.

10. The image processing device according to claim 9 , wherein

the image processor changes transparency of the position image according to predetermined input.

11. The image processing device according to claim 10 , further comprising:

an illuminance sensor which detects illuminance of an area around the vehicle, wherein

the predetermined input is the illuminance detected by the illuminance sensor, and

the image processor increases the transparency as the illuminance decreases.

12. The image processing device according to claim 9 , further comprising:

a storage in which a plurality of the position images of different types are stored, wherein

the image processor superimposes, on the second image, one or more position images selected in advance from among the plurality of the position images of the different types stored in the storage.

13. The image processing device according to claim 9 , further comprising:

a determiner which determines whether or not a following vehicle behind the vehicle is within a predetermined distance from the vehicle, wherein

when the determiner determines that the following vehicle is within the predetermined distance, the image processor does not superimpose the position image in the image processing.

14. An image display system, comprising:

the image processing device according to claim 9 ;

the imaging device; and

a display device which displays the third image output by the image processing device.

15. An image processing method, comprising:

obtaining a first image from an imaging device provided in a vehicle, the first image being captured by the imaging device, the imaging device being oriented to capture an image of an area behind the vehicle;

detecting a face position of a driver;

clipping, according to the face position detected, a second image having a range corresponding to the face position, out of a target image including the first image, and superimposing a position image on the second image at a position corresponding to the face position, the position image indicating a position in the vehicle;

performing image processing to, when the face position has moved in one of left and right directions of the vehicle, move a range in which the second image is to be clipped out of the target image to a position located in the other of the left and right directions of the vehicle relative to the range before the movement of the face position, and move a position at which the position image is to be superimposed to a position located in the one of the left and right directions of the vehicle relative to the position before the movement of the face position; and

outputting a third image resulting from the image processing.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 066703/0216 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2020
From: YOSHIDA, TADASHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 054569/0025 →