IP Library Granted Patent US 11,640,718
Granted Patent B2
US 11,640,718 · App. 17/400,805 · Granted May 2, 2023

Capturing camera

Inventors: Yuma Kobayashi (Fukuoka, JP); Tetsuo Tanaka (Fukuoka, JP); Toshiaki Ito (Fukuoka, JP); Shinichi Murakami (Fukuoka, JP); Michinori Kishimoto (Fukuoka, JP); Hiroshi Mitani (Osaka, JP); Jyouji Wada (Fukuoka, JP)
Assignee: I-PRO CO., LTD.
B60R11/04G06V20/588G06V40/161H04N5/2254H04N5/2256B60R2300/103B60R2300/106B60R2300/8053
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,640,718
App. No.
17/400,805
Granted
May 2, 2023
Kind
B2
Abstract

A capturing device has a lens block that includes a lens for focusing light from a subject during a daytime, the subject includes a vehicle. The capturing device further includes an image sensor that captures an image based on light from the subject focused by the lens, and a processor that generates a face image of an occupant riding in the vehicle based on a first number of captured imaged of the subject which are captured by the image sensor at different times. The processor generates the face image of the occupant further based on a second number of captured images in which a luminance value of a region of interest is equal to or smaller than a threshold value among the first number of captured images of the subject.

Claims (54)

1. A capturing device comprising:

a lens block that includes a lens for focusing light from a subject during a daytime, the subject including a vehicle;

an image sensor configured to capture an image based on the light from the subject focused by the lens; and

a processor configured to generate a face image of an occupant riding in the vehicle based on an M number of captured images of the subject which are captured by the image sensor at different times, the M number being an integer equal to or greater than 2,

wherein the processor generates the face image of the occupant further based on an N number of captured images, among the M number of captured images, in which a luminance value of a region of interest is equal to or smaller than a threshold value, the luminance value of the region of interest indicating an amount of shadow present, and the N number being an integer equal to or smaller than the M number,

wherein,

when the luminance value is equal to or smaller than the threshold value, set an average luminance value of the N number of captured images as a composite luminance value, and

when the luminance value is greater than threshold, set an average value of M number of captured images as the composite luminance value, and

wherein the processor generates the face image of the occupant using the composite luminance value.

2. The capturing device according to claim 1 ,

wherein the processor, for each pixel that constitutes the region of interest, derives an averaged value of the N number of captured images and generates the face image of the occupant based on the averaged value for the each pixel.

3. The capturing device according to claim 1 ,

a value of the M number is predetermined.

4. The capturing device according to claim 1 ,

wherein the processor generates the M number of window glass images cut out from window glass parts in the M number of captured images of the subject, respectively.

5. The capturing device according to claim 4 ,

wherein the processor enlarges or reduces each size of the M number of window glass images so that each of the M number of window glass images has a same size as one another.

6. The capturing device according to claim 1 ,

wherein the region of interest is a position of a face of the occupant in the vehicle.

7. The capturing device according to claim 1 , further comprising:

a sensor configured to detect a daytime mode,

wherein the processor is configured to generate the face image of the occupant, when the sensor detects the daytime mode.

8. A capturing method comprising:

focusing light from a subject during a daytime, the subject including a vehicle;

capturing an image based on the light from the subject; and

generating a face image of an occupant riding in the vehicle based on an M number of captured images of the subject which are captured at different times, the M number being an integer equal to or greater than 2,

wherein the face image of the occupant is generated further based on an N number of captured images, among the M number of captured images, in which a luminance value of region of interest is equal to or smaller than a threshold value, the luminance value of the region of interest indicating an amount of shadow present, and the N number being an integer equal to or smaller than the M number,

wherein,

when the luminance value is equal to or smaller than the threshold value, set an average luminance value of the N number of captured images as a composite luminance value, and

when the luminance value is greater than threshold, set an average value of M number of captured images as the composite luminance value, and

wherein the processor generates the face image of the occupant using the composite luminance value.

9. A capturing device comprising:

a lens block that includes a lens for focusing light from a subject during a daytime, the subject including a vehicle;

an image sensor configured to capture an image based on the light from the subject focused by the lens; and

a processor configured to generate a face image of an occupant riding in the vehicle based on an M number of captured images of the subject which are captured by the image sensor at different times, the M number being an integer equal to or greater than 2,

wherein the processor

extracts a region of interest for each of the M number of captured images,

derives, for each pixel that constitutes the region of interest extracted from each of the M number of captured images, a luminance value,

when the luminance value of each of the M number of captured images is greater than a threshold value, derives an averaged luminance value for the M number of captured images, and sets the averaged luminance value for the M number of captured images as a composite luminance value,

when the luminance value of N number of captured images, among the M number of captures images, is equal to or less than the threshold value, derives an averaged luminance value for the N number of captured images, and sets the averaged luminance value for the N number of captured images as the composite luminance value, and

generates the face image of the occupant based on the composite luminance value for the each pixel.

10. The capturing device according to claim 9 ,

a value of the M number is predetermined.

11. The capturing device according to claim 9 ,

wherein the processor generates the M number of window glass images cut out from window glass parts in the M number of captured images of the subject, respectively.

12. The capturing device according to claim 11 ,

wherein the processor enlarges or reduces each size of the M number of window glass images so that each of the M number of window glass images has a same size as one another.

13. The capturing device according to claim 9 ,

wherein the region of interest is a position of a window glass on a front passenger seat side of the vehicle.

14. The capturing camera according to claim 9 , further comprising:

a sensor configured to detect a daytime mode,

wherein the processor is configured to generate the face image, when the sensor detects the daytime mode.

15. The capturing device according to claim 1 ,

wherein the N number of captured images are stored in a memory, and the processor aligns the N number of captured images stored in the memory, cuts out the region of interest included in each of the N number of captured images, and enlarges each region of interest cut out from the N number of captured images to a same size.

Assignments (2)
ADDRESS CHANGE Recorded Nov 1, 2022
From: I-PRO CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 061828/0350 →
CHANGE OF NAME Recorded Oct 31, 2022
From: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
To: I-PRO CO., LTD.
Reel/Frame 061824/0261 →
Priority Claims (1)
JP JP2018-185882 · Sep 28, 2018 · national
Continuity (2)
Division 16523604 · Jul 26, 2019
Related Publication 20210370847A1 · Dec 2, 2021