IP Library Patent Application 15457358
Patent Application
App. No. 15/457,358

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND NON-TRANSITORY RECORDING MEDIUM STORING PROGRAM

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/457,358
Abstract

The processor calculates a first phase difference between a first light and a first reflection light, and a second phase difference between a second light and a second reflection light, generates a first distance image and a second distance using the first phase difference and the second phase difference, respectively, generates a first intensity image and a second intensity image for each of pixel of the first distance image and pixel of the second distance image, respectively, compares light receiving intensity for each pixel of the first intensity image with light receiving intensity for a corresponding pixel of the second intensity image, selects a pixel from the first distance image and a corresponding pixel of the second distance image based on the comparison, and generates a synthesized distance image using the selected pixels.

Claims (52)

1 . An image processing apparatus comprising:

a light emitter that emits first light and second light at different timings towards an object present within an angle of view of the image processing apparatus, the first light emits a first light emission amount for a first exposure time, the second light emits a second light emission amount for a second exposure time, and the first and second light emission amounts or the first and second exposure times are different from each other;

a light receiving sensor that receives first reflection light which is the first light reflected by the object, and second reflection light which is the second light reflected by the object; and

a processor that

calculates a first phase difference between the first light and the first reflection light,

generates a first distance image using the first phase difference,

generates a first intensity image in which light receiving intensity of the first reflection light received by the light receiving sensor is represented for each pixel of the first distance image,

calculates a second phase difference between the second light and the second reflection light,

generates a second distance image using the second phase difference,

generates a second intensity image in which light receiving intensity of the second reflection light received by the light receiving sensor is represented for each pixel of the second distance image,

compares the light receiving intensity for each pixel of the first intensity image with the light receiving intensity for a corresponding pixel of the second intensity image,

selects a pixel from the first distance image and a corresponding pixel of the second distance image based on the comparison, and

generates a synthesized distance image using the selected pixels.

2 . The image processing apparatus according to claim 1 , wherein the processor further

extracts a first pixel from the first distance image, the first pixel corresponding to a pixel having light receiving intensity of the first reflection light within a predetermined range in the first intensity image,

extracts a second pixel from the second distance image, the second pixel corresponding to a pixel having light receiving intensity of the second reflection light within the predetermined range in the second intensity image,

compares the light receiving intensity within the predetermined range for the first pixel with the light receiving intensity within the predetermined range for the second pixel,

based on the comparison, selects a pixel having higher light receiving intensity from the first pixel and the second pixel when both of the first pixel and the second pixel are valid pixels, and

generates the synthesized distance image using the selected pixel having the higher light receiving intensity.

3 . The image processing apparatus according to claim 2 , wherein

based on the comparison, when only one of the first pixel and the second pixel is a valid pixel, the processor generates the synthesized distance image using the valid pixel among the first pixel and the second pixel.

4 . The image processing apparatus according to claim 2 , wherein

the predetermined range is equal to or more than a first threshold.

5 . The image processing apparatus according to claim 2 , wherein

the predetermined range is equal to or less than a second threshold.

6 . The image processing apparatus according to claim 2 , wherein

the predetermined range is a range between a first threshold to a second threshold, both inclusive.

7 . An image processing method comprising:

emitting first light and second light at different timings towards an object present within an angle of view of image capture, the first light emitting in a first light emission amount for a first exposure time, the second light emitting in a second light emission amount for a second exposure time, and the first and second light emission amounts or the first and second exposure times are different from each other;

receiving first reflection light which is the first light reflected by the object, and second reflection light which is the second light reflected by the object;

calculating a first phase difference between the first light and the first reflection light;

generating a first distance image using the first phase difference;

generating a first intensity image in which light receiving intensity of the received first reflection light is represented for each pixel of the first distance image;

calculating a second phase difference between the second light and the second reflection light;

generating a second distance image using the second phase difference;

generating a second intensity image in which light receiving intensity of the received second reflection light is represented for each pixel of the second distance image;

comparing the light receiving intensity for each pixel of the first intensity image with the light receiving intensity for a corresponding pixel of the second intensity image;

selecting a pixel from the first distance image and a corresponding pixel of the second distance image based on the comparison; and

generating a synthesized distance image using the selected pixels.

8 . A non-transitory recording medium storing an image processing program,

the program causes a processor to:

emit first light and second light at different timings towards an object present within an angle of view of image capture, the first light emits in a first light emission amount for a first exposure time, the second light emits in a second light emission amount for a second exposure time, and the first and second light emission amounts or the first and second exposure times are different from each other;

receive first reflection light which is the first light reflected by the object, and second reflection light which is the second light reflected by the object;

calculate a first phase difference between the first light and the first reflection light;

generate a first distance image using the first phase difference;

generate a first intensity image in which light receiving intensity of the received first reflection light is represented for each pixel of the first distance image;

calculate a second phase difference between the second light and the second reflection light;

generate a second distance image using the second phase difference;

generate a second intensity image in which light receiving intensity of the received second reflection light is represented for each pixel of the second distance image;

compare the light receiving intensity for each pixel of the first intensity image with the light receiving intensity for a corresponding pixel of the second intensity image;

select a pixel from the first distance image and a corresponding pixel of the second distance image based on the comparison; and

generate a synthesized distance image using the selected pixels.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2018
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: SOVEREIGN PEAK VENTURES, LLC
Reel/Frame 048268/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2017
From: MATSUI, SHUHEI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 042311/0409 →