IP Library Granted Patent US 9,965,834
Granted Patent B2
US 9,965,834 · App. 15/338,046 · Granted May 8, 2018

Image processing apparatus and image acquisition apparatus

Inventors: Masao Sambongi (San Jose, CA); Norimichi Tsumura (Chiba, JP); Mayu Yokoya (Osaka, JP)
Assignees: OLYMPUS CORPORATION; NATIONAL UNIVERSITY CORPORATION CHIBA UNIVERSITY
G06T5/005G06T5/50G06T7/514G06T7/593H04N5/232G06T2207/10004G06T2207/10052G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,965,834
App. No.
15/338,046
Filed
Oct 28, 2016
Granted
May 8, 2018
Kind
B2
Art Unit
2668
USPC
382/275
Abstract

Provided is an image processing apparatus including a transformation unit that is configured to deform images so that corresponding points in a plurality of images obtained from several viewpoints with respect to the same subject are matched; a separating unit that is configured to separate specular-reflection components from the plurality of images transformed by the transformation unit and create an image from which the specular-reflection component is removed; and an image reconstructing unit that is configured to combine at least one of the specular-reflection components of the plurality of images, separated by the separating unit, and the image from which the specular-reflection component is removed.

Claims (12)

1. An image processing apparatus comprising:

a transformation unit that is configured to deform images so that corresponding points in a plurality of images obtained from several viewpoints with respect to the same subject are matched;

a separating unit that is configured to separate specular-reflection components from the plurality of images transformed by the transformation unit and create an image from which the specular-reflection component is removed; and

an image reconstructing unit that is configured to combine at least one of the specular-reflection components of the plurality of images, separated by the separating unit, and the image from which the specular-reflection component is removed.

2. An image processing apparatus according to claim 1 , wherein the separating unit comprises: a difference-image creating unit that is configured to create a difference image between a reference image selected from the plurality of transformed images transformed by the transformation unit and another transformed image; a threshold-value setting unit that is configured to set a threshold value on the basis of the difference image created by the difference-image creating unit; a reflection-component separation unit that is configured to extract the specular-reflection components from the plurality of transformed images by using the threshold value set by the threshold-value setting unit; and a removed-image creating unit that is configured to remove, from the transformed images, the specular-reflection components extracted by the reflection-component separating unit and perform interpolation processing of the images after removal to create the image from which the specular-reflection component is removed.

3. An image processing apparatus according to claim 2 , wherein the threshold-value setting unit is configured to extract, at each pixel, a maximum pixel value in the plurality of difference images and sets the threshold on the basis of a histogram of the maximum pixel values.

4. An image processing apparatus according to claim 1 , wherein the image reconstructing unit that is configured to add the image from which the specular-reflection component is removed and any one of the specular-reflection components selected from the specular-reflection components of the plurality of images.

5. An image processing apparatus according to claim 1 , wherein the image reconstructing unit that is configured to add the image from which the specular-reflection component has been removed and a plurality of the specular-reflection components selected from the specular-reflection components of the plurality of images.

6. An image processing apparatus according to claim 1 , wherein the image reconstructing unit that is configured to add the image from which the specular-reflection component has been removed and a plurality of the specular-reflection components disposed at positions that overlap each other, selected from the specular-reflection components of the plurality of images.

7. An image acquisition apparatus comprising an image obtaining unit that is configured to obtain a plurality of images with several viewpoints with respect to the same subject; and an image processing apparatus according to claim 1 .

8. An image acquisition apparatus according to claim 7 , wherein the image obtaining unit comprises a plurality of cameras arranged in an array in directions intersecting the optical axis.

9. An image acquisition apparatus according to claim 7 , wherein the image obtaining unit comprises an image-capturing lens that collects light from the subject; an image-capturing element that captures the light collected by the image-capturing lens; and a microlens array disposed between the image-capturing element and the image-capturing lens and formed by arraying a plurality of microlenses two-dimensionally in directions intersecting the optical axis.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: SAMBONGI, MASAO; TSUMURA, NORIMICHI; YOKOYA, MAYU
To: OLYMPUS CORPORATION; NATIONAL UNIVERSITY CORPORATION CHIBA UNIVERSITY
Reel/Frame 040163/0330 →
Priority Claims (1)
JP 2014-095253 · May 2, 2014 · national
Continuity (2)
Continuation PCTJP2015063072 · May 1, 2015
Related Publication 20170046819A1 · Feb 16, 2017