IP Library Granted Patent US 9,838,665
Granted Patent B2
US 9,838,665 · App. 14/513,729 · Granted Dec 5, 2017

Image processing device, imaging device, and image processing program

Inventors: Kiyoshige Shibazaki (Higashimurayama, JP); Muneki Hamashima (Fukaya, JP); Susumu Mori (Tokyo, JP); Kenichi Ishiga (Tokyo, JP)
Assignee: NIKON CORPORATION
H04N13/0037H04N9/045H04N13/0203H04N13/0217H04N13/0257H04N2013/0077
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,838,665
App. No.
14/513,729
Granted
Dec 5, 2017
Kind
B2
Abstract

An image processing apparatus is provided, that is configured to: extract a first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image, at a target pixel position from image data having the first pixel value; extract second and third luminance values corresponding to second and third viewpoints that are different from the first viewpoint, at the target pixel position from luminance image data having the second and third luminance values; and calculate at least any of second and third pixel values of the second and third viewpoints such that a relational expression between the second or third pixel value and the first pixel value extracted by the pixel value extracting unit remains correlated with a relational expression defined by the second and third luminance values.

Claims (44)

1. An image processing apparatus comprising:

a pixel value extracting unit that extracts a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;

a luminance value extracting unit that extracts a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and

a calculating unit that calculates at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a ratio between the second pixel value and the first pixel value extracted by the pixel value extracting unit or a ratio between the third pixel value and the first pixel value remains correlated with (ii) a ratio defined by the second luminance value and the third luminance value.

2. The image processing apparatus according to claim 1 , wherein the calculating unit calculates at least any of the second pixel value and the third pixel value according to calculation formulae:

P C2 =2 P C1 ×P B2 /( P B2 +P B3 )

P C3 =2 P C1 ×P B3 /( P B2 +P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

3. The image processing apparatus according to claim 1 , wherein the calculating unit calculates at least any of the second pixel value and the third pixel value according to calculation formulae:

P C2 =P C1 ×P B2 /√( P B2 ×P B3 )

P C3 =P C1 ×P B3 /√( P B2 ×P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

4. The image processing apparatus according to claim 1 , wherein the first pixel value extracted by the pixel value extracting unit, and each of the second luminance value and the third luminance value extracted by the luminance value extracting unit are linear gradation values that are proportional to a received light amount.

5. An image processing apparatus comprising:

a pixel value extracting unit that extracts a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;

a luminance value extracting unit that extracts a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and

a calculating unit that calculates at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a difference between the second pixel value and the first pixel value extracted by the pixel value extracting unit or a difference between the third pixel value and the first pixel value remains correlated with (ii) a difference between the second luminance value and the third luminance value.

6. The image processing apparatus according to claim 5 , wherein the calculating unit calculates at least any of the second pixel value and the third pixel value according to:

P C2 −P C1 =k ( P B2 −P B3 )

P C3 −P C1 =k ( P B3 −P B2 )

(P C1 : first pixel value, P C2 : second pixel value, P C3 : third pixel value, P B2 : second luminance value, P B3 : third luminance value, k: proportionality coefficient).

7. The image processing apparatus according to claim 5 , wherein the first pixel value extracted by the pixel value extracting unit, and each of the second luminance value and the third luminance value extracted by the luminance value extracting unit are gamma-converted values.

8. A non-transitory computer-readable medium having stored thereon an image processing program that causes a computer to:

extract a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;

extract a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and

calculate at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a ratio between the second pixel value and the first pixel value extracted in the extracting of the first pixel value or a ratio between the third pixel value and the first pixel value remains correlated with (ii) a ratio defined by the second luminance value and the third luminance value.

9. The non-transitory computer-readable medium according to claim 8 , wherein at least any of the second pixel value and the third pixel value are calculated according to calculation formulae:

P C2 =2 P C1 ×P B2 /( P B2 +P B3 )

P C3 =2 P C1 ×P B3 /( P B2 +P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

10. The non-transitory computer-readable medium according to claim 8 , wherein at least any of the second pixel value and the third pixel value are calculated according to calculation formulae:

P C2 =P C1 ×P B2 /√( P B2 ×P B3 )

P C3 =P C1 ×P B3 /√( P B2 ×P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

11. The non-transitory computer-readable medium according to claim 8 , wherein the first pixel value, and each of the second luminance value and the third luminance value are linear gradation values that are proportional to a received light amount.

12. A non-transitory computer-readable medium having stored thereon an image processing program that causes a computer to:

extract a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;

extract a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and

calculate at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a difference between the second pixel value and the first pixel value extracted in the extracting of the first pixel value or a difference between the third pixel value and the first pixel value remains correlated with (ii) a difference between the second luminance value and the third luminance value.

13. The non-transitory computer-readable medium according to claim 12 , wherein at least any of the second pixel value and the third pixel value are calculated according to:

P C2 −P C1 =k ( P B2 −P B3 )

P C3 −P C1 =k ( P B3 −P B2 )

(P C1 : first pixel value, P C2 : second pixel value, P C3 : third pixel value, P B2 : second luminance value, P B3 : third luminance value, k: proportionality coefficient).

14. The non-transitory computer-readable medium according to claim 12 , wherein the first pixel value, and each of the second luminance value and the third luminance value are gamma-converted values.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE TITLE PREVIOUSLY RECORDED ON REEL 034596 FRAME 0199. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 27, 2015
From: SHIBAZAKI, KIYOSHIGE; HAMASHIMA, MUNEKI; MORI, SUSUMU; ISHIGA, KENICHI
To: NIKON CORPORATION
Reel/Frame 034825/0970 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2014
From: SHIBAZAKI, KIYOSHIGE; HAMASHIMA, MUNEKI; MORI, SUSUMU; ISHIGA, KENICHI
To: NIKON CORPORATION
Reel/Frame 034596/0199 →
Priority Claims (4)
JP 2012-100467 · Apr 25, 2012 · national
JP 2012-100472 · Apr 25, 2012 · national
JP 2012-100474 · Apr 25, 2012 · national
JP 2012-100476 · Apr 25, 2012 · national
Continuity (2)
Continuation PCTJP2013002831 · Apr 25, 2013
Related Publication 20150103144A1 · Apr 16, 2015