IP Library Granted Patent US 7,970,227
Granted Patent B2
US 7,970,227 · App. 11/778,939 · Granted Jun 28, 2011

Image processing apparatus, image processing method, and computer program

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,970,227
App. No.
11/778,939
Granted
Jun 28, 2011
Kind
B2
Abstract

An image processing apparatus that generates one output image front plural input images includes a detecting unit that detects a positional relation among the plural input images, a pixel-value calculating unit that calculates a pixel value of a pixel of the output image using pixel values of pixels of the input images and an interpolation function, a determining unit that determines whether the pixel of the output image is a motion pixel, and an adjusting unit that adjusts a high-pass characteristic of the interpolation function on the basis of a result of the determination on whether the pixel of the output, image is a motion pixel.

Claims (39)

1. An image processing apparatus that generates one output image from plural input images, the image processing apparatus comprising:

detecting means for detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

pixel-value calculating means for calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images and an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation;

determining means for determining whether the pixel of the output image is a motion pixel that is a pixel in an area in which a moving subject appears; and

adjusting means for adjusting a high-pass characteristic of the interpolation function on the basis of a result of the determination on whether the pixel of the output image is a motion pixel.

2. An image processing apparatus according to claim 1 , wherein the determining means determines, with a near area in a range near from a position of the pixel of the output image in the input images after the positioning set as a determination area used for determining whether the pixel of the output image is the motion pixel, whether the pixel of the output image is the motion pixel on the basis of pixel values of pixels in the determination area among the pixels of the input images after the positioning.

3. An image processing apparatus according to claim 1 , further comprising influence-parameter calculating means for calculating, with a near area in a range near from a position of the pixel of the output image in the input images after the positioning set as an influential area used for calculating an influence parameter indicating a degree of an influence of the pixel values of the pixels of the input images after the positioning on the pixel value of the pixel of the output image, the influence parameter on the basis of pixels values of pixels in the influential area among the pixels of the input images after the positioning, wherein

the pixel-value calculating means calculates the pixel value of the pixel of the output image using the pixel values of the pixels of the input images, the interpolation function, and the influence parameter.

4. An image processing method of generating one output image from plural input images, the image processing method comprising the steps of:

detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images and an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation;

determining whether the pixel of the output image is a motion pixel that is a pixel in an area in which a moving subject appears; and

adjusting a high-pass characteristic of the interpolation function on the basis of a result of the determination on whether the pixel of the output image is a motion pixel.

5. A non-transitory computer-readable medium encoded with a computer program loadable into a memory of a computer, the computer program causing the computer to execute an image processing for generating an output image from plural input images, the image processing comprising:

a step of detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

a step of calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images and an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation;

a step of determining whether the pixel of the output image is a motion pixel that is a pixel in an area in which a moving subject appears; and

a step of adjusting a high-pass characteristic of the interpolation function on the basis of a result of the determination on whether the pixel of the output image is a motion pixel.

6. An image processing apparatus that generates one output image from plural input images, the image processing apparatus comprising:

detecting means for detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

pixel-value calculating means for calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images, an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation, and an influence parameter indicating a degree of an influence of the pixel values of the pixels of the input images after the positioning on the pixel value of the pixel of the output image; and

influence-parameter calculating means for calculating, with a near area in a range near from a position of the pixel of the output image in the input images after the positioning set as an influential area used for calculating the influence parameter, the influence parameter on the basis of pixels values of pixels in the influential area among the pixels of the input images after the positioning.

7. An image processing method of generating one output image from plural input images, the image processing method comprising the steps of:

detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images, an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation, and an influence parameter indicating a degree of an influence of the pixel values of the pixels of the input images after the positioning on the pixel value of the pixel of the output image; and

calculating, with a near area in a range near from a position of the pixel of the output image in the input images after the positioning set as an influential area used for calculating the influence parameter, the influence parameter on the basis of pixels values of pixels in the influential area among the pixels of the input images after the positioning.

8. A non-transitory computer-readable medium encoded with a computer program loadable into a memory of a computer, the computer program causing the computer to execute an image processing for generating an output image from plural input images, the image processing comprising:

a step of detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

a step of calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images, an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation, and an influence parameter indicating a degree of an influence of the pixel values of the pixels of the input images after the positioning on the pixel value of the pixel of the output image; and

a step of calculating, with a near area in a range near from a position of the pixel of the output image in the input images after the positioning set as an influential area used for calculating the influence parameter, the influence parameter on the basis of pixels values of pixels in the influential area among the pixels of the input images after the positioning.

9. An image processing apparatus that generates one output image from plural input images, the image processing apparatus comprising:

a detecting unit detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

a pixel-value calculating unit calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images and an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation;

a determining unit determining whether the pixel of the output image is a motion pixel that is a pixel in an area in which a moving subject appears; and

an adjusting unit adjusting a high-pass characteristic of the interpolation function on the basis of a result of the determination on whether the pixel of the output image is a motion pixel.

10. An image processing apparatus that generates one output image from plural input images, the image processing apparatus comprising:

a detecting unit detecting a positional relation among the plural input images photographed by imaging means for photographing an image;

a pixel-value calculating unit calculating a pixel value of a pixel of the output image using pixel values of pixels of the input images, an interpolation function that changes according to positions of the pixels of the input images after positioning obtained by performing positioning of the plural input images on the basis of the positional relation, and an influence parameter indicating a degree of an influence of the pixel values of the pixels of the input images after the positioning on the pixel value of the pixel of the output image; and

an influence-parameter calculating unit calculating, with a near area in a range near from a position of the pixel of the output image in the input images after the positioning set as an influential area used for calculating the influence parameter, the influence parameter on the basis of pixels values of pixels in the influential area among the pixels of the input images after the positioning.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2016
From: SONY CORPORATION
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 040419/0001 →