IP Library Granted Patent US 9,794,452
Granted Patent B2
US 9,794,452 · App. 14/890,507 · Granted Oct 17, 2017

Image processing apparatus, image processing method, and program

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,794,452
App. No.
14/890,507
Granted
Oct 17, 2017
Kind
B2
Abstract

Noise is sufficiently reduced in a moving image. A determination section determines, each time an input image is input, whether a change amount of a pixel value distribution in the input image and an output image that is output is smaller than a predetermined threshold value. A mixing ratio supply section supplies a value that becomes larger as the number of times the change amount is sequentially determined to be smaller than the predetermined threshold value becomes larger, the value serving as a mixing ratio of the output image in mixing of the input image and the output image. A mixing section mixes, each time the input image is input, the input image and the output image based on the supplied mixing ratio and outputs the input image and the output image to serve as a new output image.

Claims (44)

1. An image processing apparatus to generate a moving image with reduced noise, comprising:

an image processor configured to:

determine, each time an input image is input, whether a change amount of the motion of a pixel value distribution in the input image and an output image that is output, is smaller than a predetermined threshold value;

supply a value that becomes larger as the number of times the motion change amount is sequentially determined to be smaller than the predetermined threshold value becomes larger, the value serving as a mixing ratio of the output image in mixing of the input image and the output image; and

generate a mixed noise reduced moving image by mixing the input image and the output image based on the mixing ratio;

wherein the image processor mixes, each time the input image is input, the input image and the output image based on the supplied mixing ratio and outputs the mixed noise reduced moving image.

2. The image processing apparatus according to claim 1 , wherein the image processor is further configured to:

generate an upper limit value that becomes larger as the number of times becomes larger,

acquire a value that becomes smaller as the change amount becomes larger, and

supply, when the acquired value is larger than the upper limit value, the upper limit value to serve as the mixing ratio, and supply, when the acquired value does not exceed the upper limit value, the acquired value to serve as the mixing ratio.

3. The image processing apparatus according to claim 1 , wherein the image processor is further configured to:

supply the mixing ratio that becomes larger as the number of times becomes larger and at which a proportion of each of the input images mixed in the output image is made uniform.

4. The image processing apparatus according to claim 1 ,

wherein each of the input image and the output image is an image including a plurality of areas each including a plurality of pixels, and

wherein the image processor is further configured to:

determine, per area, whether the change amount is smaller than the predetermined threshold value,

acquire, per area, the number of times the change amount is sequentially determined to be smaller than the predetermined threshold value, and

supply the mixing ratio that becomes larger as a minimum value of the numbers of times acquired per area becomes larger.

5. The image processing apparatus according to claim 1 , wherein

each of the input image and the output image is an image including a plurality of pixels, and

the image processor is further configured to:

determine, per pixel, whether the change amount is smaller than the predetermined threshold value,

acquire, per pixel, the number of times the change amount is sequentially determined to be smaller than the predetermined threshold value, and

supply the mixing ratio that becomes larger as a minimum value of the numbers of times acquired per pixel becomes larger.

6. The image processing apparatus according to claim 5 , wherein the image processor is further configured to:

replace, when the pixel includes invalid data together with valid data indicating a pixel value, the invalid data not applying to the valid data, the invalid data within the pixel per pixel based on the number of times;

hold the output image in which the invalid data is replaced, and

acquire the number of times from the held output image.

7. An imaging apparatus to generate a moving image with reduced noise, comprising:

an image processor configured to:

determine, each time an input image is input, whether a change amount of the motion of a pixel value distribution in the input image and an output image that is output, is smaller than a predetermined threshold value;

generate a value that becomes larger as the number of times the motion change amount is sequentially determined to be smaller than the predetermined threshold value becomes larger, the value serving as a mixing ratio of the output image in mixing of the input image and the output image;

generate a mixed noise reduced moving image by mixing, each time the input image is input, the input image and the output image based on the supplied mixing ratio and outputting the mixed noise reduced moving image; and

hold the mixed noise reduced moving image.

8. An image processing method to generate a moving image with reduced noise, comprising:

a determination procedure of determining, each time an input image is input, whether a change amount of a pixel value distribution in the input image and an output image that is output is smaller than a predetermined threshold value;

a mixing ratio supply procedure of supplying, a value that becomes larger as the number of times the change amount is sequentially determined to be smaller than the predetermined threshold value becomes larger, the value serving as a mixing ratio of the output image in mixing of the input image and the output image;

a mixing procedure of mixing, each time the input image is input, the input image and the output image based on the supplied mixing ratio to generate a mixed noise reduced moving image; and

outputting the mixed noise reduced moving image.

9. A non-transitory computer-readable storage medium having instructions that, when executed by at least one computer, cause the at least one computer to execute instructions to generate a moving image with reduced noise comprising:

a determination procedure of determining, each time an input image is input, whether a change amount of a pixel value distribution in the input image and an output image that is output is smaller than a predetermined threshold value;

a mixing ratio supply procedure of supplying, a value that becomes larger as the number of times the change amount is sequentially determined to be smaller than the predetermined threshold value becomes larger, the value serving as a mixing ratio of the output image in mixing of the input image and the output image; and

a mixing procedure of mixing, each time the input image is input, the input image and the output image based on the supplied mixing ratio to generate a mixed noise reduced moving image; and

and output procedure of outputting the mixed noise reduced moving image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2016
From: SONY CORPORATION
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 039386/0277 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2015
From: NAGANO, HIROSUKE
To: SONY CORPORATION
Reel/Frame 037158/0377 →