IP Library Granted Patent US 9,729,871
Granted Patent B2
US 9,729,871 · App. 13/940,637 · Granted Aug 8, 2017

Video image decoding apparatus and video image encoding system

Inventor: Kazuhito Sakomizu (Tokyo, JP)
Assignee: Oki Electric Industry Co., Ltd.
H04N19/00569H04N19/31H04N19/395H04N19/50H04N19/573H04N19/587H04N19/103H04N19/436H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,729,871
App. No.
13/940,637
Granted
Aug 8, 2017
Kind
B2
Abstract

A video image decoding apparatus includes a plurality of predicted image generating units that generate predicted images according to respectively different methods. A predicted image combining unit combines the predicted images generated by the predicted image generating units to obtain a predicted image. A decoding unit decodes an encoded image by using, as side information, the predicted image obtained by the predicted image combining unit.

Claims (55)

1. A video image decoding apparatus, comprising:

a processor; and

a non-transitory storage medium containing program instructions, execution of which by the processor causes the video image decoding apparatus to provide functions of

a plurality of predicted image generating units each configured to

generate a predicted image according to one of a plurality of different methods,

estimate an image quality of the generated predicted image, and

output the estimated image quality as image quality information, which includes a plurality of image quality values each corresponding to a pixel of the generated predicted image, together with the generated predicted image;

a predicted image combining unit configured to generate a combined predicted image that is a weighted average of the generated predicted images, by, for each pixel of the combined predicted image,

determining a plurality of pixels, each in one of the generated predicted images at a same pixel location as that of said each pixel in the combined predicted image,

weighting a pixel value of each determined pixel by the image quality value corresponding to said each determined pixel, and

summing the weighted pixel values; and

a decoding unit configured to decode an encoded image by using, as side information, the combined predicted image obtained by the predicted image combining unit.

2. The video image decoding apparatus according to claim 1 , wherein the execution of the program instructions by the processor causes the video image decoding apparatus to further provide functions of a key frame decoding unit configured to decode a key frame encoded image produced by encoding a key frame,

wherein the decoding unit decodes a non-key frame encoded image produced by encoding a non-key frame, and

the predicted image generating units generate the predicted images using at least the decoded key frame.

3. The video image decoding apparatus according to claim 2 , wherein

at least one of the predicted image generating units generates a predicted image using a hash provided from a corresponding video image encoding apparatus.

4. The video image decoding apparatus according to claim 3 , wherein

at least one of the predicted image generating units generates a predicted image from decoded key frames at previous and following times, and

at least another of the predicted image generating units generates a predicted image from the hash and one of the decoded key frame at the previous time, the decoded key frame at the following time, and the decoded key frames at the previous and following times.

5. The video image decoding apparatus according to claim 1 , wherein

each of the predicted image generating units estimates the image quality based on each pixel in the predicted image, and outputs the estimated image quality as the image quality information.

6. The video image decoding apparatus according to claim 1 , wherein

the video image decoding apparatus is provided with a hash from a corresponding video image encoding apparatus, and

each of the predicted image generating units generates a hash from the generated predicted image, and generates the image quality information by using a difference between the generated hash and the provided hash as an estimated value of the image quality.

7. The video image decoding apparatus according to claim 1 , wherein

the video image decoding apparatus is provided with a hash from a corresponding video image encoding apparatus, and

each of the predicted image generating units generates an image from a hash from a time used to estimate a motion vector, obtains an evaluation value of the motion vector used to generate the predicted image between the image generated from the hash and the predicted image, and generates the image quality information using the evaluation value as an estimated value of the image quality.

8. The video image decoding apparatus according to claim 7 ,

wherein each of the predicted image generating units calculates, as the evaluation value of the motion vector, one of a sum of absolute differences between pixel values of each pixel and a mean of absolute differences between pixel values of each pixel between the image generated from the hash and the predicted image.

9. A video image decoding apparatus, comprising:

a processor; and

a non-transitory storage medium containing program instructions, execution of which by the processor causes the video image decoding apparatus to provide functions of

a plurality of predicted image generating units each configured to

generate a predicted image according to one of a plurality of different methods,

estimate an image quality of the generated predicted image, and

output the estimated image quality as image quality information, which includes a plurality of image quality values each corresponding to a pixel of the generated predicted image, together with the generated predicted image;

a predicted image combining unit configured to generate a combined predicted image by, for each pixel of the combined predicted image,

determining a plurality of pixels, each in one of the generated predicted images at a same pixel location as that of said each pixel in the combined predicted image,

obtaining on pixel, among the plurality of determined pixels, that has a highest image quality value corresponding thereto based on the image quality information, and

setting a pixel value of the obtained pixel as a pixel value of said each pixel of the combined predicted image, and

a decoding unit configured to decode an encoded image by using, as side information, the combined predicted image obtained by the predicted image combining unit.

10. The video image decoding apparatus according to claim 9 ,

wherein each of the predicted image generating units estimates the image quality based on each pixel in the predicted image, and outputs the estimated image quality as the image quality information.

11. The video image decoding apparatus according to claim 9 ,

wherein the video image decoding apparatus is provided with a hash from a corresponding video image encoding apparatus, and

each of the predicted image generating units generates a hash from the generated predicted image, and generates the image quality information by using a difference between the generated hash and the provided hash as an estimated value of image quality.

12. The video image decoding apparatus according to claim 9 ,

wherein the video image decoding apparatus is provided with a hash from a corresponding video image encoding apparatus, and

each of the predicted image generating units generates an image from a hash from a time used to estimate a motion vector, obtains an evaluation value of the motion vector used to generate the predicted image between the image generated from the hash and the predicted image, and generates the image quality information using the evaluation value as an estimated value of image quality.

13. The video image decoding apparatus according to claim 12 ,

wherein each of the predicted image generating units calculates, as the evaluation value of the motion vector, one of a sum of absolute differences between pixel values of each pixel and a mean of absolute differences between pixel values of each pixel between the image generated from the hash and the predicted image.

14. A video image encoding system, comprising:

the video image decoding apparatus according to claim 1 ; and

a corresponding video image encoding apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2013
From: SAKOMIZU, KAZUHITO
To: OKI ELECTRIC INDUSTRY CO., LTD.
Reel/Frame 030787/0124 →
Priority Claims (1)
JP 2012-168411 · Jul 30, 2012 · national
Continuity (1)
Related Publication 20140029666A1 · Jan 30, 2014