IP Library Granted Patent US 10,171,821
Granted Patent B2
US 10,171,821 · App. 14/905,525 · Granted Jan 1, 2019

Scalable video encoding method and apparatus and scalable video decoding method and apparatus using up-sampling filter accompanied by conversion of bit depth and color format

Inventors: Elena Alshina (Suwon-si, KR); Chan-yul Kim (Bucheon-si, KR); Alexander Alshin (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/187H04N19/105H04N19/117H04N19/137H04N19/159H04N19/33H04N19/44H04N19/59H04N19/593H04N19/80H04N19/463
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,171,821
App. No.
14/905,525
Granted
Jan 1, 2019
Kind
B2
Abstract

A video encoding method including determining a phase shift between pixels of an enhancement layer image and a reference layer image, according to a scaling factor between the enhancement layer image and the reference layer image and a color format of the enhancement layer; selecting at least one filter coefficient set corresponding to the phase shift, from filter coefficient data including filter coefficient sets; generating an up-sampled reference layer image by extending a resolution of the reference layer image according to the scaling factor by performing interpolation filtering on the reference layer image by using the filter coefficient set; obtaining a prediction error between the up-sampled reference layer image and the enhancement layer image; generating an enhancement layer bitstream including the prediction error and a scalable codec; and generating a base layer bitstream by encoding the base layer images.

Claims (48)

1. A scalable video encoding method comprising:

determining a reference layer image from among base layer images so as to inter layer predict an enhancement layer image, wherein the reference layer image corresponds to the enhancement layer image;

determining a phase between pixels of the enhancement layer image and the reference layer image, according to a scaling factor between the enhancement layer image and the reference layer image and a color format difference of the enhancement layer image and the reference layer image;

selecting at least one filter coefficient set corresponding to the determined phase, from filter coefficient data comprising filter coefficient sets that respectively correspond to phases;

generating an up-sampled reference layer image by extending a resolution of the reference layer image according to the scaling factor by performing interpolation filtering on the reference layer image by using the selected filter coefficient set;

obtaining a prediction error between the up-sampled reference layer image and the enhancement layer image;

generating an enhancement layer bitstream comprising the prediction error; and

generating a base layer bitstream by encoding the base layer images.

2. The scalable video encoding method of claim 1 , wherein the generating of the up-sampled reference layer image comprises converting a bit depth of the reference layer image so that the up-sampled reference layer image corresponds to a bit depth of the enhancement layer image.

3. The scalable video encoding method of claim 1 , wherein the determining of the phase between the pixels comprises:

determining a phase between a luma pixel of the reference layer image and a luma pixel of the enhancement layer image according to the scaling factor; and

determining a phase between a chroma pixel of the reference layer image and a chroma pixel of the enhancement layer image according to the scaling factor and the color format of the enhancement layer.

4. The scalable video encoding method of claim 3 , wherein the determining of the phase between the chroma pixels comprises:

determining a chroma pixel ratio according to the scaling factor and the color format difference; and

determining the phase between the chroma pixel of the reference layer image and the chroma pixel of the enhancement layer image according to the chroma pixel ratio.

5. The scalable video encoding method of claim 1 , further comprising determining, from the reference layer image, positions of samples used in the interpolation filtering.

6. A scalable video decoding method comprising:

determining a reference layer image from among base layer images obtained by decoding a base layer bitstream comprising encoded base layer images, wherein the reference layer image corresponds to an enhancement layer image;

obtaining a scaling factor between the enhancement layer image and the reference layer image and a color format difference of the enhancement layer image and the reference layer image and a prediction error for inter layer prediction of the enhancement layer image by decoding an enhancement layer bitstream;

determining a phase between pixels of the enhancement layer image and the reference layer image based on the scaling factor and the color format difference;

selecting at least one filter coefficient set corresponding to the determined phase, from filter coefficient data comprising filter coefficient sets that respectively correspond to phases;

generating an up-sampled reference layer image by extending a resolution of the reference layer image according to the scaling factor by performing, the interpolation filtering on the reference layer image according to the selected filter coefficient set; and

reconstructing the enhancement layer image by using the prediction error and the up-sampled reference layer image.

7. The scalable video decoding method of claim 6 , wherein the generating of the up-sampled reference layer image comprises converting a bit depth of the reference layer image so that the up-sampled reference layer image corresponds to a bit depth of the enhancement layer image.

8. The scalable video decoding method of claim 6 , wherein the determining of the phase between the pixels comprises:

determining a phase between a luma pixel of the reference layer image and a luma pixel of the enhancement layer image according to the scaling factor; and

determining a phase between a chroma pixel of the reference layer image and a chroma pixel of the enhancement layer image according to the scaling factor and the color format of the enhancement layer.

9. The scalable video decoding method of claim 8 , wherein the determining of the phase between the chroma pixels comprises:

determining a chroma pixel ratio according to the scaling factor and the color format difference; and

determining the phase between the chroma pixel of the reference layer image and the chroma pixel of the enhancement layer image according to the chroma pixel ratio.

10. The scalable video decoding method of claim 8 , wherein the converting of the color format comprises converting the color format of the enhancement layer image, so that a ratio of a luma pixel to two chroma pixels is 4:2:2 or 4:4:4.

11. The scalable video decoding method of claim 6 , further comprising determining, from the reference layer image, positions of samples used in the interpolation filtering.

12. A scalable video encoding apparatus comprising:

a filter data storage unit configured to store filter coefficient sets that respectively correspond to phases;

a filter selector configured to determine a phase between a pixel of a reference layer image and a pixel of an enhancement layer image, based on a scaling factor between the reference layer image selected from a base layer and the enhancement layer image corresponding to the reference layer image, and a color format difference of the enhancement layer image and the reference layer image, and to select, from data of the filter coefficient sets, a filter coefficient set corresponding to the determined phase;

an up-sampling unit configured to perform interpolation filtering on the reference layer image by using the selected filter coefficient set;

a prediction error obtainer configured to obtain a prediction error between the up-sampled reference layer image and the enhancement layer image;

a base layer encoder configured to generate a base layer bitstream by performing encoding on the base layer image; and

an enhancement layer encoder configured to generate an enhancement layer bitstream comprising the prediction error.

13. A scalable video decoding apparatus comprising:

a filter data storage unit configured to store filter coefficient sets that respectively correspond to phases;

an enhancement layer decoder configured to obtain, from an enhancement layer bitstream, a prediction error between an up-sampled reference layer image and an enhancement layer image, a scaling factor between the enhancement layer image and a reference layer image and a color format difference of the enhancement layer image and the reference layer image;

a base layer bitstream decoder configured to generate a base layer image from a base layer bitstream;

a filter selector configured to select, from among filter coefficient sets stored in the filter data storage unit, a filter coefficient set corresponding to a phase between pixels of the enhancement layer image and the reference layer image based on the scaling factor and the color format difference;

an up-sampling unit configured to obtain the up-sampled reference layer image by performing the interpolation filtering on the reference layer image according to the selected filter coefficient set; and

an enhancement layer obtainer configured to obtain the enhancement layer image by using the prediction error and the up-sampled reference layer image.

14. A computer-readable recording medium having recorded thereon a program for executing the video encoding method of claim 1 .

15. A computer-readable recording medium having recorded thereon a program for executing the video decoding method of claim 6 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2016
From: ALSHINA, ELENA; KIM, CHAN-YUL; ALSHIN, ALEXANDER
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 037543/0675 →
Continuity (2)
Provisional Application 61846701 · Jul 16, 2013
Related Publication 20160156912A1 · Jun 2, 2016