IP Library Granted Patent US 9,819,947
Granted Patent B2
US 9,819,947 · App. 14/581,488 · Granted Nov 14, 2017

Methods, apparatus and systems for scalable video coding with mixed interlace and progressive content

Inventors: Yan Ye (San Diego, CA); Yong He (San Diego, CA); Yuwen He (San Diego, CA); Ralph Neff (San Diego, CA)
Assignee: VID SCALE, INC.
H04N19/196H04N19/117H04N19/139H04N19/16H04N19/172H04N19/174H04N19/513H04N19/33H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,819,947
App. No.
14/581,488
Granted
Nov 14, 2017
Kind
B2
Abstract

Methods, apparatus, and systems for video coding/decoding are disclosed. One representative method includes a decoder receiving video content including at least a base layer (BL), an enhancement layer (EL) and phase information. The phase information includes an indicator indicating one or more sets of phase parameters from among plural sets of phase parameters. The method further includes assembling the BL into an inter-layer reference (ILR) picture based on the video content and the received phase information, selecting one or both of the ILR picture or an EL reference picture, and predicting a current EL picture using the phase information and one or more of the selected ILR picture or the selected EL reference picture.

Claims (52)

1. A video decoding method implemented in a video decoder, comprising:

receiving a video signal including base layer video content comprising interlaced field pictures and enhancement layer video content comprising progressive frame pictures;

storing one or more sets of cross layer phase alignment parameters for use in resampling a video picture;

assembling one or more progressive frame inter-layer reference (ILR) pictures for use in predicting at least one progressive frame picture in the enhancement layer based on a field picture in the base layer and one or more of the sets of stored cross layer phase alignment parameters; and

predicting an enhancement layer picture using the ILR picture.

2. The method of claim 1 wherein the interlaced field pictures comprise top field pictures and bottom field pictures.

3. The method of claim 1 further comprising using a first set of the one or more sets of stored cross layer phase alignment parameters to resample a top field picture and using a second set of the one or more sets of stored cross layer phase alignment parameters to resample a bottom field picture.

4. The method of claim 1 wherein each of the stored one or more sets of cross layer phase alignment parameters comprises:

phaseX information that is used to select horizontal phase filters for a luma component of the one or more ILR reference pictures;

phaseXC information that is used to select horizontal phase filters for at least one of the chroma components of the one or more ILR reference pictures;

phaseY information that is used to select vertical phase filters for the luma component of the one or more ILR reference pictures; and/or

phaseYC information that is used to select vertical phase filters for at least one of the chroma components of the one or more ILR reference pictures.

5. The method of claim 1 further comprising:

receiving a number indicator indicating a number of sets of cross layer phase alignment parameters that are being transmitted.

6. The method of claim 1 further comprising:

receiving at least one index indicator indicating at least one set of cross layer phase alignment parameters from among the stored one or more sets of cross layer phase alignment parameters to be used in assembling the at least one ILR picture.

7. The method of claim 6 wherein the at least one index indicator is received in a slice segment header.

8. The method of claim 6 wherein the assembling of the one or more ILR pictures includes:

selecting the phase filters for resampling of at least one of the luma and/or chroma components of the one or more ILR pictures based on the at least one set of cross layer phase alignment parameters indicated by the received at least one index indicator.

9. The method of claim 8 wherein the at least one index indicator is associated with a slice of the video signal, and the method further comprises adjusting at least one of the horizontal phase filters and vertical phase filters for a slice in the base layer video content for use in assembling the ILR picture in accordance with the index indicator associated with the slice.

10. The method of claim 1 further comprising receiving via signaling the one or more sets of cross layer phase alignment parameters to be stored.

11. The method of claim 10 wherein the one or more sets of cross layer phase alignment parameters to be stored are received in a Video Parameter Set (VPS).

12. The method of claim 10 wherein the one or more sets of cross layer phase alignment parameters to be stored are received in a Picture Parameter Set (PPS).

13. The method of claim 8 further comprising:

receiving via signaling a flag indicator indicating whether the at least one index indicator is being signaled.

14. The method of claim 1 further comprising:

receiving a flag indicator that indicates whether the one or more sets of cross layer phase alignment parameters are signaled.

15. The method of claim 14 wherein a first state of the flag indicator that indicates whether the one or more sets of cross layer phase alignment parameters are signaled indicates that the one or more sets of cross layer phase alignment parameters are not signaled and that the one or more sets of cross layer phase alignment parameters are to be inferred.

16. The method of claim 15 wherein the inferred one or more sets of cross layer phase alignment parameters comprise a set including a luma horizontal phase parameter, a luma vertical phase parameter, a chroma horizontal phase parameter, and a chroma vertical phase parameter, wherein the luma horizontal phase parameter, the luma vertical phase parameter, and the chroma horizontal phase parameter have the same value, and the chroma horizontal phase parameter and the chroma vertical phase parameter values have different values from each other.

17. The method of claim 15 wherein the inferred one or more sets of cross layer phase alignment parameters is a set comprising:

phaseX information that is used to select horizontal phase filters for a luma component of the one or more ILR reference pictures is 0;

phaseXC information that is used to select horizontal phase filters for at least one of the chroma components of the one or more ILR reference pictures is 0;

phaseY information that is used to select vertical phase filters for the luma component of the one or more ILR reference pictures is 0; and

phaseYC information that is used to select vertical phase filters for at least one of the chroma components of the one or more ILR reference pictures is 1.

18. A video encoding method implemented in a video encoder, comprising:

transmitting a video signal including base layer video content comprising interlaced field pictures and enhancement layer video content comprising progressive frame pictures; and

transmitting one or more sets of cross layer phase alignment parameters for use in resampling a video picture in the base layer for use by a video decoder in assembling one or more progressive frame inter-layer reference (ILR) pictures for predicting at least one progressive frame picture in the enhancement layer based on a field picture in the base layer and one or more of the sets of cross layer phase alignment parameters.

19. The method of claim 18 wherein each of the one or more sets of cross layer phase alignment parameters comprises:

phaseX information that is used to select horizontal phase filters for a luma component of the ILR reference picture;

phaseXC information that is used to select horizontal phase filters for at least one of the chroma components of the ILR reference picture;

phaseY information that is used to select vertical phase filters for the luma component of the ILR reference picture; and/or

phaseYC information that is used to select vertical phase filters for at least one of the chroma components of the ILR reference picture.

20. The method of claim 18 further comprising:

transmitting a number indicator indicating a number of sets of phase values that are being transmitted.

21. The method of claim 18 further comprising transmitting at least one index indicator indicating at least one set of cross layer phase alignment parameters from among the one or more sets of cross layer phase alignment parameters to be used in assembling the ILR picture.

22. The method of claim 21 wherein the at least one index indicator is transmitted in a slice segment header.

23. The method of claim 18 wherein the plurality of sets of cross layer phase alignment parameters are transmitted in a Picture Parameter Set (PPS).

24. The method of claim 23 further comprising:

transmitting a flag indicator indicating whether the at least one index indicator is being signaled.

25. The method of claim 18 further comprising:

transmitting a flag indicator that indicates whether the one or more sets of cross layer phase alignment parameters are signaled or inferred.

26. The method of claim 25 wherein the inferred one or more sets of cross layer phase alignment parameters comprises a set including a luma horizontal phase parameter, a luma vertical phase parameter, a chroma horizontal phase parameter, and a chroma vertical phase parameter, wherein the luma horizontal phase parameter, the luma vertical phase parameter, and the chroma horizontal phase parameter have the same value, and the chroma horizontal phase parameter and the chroma vertical phase parameter have different values from each other.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INVENTOR NAMES ORIGINALLY SUBMITTED ON THE COVER AS:YAN YEYUNG HEYUWEN HERALPH NEFF PREVIOUSLY RECORDED ON REEL 035788 FRAME 0633. ASSIGNOR(S) HEREBY CONFIRMS THE INVENTOR NAMES AS CORRECTLY LISTED ON THE ASSIGNMENT:YAN YEYONG HEYUWEN HERALPH NEFF. Recorded Oct 22, 2018
From: YE, YAN; HE, YONG; HE, YUWEN; NEFF, RALPH
To: VID SCALE, INC.
Reel/Frame 047287/0170 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2015
From: YE, YAN; HE, YUNG; HE, YUWEN; NEFF, RALPH
To: VID SCALE, INC
Reel/Frame 035788/0633 →
Continuity (3)
Provisional Application 61939217 · Feb 12, 2014
Provisional Application 61923110 · Jan 2, 2014
Related Publication 20150189298A1 · Jul 2, 2015