IP Library Granted Patent US 11,877,000
Granted Patent B2
US 11,877,000 · App. 17/629,093 · Granted Jan 16, 2024

Canvas size scalable video coding

Inventors: Taoran Lu (Santa Clara, CA); Fangjun Pu (Sunnyvale, CA); Peng Yin (Ithaca, NY); Sean Thomas McCarthy (San Francisco, CA); Tao Chen (Palo Alto, CA)
Assignee: DOLBY LABORATORIES LICENSING CORPORATION
H04N19/513H04N19/105H04N19/172H04N19/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,877,000
App. No.
17/629,093
Granted
Jan 16, 2024
Kind
B2
Abstract

Methods and systems for canvas size scalability across the same or different bitstream layers of a video coded bitstream are described. Offset parameters for a conformance window, a reference region of interest (ROI) in a reference layer, and a current ROI in a current layer are received. The width and height of a current ROI and a reference ROI are computed based on the offset parameters and they are used to generate a width and height scaling factor to be used by a reference picture resampling unit to generate an output picture based on the current ROI and the reference ROI.

Claims (26)

1. A method to decode a coded bitstream with scalable canvas size, the method performed by a processor and comprising, for a current picture:

receiving a current picture width and a current picture height comprising unsigned integer values;

receiving first offset parameters determining a rectangular area on the current picture, wherein the first offset parameters comprise signed integer values;

computing a current area width and a current area height for the rectangular area on the current picture based on the current picture width, the current picture height and the first offset parameters;

for a reference area, accessing a reference area width, a reference area height, a reference area left offset, and a reference area top offset;

computing a horizontal scaling factor based on the current area width and the reference area width;

computing a vertical scaling factor based on the current area height and the reference area height;

computing a left-offset adjustment and a top-offset adjustment of the current area based on the first offset parameters; and

performing motion compensation based on the horizontal and vertical scaling factors, the left-offset adjustment, the top-offset adjustment, the reference area left offset, and the reference area top offset, wherein accessing the reference area width and the reference area height, further comprises, for a reference picture:

accessing a reference picture width and a reference picture height;

receiving second offset parameters determining a rectangular area in the reference picture, wherein the second offset parameters comprise signed integer values;

computing the reference area width and the reference area height for the rectangular area in the reference picture based on the reference picture width, the reference picture height and the second offset parameters; and

computing the reference area left offset and the reference area top offset based on the second offset parameters.

2. The method of claim 1 , wherein the first offset parameters comprise a left offset, a top offset, a right offset, and a bottom offset.

3. The method of claim 2 , wherein one or more of the left offset, the top offset, the right offset, or the bottom offset comprise values between −2 14 and 2 14 .

4. The method of claim 2 , wherein computing the current area width comprises subtracting from the current picture width a first sum of the left offset and the right offset, and computing the current area height comprises subtracting from the current picture height a second sum of the top offset and the bottom offset.

5. The method of claim 1 , wherein computing the horizontal scaling factor (hori_scale_fp) comprises computing

hori_scale_ fp =((fRefWidth«14)+(fCurWidth»1))/fCurWidth

wherein fRefWidth denotes the reference area width and fCurWidth denotes the current area width.

6. The method of claim 1 , wherein performing motion compensation comprises computing

refxSb L =((( xSb −fCurLeftOffset)«4)+refMvLX[0])*hori_scale_ fp refx L =((Sign(refxSb L )*((Abs(refxSb L )+128)»8)+ x L *((hori_scale_ fp+ 8)»4))+32)»6+(fRefLeftOffset«4)refySb L =((( ySb −fCurTopOffset)«4)+refMvLX[1])*vert_scale_ fp refyL=((Sign(refySb L )*((Abs(refySb L )+128)»8)+ yL *((vert_scale_ fp+ 8)»4))+32)»6+(fRefTopOffset«4)

wherein hori_scale_fp denotes the horizontal scaling factor, vert_scale_fp denotes the vertical scaling fcator, fCurLeftOffset denotes the left-offset adjustment, fCurTopOffset denotes the top-offset adjustment, fRefLeftOffset denotes the reference area left offset, fRefTopOffset denotes the reference area top offset, and (refxSb L , refySb L ) and (refx L , refy L ) are luma locations pointed to by a motion vector (refMvLX[0], refMvLX[1]) given in 1/16-sample units.

7. The method of claim 1 , wherein the reference area comprises a reference picture.

8. The method of claim 1 , wherein the reference area width, the reference area height, the reference area left offset, and the reference area top offset are computed based on one or more of conformance window parameters for the reference picture, a reference picture width, a reference picture height, or region of interest offset parameters.

9. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing with one or more processors a method in accordance with claim 1 .

10. An apparatus comprising a processor and configured to perform the method of claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2022
From: LU, TAORAN; PU, FANGJUN; YIN, PENG; MCCARTHY, SEAN THOMAS; CHEN, TAO
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 058770/0312 →
Continuity (4)
Provisional Application 62945931 · Dec 10, 2019
Provisional Application 62902818 · Sep 19, 2019
Provisional Application 62883195 · Aug 6, 2019
Related Publication 20220385935A1 · Dec 1, 2022