IP Library Granted Patent US 11,190,781
Granted Patent B2
US 11,190,781 · App. 16/887,103 · Granted Nov 30, 2021

Adaptive resolution change in video processing

Inventors: Mohammed Golam Sarwer (San Mateo, CA); Jiancong Luo (San Mateo, CA); Yan Ye (San Mateo, CA)
Assignee: Alibaba Group Holding Limited
H04N19/30H04N19/105H04N19/132H04N19/172H04N19/423
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,190,781
App. No.
16/887,103
Granted
Nov 30, 2021
Kind
B2
Abstract

The present disclosure provides systems and methods for performing adaptive resolution change during video encoding and decoding. The methods include: comparing resolutions of a target picture and a first reference picture; in response to the target picture and the first reference picture having different resolutions, resampling the first reference picture to generate a second reference picture; and encoding or decoding the target picture using the second reference picture.

Claims (52)

1. A computer-implemented video processing method, comprising:

comparing resolutions of a target picture and a first reference picture, the first reference picture having at least a first version and a second version, the first version having an original resolution, and the second version having a maximum resolution allowed for resampling the first reference picture;

in response to the target picture and the first reference picture having different resolutions, resampling the second version of the first reference picture to generate a second reference picture; and

encoding or decoding the target picture using the second reference picture.

2. The method according to claim 1 , further comprising:

storing the second reference picture in a first buffer, the first buffer being different from a second buffer storing decoded pictures that are used for prediction of future pictures; and

removing the second reference picture from the first buffer after the encoding or decoding of the target picture is completed.

3. The method according to claim 1 , wherein encoding or decoding the target picture comprises:

encoding or decoding the target picture by using no more than a predetermined number of resampled reference pictures.

4. The method according to claim 3 , wherein encoding or decoding the target picture comprises:

signaling the predetermined number as part of a sequence parameter set or a picture parameter set.

5. The method according to claim 1 , further comprising:

storing the first version and the second version of the first reference picture in a decoded picture buffer; and

outputting the first version for coding future pictures.

6. The method according to claim 1 , wherein resampling the first reference picture to generate the second reference picture comprises:

generating the second reference picture in a supported resolution.

7. The method according to claim 6 , wherein further comprising:

signaling, as part of a sequence parameter set or a picture parameter set, information indicating:

a number of supported resolutions, and

pixel dimensions corresponding to the supported resolutions.

8. The method according to claim 7 , wherein the information comprises:

an index corresponding to at least one of the supported resolutions.

9. The method according to claim 7 , further comprising:

setting the number of supported resolutions based on a configuration of a video application or a video device.

10. The method according to claim 1 , wherein resampling the first reference picture to generate the second reference picture comprises:

performing progressive down-sampling of the first reference picture to generate the second reference picture.

11. A device, comprising:

one or more memories storing computer instructions; and

one or more processors configured to execute the computer instructions to cause the device to:

compare a resolution of a target picture to a resolution of a first reference picture, the first reference picture having at least a first version and a second version, the first version having an original resolution, and the second version having a maximum resolution allowed for resampling the first reference picture;

in response to the target picture and the first reference picture having different resolutions, resample the second version of the first reference picture to generate a second reference picture; and

encode or decode the target picture using the second reference picture.

12. The device according to claim 11 , wherein the one or more processors is further configured to execute the computer instructions to cause the device to:

store the second reference picture in a first buffer, the first buffer being different from a second buffer storing decoded pictures that are used for prediction of future pictures; and

remove the second reference picture from the first buffer after the encoding or decoding of the target picture is completed.

13. The device according to claim 11 , wherein the one or more processors is further configured to execute the computer instructions to cause the device to:

encode or decode the target picture by using no more than a predetermined number of resampled reference pictures.

14. The device according to claim 13 , wherein the one or more processors is further configured to execute the computer instructions to cause the device to:

signal the predetermined number as part of a sequence parameter set or a picture parameter set.

15. The device according to claim 11 , wherein the one or more processors is further configured to execute the computer instructions to cause the device to:

store the first version and the second version of the first reference picture in a decoded picture buffer; and

output the first version for coding future pictures.

16. The device according to claim 11 , wherein the one or more processors is further configured to execute the computer instructions to cause the device to:

generate the second reference picture in a supported resolution.

17. The device according to claim 16 , wherein the one or more processors is further configured to execute the computer instructions to cause the device to:

signal, as part of a sequence parameter set or a picture parameter set, information indicating:

a number of supported resolutions, and

pixel dimensions corresponding to the supported resolutions.

18. A non-transitory computer readable medium storing a set of instructions that is executable by at least one processor of a computer system to cause the computer system to perform a method for processing video content, the method comprising:

comparing resolutions of a target picture and a first reference picture, the first reference picture having at least a first version and a second version, the first version having an original resolution, and the second version having a maximum resolution allowed for resampling the first reference picture;

in response to the target picture and the first reference picture having different resolutions, resampling the second version of the first reference picture to generate a second reference picture; and

encoding or decoding the target picture using the second reference picture.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2020
From: SARWER, MOHAMMED GOLAM; LUO, JIANCONG; YE, YAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 054153/0279 →
Continuity (3)
Provisional Application 62865927 · Jun 24, 2019
Provisional Application 62900439 · Sep 13, 2019
Related Publication 20200404297A1 · Dec 24, 2020