IP Library Granted Patent US 12,047,591
Granted Patent B2
US 12,047,591 · App. 17/607,348 · Granted Jul 23, 2024

Resolution-adaptive video coding

Inventors: Yu-Chen Sun (Bellevue, WA); Tsui-shan Chang (Hangzhou, CN); Jian Lou (Bellevue, WA)
Assignee: Alibaba Group Holding Limited
H04N19/33H04N19/105H04N19/139H04N19/176H04N19/52H04N19/59H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,047,591
App. No.
17/607,348
Granted
Jul 23, 2024
Kind
B2
Abstract

Systems and methods are provided for implementing inter-coded resolution-adaptive video coding supported by resizing motion information of a current frame during motion prediction, reducing extensive computational costs and computing time that would be incurred as a result of extensive application of interpolation filters to generate picture information of a reference frame to sub-pixel granularity, and thus reducing computational cost and computing time of decoding as a whole. The methods and systems described herein include determining a ratio of the resolution of a reference frame to the resolution of a current frame; determining a motion vector of the block of the current frame, and calculating at least one pixel coordinate corresponding to the motion vector of the block of the current frame; resizing motion information of the block of the current frame according to a resolution of the reference frame in accordance with the ratio; locating a predictor block of the reference frame in accordance with the resized motion information; and subsequently minimizing or avoiding applying an interpolation filter to a block at the scaled coordinates at the reference frame to generate sub-pixel values of the predictor block.

Claims (37)

1. A method comprising:

determining motion information of a block of a current frame, the motion information comprising a motion vector of the block and at least one pixel coordinate corresponding to the motion vector;

resizing the motion information according to a resolution of a reference frame, the resizing the motion information according to the resolution of the reference frame including scaling at least one pixel coordinate corresponding to the motion vector by a ratio of a resolution of the reference frame to a resolution of a current frame, to derive at least one scaled coordinate corresponding to the motion vector;

locating a predictor block of the reference frame in accordance with the resized motion information, the locating the predictor block of the reference frame including:

determining that a video decoder supports a quarter-pixel accuracy; and

rounding the at least one scaled coordinate each to respective nearest values on a quarter-pixel scale; and

performing motion prediction on a current block by reference to the located predictor block.

2. The method of claim 1 , further comprising determining that the resolution of the reference frame is different from a resolution of the current frame, and determining a ratio of the resolution of the reference frame to the resolution of the current frame.

3. The method of claim 2 , wherein determining the at least one pixel coordinate corresponding to the motion vector comprises adding the motion vector to at least one pixel coordinate of the block.

4. The method of claim 1 , wherein locating the predictor block of the reference frame comprises rounding the at least one scaled coordinate each to respective nearest values on an integer pixel scale.

5. The method of claim 1 , wherein locating the predictor block of the reference frame comprises rounding at least one scaled coordinate each to respective nearest values on a sub-pixel scale.

6. The method of claim 5 , wherein an interpolation filter accurate to the sub-pixel scale is applied to the reference frame at the at least one scaled coordinate before performing motion prediction on the current block by reference to the located predictor block.

7. A system comprising:

one or more processors; and

memory communicatively coupled to the one or more processors, the memory storing computer-executable modules executable by the one or more processors that, when executed by the one or more processors, perform associated operations, the computer-executable modules including:

a motion prediction module comprising a motion information determining submodule configured to determine motion information of a block of a current frame, the motion information comprising a motion vector of the block and at least one pixel coordinate corresponding to the motion vector;

a motion information resizing submodule configured to resize the motion information according to a resolution of a reference frame by scaling the at least one pixel coordinate corresponding to the motion vector by a ratio of a resolution of the reference frame to a resolution of a current frame, to derive at least one scaled coordinate corresponding to the motion vector; and

a predictor block locating submodule configured to locate a predictor block of the reference frame in accordance with the resized motion information by:

determining that a video decoder supports a quarter-pixel accuracy; and

rounding the at least one scaled coordinate each to respective nearest values on a quarter-pixel scale,

wherein the motion prediction module is further configured to perform motion prediction on a current block by reference to the located predictor block.

8. The system of claim 7 , wherein the motion prediction module further comprises a resolution comparing submodule configured to determine that the resolution of the reference frame is different from a resolution of the current frame, and a ratio determining submodule configured to determine a ratio of the resolution of the reference frame to the resolution of the current frame.

9. The system of claim 8 , wherein the motion information determining submodule is configured to determine the at least one pixel coordinate corresponding to the motion vector by adding the motion vector to at least one pixel coordinate of the block.

10. The system of claim 7 , wherein the predictor block locating submodule is configured to locate the predictor block of the reference frame by rounding the at least one scaled coordinate each to respective nearest values on an integer pixel scale.

11. The system of claim 7 , wherein the predictor block locating submodule is configured to locate the predictor block of the reference frame by rounding the at least one scaled coordinate each to a respective nearest value on a sub-pixel scale.

12. The system of claim 11 , further comprising an interpolation filter applying submodule configured to apply an interpolation filter accurate to the sub-pixel scale to the reference frame at the at least one scaled coordinate before the motion prediction module performs motion prediction on the current block by reference to the located predictor block.

13. A computer-readable storage medium storing computer-readable instructions executable by one or more processors, that when executed by the one or more processors, cause the one or more processors to perform operations comprising:

determining motion information of a block of a current frame, the motion information comprising a motion vector of the block and at least one pixel coordinate corresponding to the motion vector;

resizing the motion information according to a resolution of a reference frame, the resizing the motion information according to the resolution of the reference frame including scaling at least one pixel coordinate corresponding to the motion vector by a ratio of a resolution of the reference frame to a resolution of a current frame, to derive at least one scaled coordinate corresponding to the motion vector;

locating a predictor block of the reference frame in accordance with the resized motion information, the locating the predictor block of the reference frame including:

determining that a video decoder does not support a quarter-pixel accuracy and supports a half-pixel accuracy; and

rounding the at least one scaled coordinate each to respective nearest values on a half-pixel scale; and

performing motion prediction on a current block by reference to the located predictor block.

14. The computer-readable storage medium of claim 13 , wherein the operations further comprise determining that the resolution of the reference frame is different from a resolution of the current frame, and determining a ratio of the resolution of the reference frame to the resolution of the current frame.

15. The computer-readable storage medium of claim 14 , wherein determining the at least one pixel coordinate corresponding to the motion vector comprises adding the motion vector to at least one pixel coordinate of the block.

16. The computer-readable storage medium of claim 13 , wherein locating the predictor block of the reference frame comprises rounding the at least one scaled coordinate each to a respective nearest value on a sub-pixel scale.

17. The computer-readable storage medium of claim 16 , wherein an interpolation filter accurate to the sub-pixel scale is applied to the reference frame at the at least one scaled coordinate before performing motion prediction on the current block by reference to the located predictor block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: CLOUD INTELLIGENCE ASSETS HOLDING (SINGAPORE) PRIVATE LIMITED
Reel/Frame 075478/0225 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2024
From: SUN, YUCHEN; CHANG, TSUISHAN; LOU, JIAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 066843/0206 →
Continuity (1)
Related Publication 20220224925A1 · Jul 14, 2022