IP Library › Granted Patent US 11,641,464
Granted Patent B2
US 11,641,464 · App. 17/699,014 · Granted May 2, 2023

Scaling window in video coding

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Zhipin Deng (Beijing, CN); Jizheng Xu (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/132H04N19/159H04N19/176H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,641,464
App. No.
17/699,014
Granted
May 2, 2023
Kind
B2
Abstract

An example method of video processing includes determining, for a conversion between a current picture of a video and a bitstream of the video, a scaling ratio based on a first window in the current picture and a second window in a reference picture associated with the current picture; resampling the reference picture by using the determined scaling ratio; and performing the conversion based on the result of the resampling, wherein a dimension of the first window is W×H and a dimension of the second window is W′×H′, where W, H, W′ and H′ are integers, and wherein W, H, W′ and H′ satisfy a constraint.

Claims (53)

1. A method of video processing, comprising:

determining, for a conversion between a current picture of a video and a bitstream of the video,

a size of a current window of the current picture based on a first set of offset values,

determining, for a reference picture associated with the current picture, a size of a reference window of the reference picture based on a second set of offset values, and

performing the conversion based on the size of a current window and the size of the reference window,

wherein indications of the first set of offset values and the second set of offset values are included in the bitstream,

wherein the size of a current window and the size of the reference window satisfy a constraint, and

wherein a width of the current window is W, and a width of the reference window is W′, and the constraint specifies that W′/a≤W≤W′×b, and wherein a and b are positive integers.

2. The method of claim 1 , wherein the current window and the reference window are scaling windows which are used to derive a scaling ratio in an inter prediction.

3. The method of claim 1 , wherein a height of the current window is H, and a height of the reference window is H′, and

wherein the constraint specifies that H′/a≤H≤H′×b.

4. The method of claim 3 , wherein a is equal to 2, and b is equal to 8.

5. The method of claim 1 , wherein indications of the first set of offset values and the second set of offset values are included in picture parameter sets (PPS) of the bitstream.

6. The method of claim 1 , wherein a top offset and a left offset of the first set of offset values and a location of a top left sample of a current block in the current picture are used to determine a location of a reference sample associated with a first sample in the current block.

7. The method of claim 2 , wherein different sets of offset values are used for indicating a conformance window and a scaling window respectively, and

wherein samples outside the conformance window are disposable when outputting the video.

8. The method of claim 1 , wherein the conversion includes encoding the current picture into the bitstream.

9. The method of claim 1 , wherein the conversion includes decoding the current picture from the bitstream.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current picture of a video and a bitstream of the video,

a size of a current window of the current picture based on a first set of offset values,

determine, for a reference picture associated with the current picture, a size of a reference window of the reference picture based on a second set of offset values, and

perform the conversion based on the size of a current window and the size of the reference window,

wherein indications of the first set of offset values and the second set of offset values are included in the bitstream,

wherein the size of a current window and the size of the reference window satisfy a constraint, and

wherein a width of the current window is W, and a width of the reference window is W′, and the constraint specifies that W′/a≤W≤W′×b, and wherein a and b are positive integers.

11. The apparatus of claim 10 , wherein the current window and the reference window are scaling windows which are used to derive a scaling ratio in an inter prediction.

12. The apparatus of claim 10 , wherein a height of the current window is H, and a height of the reference window is H′, and

wherein the constraint specifies that H′/a≤H≤H′×b.

13. The apparatus of claim 12 , wherein a is equal to 2, and b is equal to 8.

14. The apparatus of claim 10 , wherein indications of the first set of offset values and the second set of offset values are included in picture parameter sets (PPS) of the bitstream.

15. The apparatus of claim 10 , wherein a top offset and a left offset of the first set of offset values and a location of a top left sample of a current block in the current picture are used to determine a location of a reference sample associated with a first sample in the current block.

16. The apparatus of claim 11 , wherein different sets of offset values are used for indicating a conformance window and a scaling window respectively, and

wherein samples outside the conformance window are disposable when outputting the video.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current picture of a video and a bitstream of the video,

a size of a current window of the current picture based on a first set of offset values,

determine, for a reference picture associated with the current picture, a size of a reference window of the reference picture based on a second set of offset values, and

perform the conversion based on the size of a current window and the size of the reference window,

wherein indications of the first set of offset values and the second set of offset values are included in the bitstream,

wherein the size of a current window and the size of the reference window satisfy a constraint, and

wherein a width of the current window is W, and a width of the reference window is W′, and the constraint specifies that W′/a≤W≤W′×b, and wherein a and b are positive integers.

18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current picture of the video, a size of a current window of the current picture based on a first set of offset values,

determining, for a reference picture associated with the current picture, a size of a reference window of the reference picture based on a second set of offset values, and

generating the bitstream based on the size of a current window and the size of the reference window,

wherein indications of the first set of offset values and the second set of offset values are included in the bitstream,

wherein the size of a current window and the size of the reference window satisfy a constraint, and

wherein a width of the current window is W, and a width of the reference window is W′, and the constraint specifies that W′/a≤W≤W′×b, and wherein a and b are positive integers.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the current window and the reference window are scaling windows which are used to derive a scaling ratio in an inter prediction.

20. The non-transitory computer-readable storage medium of claim 17 , wherein a height of the current window is H, and a height of the reference window is H′, and

wherein the constraint specifies that H′/a≤H≤H′×b.

21. The non-transitory computer-readable storage medium of claim 20 , wherein a is equal to 2, and b is equal to 8.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2022
From: ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 059323/0273 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2022
From: LIU, HONGBIN; DENG, ZHIPIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059323/0334 →
Priority Claims (2)
WO PCT/CN2019/106671 · Sep 19, 2019 · international
WO PCT/CN2019/109837 · Oct 5, 2019 · international
Continuity (2)
Continuation PCTCN2020116468 · Sep 21, 2020
Related Publication 20220217328A1 · Jul 7, 2022
Cited By (6)
US 12,395,661 US 12,407,812 US 12,425,597 US 12,483,691 US 12,615,394 US 12,726,651