IP Library Granted Patent US 11,979,600
Granted Patent B2
US 11,979,600 · App. 18/158,295 · Granted May 7, 2024

Encoder-side search ranges having horizontal bias or vertical bias

Inventors: Lihua Zhu (Mountain View, CA); Yongjun Wu (Bellevue, WA); Gary J. Sullivan (Bellevue, WA)
Assignee: Microsoft Technology Licensing, LLC
H04N19/52H04N19/105H04N19/11H04N19/119H04N19/159H04N19/162H04N19/167H04N19/176H04N19/51H04N19/593H04N19/61H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,979,600
App. No.
18/158,295
Granted
May 7, 2024
Kind
B2
Abstract

Innovations in encoder-side search ranges having horizontal bias or vertical bias are described herein. For example, a video encoder determines a block vector (“BV”) for a current block of a picture, performs intra prediction for the current block using the BV, and encodes the BV. The BV indicates a displacement to a region within the picture. When determining the BV, the encoder checks a constraint that the region is within a BV search range having a horizontal bias or vertical bias. The encoder can select the BV search range from among multiple available BV search ranges, e.g., depending at least in part on BV values of one or more previous blocks, which can be tracked in a histogram data structure.

Claims (40)

1. A computer system comprising one or more processing units and memory, wherein the computer system implements a video encoder configured to perform operations comprising:

encoding a current picture of a video sequence, thereby producing encoded data for the current picture, wherein the encoding the current picture includes:

determining a block vector (“BV”) value for a current block of a given coding tree block of the current picture, the BV value indicating a displacement to a region within the current picture, wherein the determining the BV value for the current block includes identifying the BV value for the current block subject to a constraint that the region is within a BV search range having a horizontal bias or a vertical bias, wherein, for the horizontal bias, the BV search range includes candidate BV values having a wider range of horizontal BV component values than vertical BV component values, and wherein, for the vertical bias, the BV search range includes candidate BV values having a wider range of vertical BV component values than horizontal BV component values;

performing intra block copy prediction for the current block using the BV value for the current block; and

encoding the BV value for the current block; and

outputting, as part of a bitstream, the encoded data for the current picture.

2. The computer system of claim 1 , wherein the BV search range has a vertical bias.

3. The computer system of claim 2 , wherein the given coding tree block has a dimension S, and wherein the BV search range has a height between S and 2S, inclusive.

4. The computer system of claim 3 , wherein the BV search range has a width between ¼S and ¾S, inclusive.

5. The computer system of claim 1 , wherein the BV search range has a horizontal bias.

6. The computer system of claim 4 , wherein the given coding tree block has a dimension S, and wherein the BV search range has a width between S and 2S, inclusive.

7. The computer system of claim 6 , wherein the BV search range has a height between ¼S and ¾S, inclusive.

8. The computer system of claim 1 , wherein the encoding the current picture further includes selecting the BV search range from among multiple available BV search ranges.

9. The computer system of claim 8 , wherein the selecting:

depends at least in part on BV values of one or more previous blocks of the current picture and/or one or more previous pictures; or

depends at least in part on BV values of one or more previous blocks, wherein the BV values of the one or more previous blocks are tracked in a histogram data structure.

10. The computer system of claim 8 , wherein the selecting depends at least in part on a user setting.

11. The computer system of claim 1 , wherein a 2N×2N block includes the current block, and wherein the encoding the current picture further includes identifying how to partition the 2N×2N block using a bottom-up approach that includes:

checking a subset of modes per N×N block of the 2N×2N block;

caching vector values for the respective N×N blocks of the 2N×2N block;

checking a subset of modes with a 2N-dimension for the 2N×2N block, including using the cached vector values;

selecting a best mode with a 2N-dimension for the 2N×2N block; and

selecting between the best mode with a 2N-dimension for the 2N×2N block and best modes for the respective N×N blocks of the 2N×2N block.

12. The computer system of claim 1 , wherein the determining the BV value for the current block includes:

identifying a current best location for prediction through iterative evaluation in a small neighborhood around the current best location, wherein the small neighborhood includes locations that are immediately adjacent horizontally or vertically to the current best location; and

confirming the current best location through iterative evaluation in successively larger neighborhoods around the current best location, wherein each of the larger neighborhoods includes locations in a ring outside the small neighborhood.

13. The computer system of claim 1 , wherein the current block is part of a current coding tree block having dimensions N×N, and wherein the encoding the current picture further includes identifying how to partition the current coding tree block into two partitions that have different dimensions.

14. The computer system of claim 1 , wherein the current block is part of a current slice of the current picture, and wherein the identifying the BV value for the current block is also subject to a constraint that the region is within the current slice.

15. In a computer system that implements a video decoder, a method comprising:

receiving encoded data, as part of a bitstream, for a current picture of a video sequence; and

decoding the current picture using the encoded data, wherein the decoding the current picture includes:

decoding a block vector (“BV”) value for a current block of a given coding tree block of the current picture, the BV value indicating a displacement to a region within the current picture, wherein the BV value for the current block is subject to a constraint that the region is within a BV search range having a horizontal bias or a vertical bias, wherein, for the horizontal bias, the BV search range includes candidate BV values having a wider range of horizontal BV component values than vertical BV component values, and wherein, for the vertical bias, the BV search range includes candidate BV values having a wider range of vertical BV component values than horizontal BV component values; and

performing intra block copy prediction for the current block using the BV value for the current block.

16. The method of claim 15 , wherein the BV search range has a horizontal bias, wherein the given coding tree block has a dimension S, and wherein the BV search range has a width between S and 2S, inclusive.

17. The method of claim 15 , wherein the current block is part of a current slice of the current picture, the BV value for the current block is also subject to a constraint that the region is within the current slice.

18. One or more non-transitory computer-readable media having stored thereon encoded data, in a bitstream, for a current picture of a video sequence, the encoded data including data representing a block vector (“BV”) value for a current block of a given coding tree block of the current picture, the BV value indicating a displacement to a region within the current picture, wherein the BV value for the current block is subject to a constraint that the region is within a BV search range having a horizontal bias or a vertical bias, wherein, for the horizontal bias, the BV search range includes candidate BV values having a wider range of horizontal BV component values than vertical BV component values, and wherein, for the vertical bias, the BV search range includes candidate BV values having a wider range of vertical BV component values than horizontal BV component values, the encoded data being organized to facilitate decoding of the current picture by operations that include:

decoding the BV value for the current block; and

performing intra block copy prediction for the current block using the BV value for the current block.

19. The one or more computer-readable media of claim 18 , wherein the BV search range has a horizontal bias, wherein the given coding tree block has a dimension S, and wherein the BV search range has a width between S and 2S, inclusive.

20. The one or more computer-readable media of claim 18 , wherein the current block is part of a current slice of the current picture, and wherein the BV value for the current block is also subject to a constraint that the region is within the current slice.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2023
From: ZHU, LIHUA; WU, YONGJUN; SULLIVAN, GARY J.
To: MICROSOFT CORPORATION
Reel/Frame 062788/0646 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2023
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 062788/0678 →
Continuity (5)
Continuation 17581446 · Jan 21, 2022
Continuation 14455856 · Aug 8, 2014
Provisional Application 61954572 · Mar 17, 2014
Provisional Application 61928970 · Jan 17, 2014
Related Publication 20230164349A1 · May 25, 2023
Cited By (3)
US 12,316,860 US 12,375,711 US 12,413,771