IP Library Granted Patent US 12,267,490
Granted Patent B2
US 12,267,490 · App. 17/470,407 · Granted Apr 1, 2025

Tile level filtering in video coding

Inventors: Ye-Kui Wang (San Diego, CA); Jianle Chen (San Diego, CA); Fnu Hendry (San Diego, CA)
Assignee: Huawei Technologies Co., Ltd.
H04N19/117H04N19/105H04N19/119H04N19/132H04N19/137H04N19/159H04N19/172H04N19/174H04N19/176H04N19/184H04N19/186H04N19/46H04N19/52H04N19/593H04N19/70H04N19/82H04N19/86H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,490
App. No.
17/470,407
Granted
Apr 1, 2025
Kind
B2
Abstract

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a flag and a picture including a tile with a tile boundary. The tile is decoded. Filtering operations are performed across the tile boundary when the flag is set to a first value. The filtering operations across the tile boundary are omitted when the flag is set to a second value. The tile is forwarded for display as part of a decoded video sequence.

Claims (48)

1. A method implemented by a decoder, the method comprising:

receiving a bitstream comprising a first flag, a second flag, and a picture including a tile with a tile boundary and a sub-picture with a sub-picture boundary;

deriving a motion vector predictor candidate list for a current block by excluding a collocated motion vector from the motion vector predictor candidate list when the collocated motion vector points outside of the sub-picture and when a flag is set to indicate the sub-picture is treated as a picture, wherein the collocated motion vector is included in a collocated block from a collocated picture;

decoding the tile and the sub-picture based on the motion vector predictor candidate list;

enabling filtering operations across the tile boundary when the first flag is set to a first value;

disabling the filtering operations across the tile boundary when the first flag is set to a second value;

enabling filtering operations across the sub-picture boundary when the second flag is set to a third value; and

disabling the filtering operations across the sub-picture boundary when the second flag is set to a fourth value,

wherein the first flag is denoted as a loop_filter_across_tiles_enabled_flag, and wherein the loop_filter_across_tiles_enabled_flag is obtained from a picture parameter set (PPS) in the bitstream.

2. The method of claim 1 , wherein the second flag is denoted as loop_filter_across_subpic_enabled_flag.

3. The method of claim 1 , wherein the loop_filter_across_tiles_enabled_flag is set to one when specifying the filtering operations are enabled across tile boundaries in pictures referring to the PPS, and wherein the loop_filter_across_tiles_enabled_flag is set to zero when specifying the filtering operations are disabled across tile boundaries in pictures referring to the PPS.

4. The method of claim 1 , wherein the filtering operations include an adaptive loop filter (ALF).

5. The method of claim 1 , wherein the filtering operations include a sample adaptive offset (SAO) filter.

6. The method of claim 1 , wherein the filtering operations include a deblocking filter.

7. The method of claim 1 , wherein the tile boundary includes one or more edges of the tile.

8. A method implemented in an encoder, the method comprising:

partitioning a picture into a tile with a tile boundary and a sub-picture with a sub-picture boundary;

setting a first flag in a bitstream to indicate whether filtering operations are performed across the tile boundary;

deriving a motion vector predictor candidate list for a current block by excluding a collocated motion vector from the motion vector predictor candidate list when the collocated motion vector points outside of the sub-picture and when a flag is set to indicate the sub-picture is treated as a picture, wherein the collocated motion vector is included in a collocated block from a collocated picture;

encoding the tile and the sub-picture in the bitstream based on the motion vector predictor candidate list;

setting a second flag in the bitstream to indicate whether filtering operations are performed across the sub-picture boundary; and

storing the bitstream for communication toward a decoder,

wherein the first flag is denoted as a loop_filter_across_tiles_enabled_flag, and wherein the loop_filter_across_tiles_enabled_flag is set in a picture parameter set (PPS) in the bitstream.

9. The method of claim 8 , further comprising:

decoding the tile and the sub-picture for use in a reference picture;

performing the filtering operations across the tile boundary when the first flag is set to a first value;

omitting the filtering operations across the tile boundary when the first flag is set to a second value;

performing the filtering operations across the sub-picture boundary when the second flag is set to a third value; and

omitting the filtering operations across the sub-picture boundary when the second flag is set to a fourth value.

10. The method of claim 9 , wherein the second flag is denoted as loop_filter_across_subpic_enabled_flag.

11. The method of claim 8 , wherein the loop_filter_across_tiles_enabled_flag is set to one when specifying the filtering operations can be performed across tile boundaries in pictures referring to the PPS, and wherein the loop_filter_across_tiles_enabled_flag is set to zero when specifying the filtering operations are not performed across tile boundaries in pictures referring to the PPS.

12. The method of claim 8 , wherein the filtering operations include application of an adaptive loop filter (ALF), a sample adaptive offset (SAO) filter, a deblocking filter, or combinations thereof.

13. A decoder comprising:

a receiver configured to receive a bitstream comprising a first flag, a second flag, and a picture including a tile with a tile boundary and a sub-picture with a sub-picture boundary; and

a processor coupled to the receiver and configured to:

derive a motion vector predictor candidate list for a current block by excluding a collocated motion vector from the motion vector predictor candidate list when the collocated motion vector points outside of the sub-picture and when a flag is set to indicate the sub-picture is treated as a picture, wherein the collocated motion vector is included in a collocated block from a collocated picture;

decode the tile and the sub-picture based on the motion vector predictor candidate list;

enable filtering operations across the tile boundary when the first flag is set to a first value;

disable the filtering operations across the tile boundary when the first flag is set to a second value;

enable filtering operations across the sub-picture boundary when the second flag is set to a third value; and

disable the filtering operations across the sub-picture boundary when the second flag is set to a fourth value,

wherein the first flag is denoted as a loop_filter_across_tiles_enabled_flag, and wherein the loop_filter_across_tiles_enabled_flag is obtained from a picture parameter set (PPS) in the bitstream.

14. The decoder of claim 13 , wherein the second flag is denoted as loop_filter_across_subpic_enabled_flag.

15. The decoder of claim 13 , wherein the loop_filter_across_tiles_enabled_flag is set to one when specifying the filtering operations are enabled across tile boundaries in pictures referring to the PPS, and wherein the loop_filter_across_tiles_enabled_flag is set to zero when specifying the filtering operations are disabled across tile boundaries in pictures referring to the PPS.

16. The decoder of claim 13 , wherein the filtering operations include an adaptive loop filter (ALF).

17. The decoder of claim 13 , wherein the filtering operations include a sample adaptive offset (SAO) filter.

18. The decoder of claim 13 , wherein the filtering operations include a deblocking filter.

19. The decoder of claim 13 , wherein the tile boundary includes one or more edges of the tile.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2024
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 069511/0538 →
Continuity (4)
Continuation PCTUS2020022089 · Mar 11, 2020
Provisional Application 62826659 · Mar 29, 2019
Provisional Application 62816751 · Mar 11, 2019
Related Publication 20210409703A1 · Dec 30, 2021
References Cited (44)
US 9462298B2 · Chong et al. · 2016 [cited by applicant]
US 11831816B2 · Wang · 2023 [cited by examiner]
US 20070183676A1 · Hannuksela et al. · 2007 [cited by applicant]
US 20130107973A1 · Wang et al. · 2013 [cited by applicant]
US 20130202051A1 · Zhou · 2013 [cited by applicant]
US 20130208806A1 · Hu et al. · 2013 [cited by applicant]
US 20130208808A1 · Sasai et al. · 2013 [cited by applicant]
US 20140037011A1 · Lim et al. · 2014 [cited by applicant]
US 20140254666A1 · Rapaka et al. · 2014 [cited by applicant]
US 20140369415A1 · Naing et al. · 2014 [cited by applicant]
US 20150010091A1 · Hsu et al. · 2015 [cited by applicant]
US 20160080753A1 · Oh · 2016 [cited by examiner]
US 20170085917A1 · Hannuksela · 2017 [cited by applicant]
US 20180091825A1 · Zhao et al. · 2018 [cited by applicant]
US 20190075328A1 · Huang et al. · 2019 [cited by applicant]
US 20190306515A1 · Shima · 2019 [cited by applicant]
US 20200120359A1 · Hanhart et al. · 2020 [cited by applicant]
US 20200260071A1 · Hannuksela et al. · 2020 [cited by applicant]
US 20210152816A1 · Zhang et al. · 2021 [cited by applicant]
US 20210185330A1 · Kim · 2021 [cited by examiner]
EP 2728876A1 · 2014 [cited by applicant]
JP 2014534738A · 2014 [cited by applicant]
JP 2015504254A · 2015 [cited by applicant]
JP 2018107500A · 2018 [cited by applicant]
JP 2020517164A · 2020 [cited by applicant]
JP 2022507590A · 2022 [cited by applicant]
WO 2013168407A1 · 2013 [cited by applicant]
WO 2014051915A1 · 2014 [cited by applicant]
WO 2018191224A1 · 2018 [cited by applicant]
WO 2019009590A1 · 2019 [cited by applicant]
“Line Transmission of Non-Telephone Signals, Video Codec for Audiovisual Services at p×64 kbits,” ITU-T, H.261, Mar. 1993, 29 pages. [cited by applicant]
“Transmission of Non-Telephone Signals, Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” H.262, Jul. 1995, 211 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Video coding for low bit rate communication,” ITU-T, H.263, Jan. 2005, 226 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services,” ITU-T, H.264, Jun. 2019, 836 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding,” H.265, Apr. 2013, 317 pages. [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 3),” JVET-L1001-v3, Oct. 3-12, 2018, 181 pages. [cited by applicant]
JVET-M1001-v6, “Versatile Video Coding (Draft 4),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 298 pages. [cited by applicant]
JVET-M0261, “AHG12: On grouping of tiles,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 11 pages. [cited by applicant]
JCTVC-AC1005-v2, “HEVC Additional Supplemental Enhancement Information (Draft 4),” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 29th Meeting: Macao, CN, Oct. 19-25… [cited by applicant]
Document: JCTVC-I0356, Coban, M., et al., “Support of independent sub-pictures,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 9th Meeting: Geneva, CH, Apr. 27-May 7,… [cited by applicant]
Document: JVET-Q0352, Jang, H., et al., “AHG9/AHG12: On subpicture boundary”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 12 pages. [cited by applicant]
Hannuksela, M., et al., “Sub-Picture Video Coding for Unequal Error Protection”, Mar. 2002, 4 pages. [cited by applicant]
Huawei Technologies Co., Ltd. “[OMAF] On Signaling of some properties of sub-picture tracks”, ISO/IEC JTC1/SC29/ WG11 MPEG2018/M42964, Ljubljana, SI, Jul. 2018, 3 pages. [cited by applicant]
Document: JCTVC-J0088, Zhou, M., et al., “AHG4: Enable parallel decoding with tiles,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG 11 10th Meeting: Stockholm, Sweden, Jul.… [cited by applicant]