IP Library › Granted Patent US 12,382,050
Granted Patent B2
US 12,382,050 · App. 18/437,430 · Granted Aug 5, 2025

Adaptation of scan order for entropy coding

Inventor: Dake He (Waterloo, CA)
Assignee: GOOGLE LLC
H04N19/129H04N19/172H04N19/176H04N19/18H04N19/182H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,382,050
App. No.
18/437,430
Granted
Aug 5, 2025
Kind
B2
Abstract

An encoded bitstream is stored on a non-transitory computer-readable storage medium. The encoded bitstream is configured for decoding by operations that include decoding a subset of quantized transform coefficients of a quantized transform block using a first scan order; determining, based on the subset of the quantized transform coefficients, a second scan order; decoding, based on the second scan order, remaining quantized transform coefficients of the quantized transform block; obtaining a current block based on the quantized transform coefficients.

Claims (60)

1. A non-transitory computer-readable storage medium having stored thereon an encoded bitstream, wherein the encoded bitstream, processed by a processor, causes the processor to perform operations comprising:

decoding a subset of quantized transform coefficients of a quantized transform block using a first scan order;

determining, based on the subset of the quantized transform coefficients, a second scan order;

decoding, based on the second scan order, remaining quantized transform coefficients of the quantized transform block; and

obtaining a current block based on the quantized transform coefficients,

wherein the subset of quantized transform coefficients is arranged in the encoded bitstream for decoding based on the first scan order, and

wherein the remaining quantized transform coefficients are arranged in the encoded bitstream for decoding based on the second scan order.

2. The non-transitory computer-readable storage medium of claim 1 , wherein determining, based on the subset of the quantized transform coefficients, the second scan order comprises:

determining the second scan order based on a distribution of non-zero quantized transform coefficients within the subset of quantized transform coefficients.

3. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:

determining, based on at least the subset of the quantized transform coefficients, a context model for decoding an intra-prediction mode, wherein determining the context model comprises:

determining a category based on the at least the subset of the quantized transform coefficients; and

determining the context model based on the category; and

decoding the intra-prediction mode based on the context model, wherein the current block is obtained based further on the intra-prediction mode.

4. The non-transitory computer-readable storage medium of claim 3 ,

wherein the subset of the quantized transform coefficients comprises first quantized transform coefficients of a top-most row of the quantized transform block and second quantized transform coefficients of a left-most column of the quantized transform block, and

wherein determining the category based on the at least the subset of the quantized transform coefficients comprises:

determining the category based on a first count of non-zero quantized transform coefficients in at least a subset of the first quantized transform coefficients of the top-most row and a second count of non-zero quantized transform coefficients in at least a subset of the second quantized transform coefficients of the left-most column of the quantized transform block.

5. The non-transitory computer-readable storage medium of claim 4 , wherein the operations further comprise:

determining that the category is vertical in a case that the first count is zero and the second count is positive.

6. The non-transitory computer-readable storage medium of claim 4 , wherein the operations further comprise:

determining that the category is horizontal in a case that the first count is positive and second count is zero.

7. The non-transitory computer-readable storage medium of claim 4 , wherein the operations further comprise:

determining that the category is diagonal in a case that the first count and the second count are both zero or are both positive.

8. A non-transitory computer-readable storage medium having stored thereon an encoded bitstream, wherein the encoded bitstream comprises:

a first group of coefficients of a transform block consisting of first coefficients of a first row of the transform block and second coefficients of a first column of the transform block; and

a second group of coefficients of the transform block consisting of remaining coefficients of the transform block, wherein the second group does not include any coefficient of the first group,

wherein, the encoded bitstream, processed by a processor, causes the processor to perform operations comprising:

decoding the first group of coefficients using a first scan order;

determining a second scan order based on the first group of coefficients; and

decoding the sex nd group of coefficients using the second scan order.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the first scan order is a zig-zag, scan order.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the first scan order is a zig-zag, horizontal scan order.

11. The non-transitory computer-readable storage medium of claim 8 , wherein the second scan order is adapted based on the coefficients of the first group.

12. The non-transitory computer-readable storage medium of claim 8 , wherein the second scan order is one of a vertical scan order, a horizontal scan order, a second zig-zag scan order, or a diagonal scan order.

13. The non-transitory computer-readable storage medium of claim 12 ,

wherein the second scan order is the horizontal scan order in a case that a first count of non-zero coefficients in a second half of the first row is positive and a second count of non-zero coefficients in a second half of the first column is zero; and

wherein the second scan order is the vertical scan order in a case that the first count of non-zero coefficients in the second half of the first row is zero and the second count of non-zero coefficients in the second half of the first column is positive.

14. The non-transitory computer-readable storage medium of claim 12 ,

wherein the second scan order is the second zig-zag scan order in a case that a first count of non-zero elements in a second half of the first row is positive and a second count of non-zero elements in the second half of the first column is positive; and

wherein the second scan order is the diagonal scan order in a case that the first count of non-zero elements in the second half of the first row is positive and the second count of non-zero elements in the second half of the first column is positive.

15. A non-transitory computer-readable storage medium having stored thereon an encoded bitstream, wherein the encoded bitstream comprises:

a plurality of groups of elements of a block of video, the plurality of groups of elements includes a first group and a second group,

the first group, and

the second group,

wherein, the encoded bitstream, processed by a processor, causes the processor to perform operations comprising:

decoding, using a first scan order, elements of the first group;

determining, based on the elements of the first group, a second scan order for the second group; and

decoding, using the second scan order, elements of the second group.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the plurality of groups of elements of the block comprise quantized transform coefficients.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the first group includes elements of a first row of the block and elements of a first column of the block.

18. The non-transitory computer-readable storage medium of claim 17 , wherein determining, based on the elements of the first group, the second scan order for the second group comprises:

determining a first count of non-zero elements in a portion of the first row of the block;

determining a second count of non-zero elements in a portion of the first column of the block; and

responsive to the first count being zero and the second count being positive, determining the second scan order to be a vertical scan order.

19. The non-transitory computer-readable storage medium of claim 17 , wherein determining, based on the elements of the first group, the second scan order for the second group comprises:

determining a first sum of magnitudes of elements in a portion of the first row of the block;

determining a second sum of magnitudes of elements in a portion of the first column of the block; and

responsive to the first sum being positive and the second sum being zero, determining the second scan order to be a horizontal scan order.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the second group includes elements of a first row and a first column of remaining elements of the block outside of the first group.

Continuity (6)
Continuation 18084719 · Dec 20, 2022
Continuation 17544244 · Dec 7, 2021
Continuation 16930903 · Jul 16, 2020
Continuation 16435672 · Jun 10, 2019
Continuation 15608008 · May 30, 2017
Related Publication 20240244207A1 · Jul 18, 2024
References Cited (42)
US 5767910A · Iizuka · 1998 [cited by applicant]
US 9197890B2 · Sole Rojals · 2015 [cited by examiner]
US 10129548B2 · Tsukuba · 2018 [cited by examiner]
US 10356411B2 · He · 2019 [cited by applicant]
US 10757411B2 · He · 2020 [cited by applicant]
US 11223828B2 · He · 2022 [cited by applicant]
US 11323747B2 · Joshi et al. · 2022 [cited by applicant]
US 20120155781A1 · Onoue · 2012 [cited by examiner]
US 20120177113A1 · Guo et al. · 2012 [cited by applicant]
US 20120236931A1 · Karczewicz et al. · 2012 [cited by applicant]
US 20130114707A1 · Seregin et al. · 2013 [cited by applicant]
US 20130243087A1 · Lee et al. · 2013 [cited by applicant]
US 20130266064A1 · Zhang et al. · 2013 [cited by applicant]
US 20140362926A1 · Rosewarne et al. · 2014 [cited by applicant]
US 20150071359A1 · Guo et al. · 2015 [cited by applicant]
US 20160100176A1 · Pu · 2016 [cited by examiner]
US 20160381383A1 · Oh et al. · 2016 [cited by applicant]
US 20180184131A1 · Yoo et al. · 2018 [cited by applicant]
US 20180192076A1 · Ikai et al. · 2018 [cited by applicant]
US 20180205958A1 · Piao et al. · 2018 [cited by applicant]
US 20190104303A1 · Xiu · 2019 [cited by examiner]
EP 2168381A2 · 2010 [cited by applicant]
EP 2355517A1 · 2011 [cited by applicant]
Bankoski et al., “VP8 Data Format and Decoding Guide”, Independent Submission RFC 6389, Nov. 2011, 305 pp. [cited by applicant]
Bankoski et al., “VP8 Data Format and Decoding Guide draft-bankoski-vp8-bitstream-02”, Network Working Group, Internet-Draft, May 18, 2011, 288 pp. [cited by applicant]
“Introduction to Video Coding Part 1: Transform Coding”, Mozilla, Mar. 2012, 171 pp. [cited by applicant]
“Overview VP7 Data Format and Decoder”, Version 1.5, On2 Technologies, Inc., Mar. 28, 2005, 65 pp. [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Amendment 2: New profiles for professional applications, International Telecommunication Union, Apr. 2007, 75 … [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, Amendment 1: Support of additional colour spaces and r… [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, Version 3, International Telecommunication Union, Mar.… [cited by applicant]
Bankoski, et al., “Technical Overview of VP8, An Open Source Video Codec for the Web”, Jul. 11, 2011, 6 pp. [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Coding of moving video: Implementors Guide for H.264: Advanced video coding for generic audiovisual services, International Telecommunication Union, Jul. 30, 2010, 15 pp. [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, International Telecommunication Union, Version 11, Mar… [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, International Telecommunication Union, Version 12, Mar… [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, Version 8, International Telecommunication Union, Nov.… [cited by applicant]
Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, Version 1, International Telecommunication Union, May … [cited by applicant]
“VP8 Data Format and Decoding Guide, WebM Project”, Google On2, Dec. 1, 2010, 103 pp. [cited by applicant]
“VP6 Bitstream and Decoder Specification”, Version 1.02, On2 Technologies, Inc., Aug. 17, 2006, 88 pp. [cited by applicant]
“VP6 Bitstream and Decoder Specification”, Version 1.03, On2 Technologies, Inc., Oct. 29, 2007, 95 pp. [cited by applicant]
Sole, Joel et al. “Transform Coefficient Coding in HEVC”; IEEE Transactions on Circuits and Systems for Video Technology, Dec. 2012; pp. 1-11. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2018/021714 mailed May 3, 2018. [cited by applicant]
Wang X et al: “CEII: Adaptive Coefficient Scanning for LCEC”; MPEG Meeting; Mar. 17, 2011; pp. 1-3. [cited by applicant]