IP Library Granted Patent US 9,106,913
Granted Patent B2
US 9,106,913 · App. 13/565,621 · Granted Aug 11, 2015

Coding of transform coefficients for video coding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,106,913
App. No.
13/565,621
Granted
Aug 11, 2015
Kind
B2
Abstract

In an example, a method includes coding significance information for transform coefficients in a set of transform coefficients associated with the residual video data according to a scan order in one or more first passes. The method also includes coding a first set of one or more bins of information for the transform coefficients according to the scan order in one or more second passes, where the first set of one or more bins are coded in a first mode of a coding process. The method also includes coding a second set of one or more bins of information for the transform coefficients according to the scan order in one or more third passes, where the second set of one or more bins are coded in a second mode of the coding process.

Claims (69)

1. A method of coding transform coefficients associated with residual video data in a video coding process, the method comprising:

coding a sub-set of transform coefficients associated with the residual video data that comprises fewer than all transform coefficients of a block using a plurality of passes, wherein each pass of the plurality of passes comprises a scan of the sub-set of transform coefficients in a scan order, wherein the scan order comprises an order in which the sub-set of transform coefficients are processed during coding, and wherein coding the sub-set of transform coefficients comprises:

coding significance information for the sub-set of transform coefficients using a first mode of a coding process in one or more first passes;

coding a first bin and a second bin of levels of the transform coefficients for the sub-set of transform coefficients using the first mode of the coding process in one or more second passes, wherein the one or more second passes are separate from the one or more first passes; and

coding remaining bins of the levels of the transform coefficients and a sign of the levels of the transform coefficients for the sub-set of transform coefficients using a second mode of the coding process in one or more third passes, wherein the one or more third passes are separate from the one or more first and second passes.

2. The method of claim 1 , wherein the first mode is a regular mode of a Context Adaptive Binary Arithmetic Coding (CABAC) process and the second mode is a bypass mode of the CABAC process.

3. The method of claim 2 , wherein the regular mode of the CABAC process uses an adaptive context model to code bins and the bypass mode of the CABAC process uses fixed probabilities to code bins.

4. The method of claim 1 , further comprising repeating the coding for each of a plurality of sub-sets of transform coefficients in the block, wherein each sub-set comprises less than all of the entire set of transform coefficients in the block.

5. The method of claim 1 , wherein each of the sub-sets comprises sixteen consecutive coefficients in the scan order.

6. The method of claim 1 , wherein each of the sub-sets comprises a sub-block of transform coefficients in the scan order.

7. The method of claim 1 , wherein the significance information of the one or more first passes and the first bin and the second bin of the levels of the one or more second passes are grouped together for coding for the sub-set.

8. The method of claim 1 , wherein coding comprises encoding, and wherein encoding comprises including information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients in an encoded bitstream.

9. The method of claim 1 , wherein coding comprises decoding, and wherein decoding comprises receiving information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients in an encoded bitstream.

10. The method of claim 9 , wherein decoding further comprises:

determining transform coefficients for a block of video data from the information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients;

applying an inverse transform to the determined transform coefficients to generate a block of residual video data; and

combining the block of residual video data with a predictive block of video data to form a reconstructed block of video data.

11. An apparatus for coding transform coefficients associated with residual video data, the apparatus comprising:

a memory configured to store the residual video data; and

one or more processors configured to code a sub-set of transform coefficients associated with the residual video data that comprises fewer than all transform coefficients of a block using a plurality of passes, wherein each pass of the plurality of passes comprises a scan of the sub-set of transform coefficients in a scan order, wherein the scan order comprises an order in which the sub-set of transform coefficients are processed during coding, and wherein to code the sub-set of transform coefficients, the one or more processors are configured to:

code significance information for the sub-set of transform coefficients using a first mode of a coding process in one or more first passes;

code a first bin and a second bin of levels of the transform coefficients for the sub-set of transform coefficients using the first mode of the coding process in one or more second passes, wherein the one or more second passes are separate from the one or more first passes, and wherein the first set of one or more bins are coded in a first mode of a coding process; and

code remaining bins of the levels of the transform coefficients and a sign of the levels of the transform coefficients for the sub-set of transform coefficients using a second mode of the coding process in one or more third passes, wherein the one or more third passes are separate from the one or more first and second passes.

12. The apparatus of claim 11 , wherein the first mode is a regular mode of a Context Adaptive Binary Arithmetic Coding (CABAC) process and the second mode is a bypass mode of the CABAC process.

13. The apparatus of claim 12 , wherein the regular mode of the CABAC process uses an adaptive context model to code bins and the bypass mode of the CABAC process uses fixed probabilities to code bins.

14. The apparatus of claim 11 , wherein the one or more processors are further configured to repeat the coding for each of a plurality of sub-sets of transform coefficients in the block, wherein each sub-set comprises less than all of the entire set of transform coefficients in the block.

15. The apparatus of claim 11 , wherein each of the sub-sets comprises sixteen consecutive coefficients in the scan order.

16. The apparatus of claim 11 , wherein each of the sub-sets comprises a sub-block of transform coefficients in the scan order.

17. The apparatus of claim 11 , wherein the significance information of the one or more first passes and the first bin and the second bin of the levels of the one or more second passes are grouped together for coding for the sub-set.

18. The apparatus of claim 11 , wherein to code the one or more processors are configured to encode, and wherein encoding comprises including information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients in an encoded bitstream.

19. The apparatus of claim 11 , wherein to code the one or more processors are configured to decode, and wherein decoding comprises receiving information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients.

20. The apparatus of claim 19 , wherein to decode the one or more processors are further configured to:

determine transform coefficients for a block of video data from the information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients;

apply an inverse transform to the determined transform coefficients to generate a block of residual video data; and

combine the block of residual video data with a predictive block of video data to form a reconstructed block of video data.

21. An apparatus for coding transform coefficients associated with residual video data, the apparatus comprising:

means for coding a sub-set of transform coefficients associated with the residual video data that comprises fewer than all transform coefficients of a block using a plurality of passes, wherein each pass of the plurality of passes comprises a scan of the sub-set of transform coefficients in a scan order, wherein the scan order comprises an order in which the sub-set of transform coefficients are processed during coding, and wherein the means for coding the sub-set of transform coefficients comprises:

means for coding significance information for the sub-set of transform coefficients using a first mode of a coding process in one or more first passes;

means for coding a first bin and a second bin of levels of the transform coefficients for the sub-set of transform coefficients using the first mode of the coding process in one or more second passes, wherein the one or more second passes are separate from the one or more first passes; and

means for coding remaining bins of the levels of the transform coefficients and a sign of the levels of the transform coefficients for the sub-set of transform coefficients using a second mode of the coding process in one or more third passes, wherein the one or more third passes are separate from the one or more first and second passes.

22. The apparatus of claim 21 , wherein the first mode is a regular mode of a Context Adaptive Binary Arithmetic Coding (CABAC) process and the second mode is a bypass mode of the CABAC process.

23. The apparatus of claim 22 , wherein the regular mode of the CABAC process uses an adaptive context model to code bins and the bypass mode of the CABAC process uses fixed probabilities to code bins.

24. The apparatus of claim 21 , further comprising means for repeating the coding for each of a plurality of sub-sets of transform coefficients in the block, wherein each sub-set comprises less than all of the entire set of transform coefficients in the block.

25. The apparatus of claim 21 , wherein each of the sub-sets comprises sixteen consecutive coefficients in the scan order.

26. The apparatus of claim 21 , wherein each of the sub-sets comprises a sub-block of transform coefficients in the scan order.

27. The apparatus of claim 21 , wherein the significance information of the one or more first passes and the first bin and the second bin of the levels of the one or more second passes are grouped together for coding for the sub-set.

28. The apparatus of claim 21 , wherein means for coding comprises means for encoding, and wherein means for encoding comprises means for including information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients in an encoded bitstream.

29. The apparatus of claim 21 , wherein means for coding comprises means for decoding, and wherein means for decoding comprises means for receiving information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients in an encoded bitstream.

30. The apparatus of claim 29 , wherein means for decoding further comprises:

means for determining transform coefficients for a block of video data from the information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients;

means for applying an inverse transform to the determined transform coefficients to generate a block of residual video data; and

means for combining the block of residual video data with a predictive block of video data to form a reconstructed block of video data.

31. A non-transitory computer readable storage medium having instructions stored thereon that, when executed, cause one or more processors to:

code a sub-set of transform coefficients associated with the residual video data that comprises fewer than all transform coefficients of a transform block using a plurality of passes, wherein each pass of the plurality of passes comprises a scan of the sub-set of transform coefficients in a scan order, wherein the scan order comprises an order in which the sub-set of transform coefficients are processed during coding, and wherein to code the sub-set of transform coefficients, the instructions cause the one or more processors to:

code significance information for the sub-set of transform coefficients using a first mode of a coding process in one or more first passes;

code a first bin and a second bin of levels of the transform coefficients for the sub-set of transform coefficients using the first mode of the coding process in one or more second passes, wherein the one or more second passes are separate from the one or more first passes; and

code remaining bins of the levels of the transform coefficients and a sign of the levels of the transform coefficients for the sub-set of transform coefficients using a second mode of the coding process in one or more third passes, wherein the one or more third passes are separate from the one or more first and second passes.

32. The non-transitory computer readable storage medium of claim 31 , wherein the first mode is a regular mode of a Context Adaptive Binary Arithmetic Coding (CABAC) process and the second mode is a bypass mode of the CABAC process.

33. The non-transitory computer readable storage medium of claim 32 , wherein the regular mode of the CABAC process uses an adaptive context model to code bins and the bypass mode of the CABAC process uses fixed probabilities to code bins.

34. The non-transitory computer readable storage medium of claim 31 , further comprising instructions that cause the one or more processors to repeat the coding for each of a plurality of sub-sets of transform coefficients in the block, wherein each sub-set comprises less than all of the entire set of transform coefficients in the block.

35. The non-transitory computer readable storage medium of claim 31 , wherein each of the sub-sets comprises sixteen consecutive coefficients in the scan order.

36. The non-transitory computer readable storage medium of claim 31 , wherein each of the sub-sets comprises a sub-block of transform coefficients in the scan order.

37. The non-transitory computer readable storage medium of claim 31 , wherein the significance information of the one or more first passes and the first bin and the second bin of the levels of the one or more second passes are grouped together for coding for the sub-set.

38. The non-transitory computer readable storage medium of claim 31 , wherein to code comprises encoding, and wherein the instructions cause the one or more processors to include information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients in an encoded bitstream.

39. The non-transitory computer readable storage medium of claim 31 , wherein to code comprises decoding, and wherein the instructions cause the one or more processors to receive information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients in an encoded bitstream.

40. The non-transitory computer readable storage medium of claim 39 , wherein the instructions further cause the one or more processors to:

determine transform coefficients for a block of video data from the information representing the significance information, the first bin and the second bin of the levels of the transform coefficients, the remaining bins of the levels of the transform coefficients and the sign of the levels of the transform coefficients;

apply an inverse transform to the determined transform coefficients to generate a block of residual video data; and

combine the block of residual video data with a predictive block of video data to form a reconstructed block of video data.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Jul 26, 2022
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 060923/0407 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: VELOS MEDIA, LLC
To: QUALCOMM INCORPORATED
Reel/Frame 057575/0431 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: VELOS MEDIA, LLC AND VELOS MEDIA MANAGEMENT, LLC
Reel/Frame 057554/0540 →
SECOND AMENDED AND RESTATED MEMBER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 2, 2018
From: VELOS MEDIA MANAGEMENT, LLC; VELOS MEDIA, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT
Reel/Frame 045806/0030 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2017
From: QUALCOMM INCORPORATED
To: VELOS MEDIA, LLC
Reel/Frame 043173/0291 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2012
From: SOLE ROJALS, JOEL; JOSHI, RAJAN LAXMAN; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 028917/0261 →