IP Library Granted Patent US 12,348,718
Granted Patent B2
US 12,348,718 · App. 17/953,090 · Granted Jul 1, 2025

Control and use of chroma quantization parameter values

Inventors: Gary J. Sullivan (Bellevue, WA); Sandeep Kanumuri (Redmond, WA)
Assignee: Microsoft Technology Licensing, LLC
H04N19/124H04N19/126H04N19/174H04N19/186H04N19/44H04N19/70H04N19/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,718
App. No.
17/953,090
Granted
Jul 1, 2025
Kind
B2
Abstract

Innovations in control and use of chroma quantization parameter (“QP”) values that depend on hum QP values. More generally, the innovations relate to control and use of QP values for a secondary color component that depend on QP values for a primary color component. For example, during encoding, an encoder determines a QP index from a primary component QP and secondary component QP offset. The encoder maps the QP index to a secondary component QP, which has an extended range. The encoder outputs at least part of a bitstream including the encoded content. A corresponding decoder receives at least part of a bitstream including encoded content. During decoding, the decoder determines a QP index from a primary component QP and secondary component QP offset, then maps the QP index to a secondary component QP, which has an extended range.

Claims (53)

1. In a computer system that implements a video decoder, a method comprising:

receiving encoded data in at least part of a bitstream for a video sequence, the encoded data including syntax elements that indicate a picture-level chroma quantization parameter (QP) offset and a slice-level chroma QP offset; and

decoding the encoded data to reconstruct part of a picture of the video sequence for which values of QP vary according to a relationship between a luma component and one or more chroma components, wherein the decoding includes:

determining a luma QP;

determining a final chroma QP based at least in part on the luma QP, the picture-level chroma QP offset, and the slice-level chroma QP offset, wherein an upper limit of range of quantization step size (QSS) indicated by the final chroma QP substantially matches an upper limit of range of QSS indicated by the luma QP, including:

determining a QP index using the luma QP;

mapping the QP index to an intermediate chroma QP, including setting the intermediate chroma QP based on the QP index according to a piecewise mapping between different values of QP index and corresponding values of intermediate chroma QP; and

adjusting the intermediate chroma QP to determine the final chroma QP; and

performing inverse quantization operations for the part of picture based at least in part on the luma QP and the final chroma QP.

2. The method of claim 1 , wherein the piecewise mapping uses a function according to which a bottom range of values of QP index has a first linear mapping to corresponding values of intermediate chroma QP, a middle range of values of QP index has a non-linear mapping to corresponding values of intermediate chroma QP, and a top range of values of QP index has a linear mapping to corresponding values of intermediate chroma QP.

3. The method of claim 1 , wherein the piecewise mapping is implemented as a piecewise linear function.

4. The method of claim 3 , wherein, according to the piecewise linear function:

a first range of values of QP index has a first linear mapping to corresponding values of intermediate chroma QP;

a second range of values of QP index has a second linear mapping to corresponding values of intermediate chroma QP; and

a third range of values of QP index has a third linear mapping to corresponding values of intermediate chroma QP.

5. The method of claim 1 , wherein, for a range of values of QP index associated with high QSS, the relationship is characterized by change in value of the luma QP causing a change of the same size in value of chroma QP, such that ratio of change in the Juma QP to change in the chroma QP is 1.

6. The method of claim 1 , wherein values of the picture-level chroma QP offset and the slice-level chroma QP offset are constrained such that range of the picture-level chroma QP offset plus the slice-level chroma QP offset is −12 to 12.

7. The method of claim 1 , wherein values of the picture-level chroma QP offset and the slice-level chroma QP offset are constrained such that:

range of the picture-level chroma QP offset is −12 to 12; and

range of the slice-level chroma QP offset is −12 to 12.

8. The method of claim 1 , wherein the encoded data further includes a flag in a picture parameter set that indicates presence of slice-level chroma QP offsets in slice headers.

9. One or more non-transitory computer-readable media having stored thereon encoded data organized as part of a bitstream for a video sequence, the encoded data including syntax elements that indicate a picture-level chroma quantization parameter (QP) offset and a slice-level chroma QP offset, the encoded data being organized to facilitate reconstruction, with a computer system that implements a video decoder, by operations comprising:

receiving the encoded data; and

decoding the encoded data to reconstruct a coding unit of a picture of the video sequence for which values of QP vary according to a relationship between a luma component and one or more chroma components, wherein the decoding includes:

determining a luma QP;

determining a final chroma QP based at least in part on the luma QP, the picture-level chroma QP offset, and the slice-level chroma QP offset, wherein an upper limit of range of quantization step size (QSS) indicated by the final chroma QP substantially matches an upper limit of range of QSS indicated by the luma QP, including:

determining a QP index using the luma QP;

mapping the QP index to an intermediate chroma QP, including setting the intermediate chroma QP based on the QP index according to a piecewise mapping between different values of QP index and corresponding values of intermediate chroma QP; and

adjusting the intermediate chroma QP to determine the final chroma QP; and

performing inverse quantization operations for the coding unit of picture based at least in part on the luma QP and the final chroma QP.

10. The one or more computer-readable media of claim 9 , wherein the piecewise mapping is implemented as a piecewise linear function.

11. The one or more computer-readable media of claim 9 , wherein values of the picture-level chroma QP offset and the slice-level chroma QP offset are constrained such that range of the picture-level chroma QP offset plus the slice-level chroma QP offset is −12 to 12.

12. The one or more computer-readable media of claim 9 , wherein values of the picture-level chroma QP offset and the slice-level chroma QP offset are constrained such that:

range of the picture-level chroma QP offset is −12 to 12; and

range of the slice-level chroma QP offset is −12 to 12.

13. The one or more computer-readable media of claim 9 , wherein the encoded data further includes a flag in a picture parameter set that indicates presence of slice-level chroma QP offsets in slice headers.

14. One or more computer-readable memory or storage devices having stored thereon computer-executable instructions for causing one or more processing units, when programmed thereby, to perform operations comprising:

encoding part of a picture of a video sequence for which values of quantization parameter (QP) vary according to a relationship between a luma component and one or more chroma components, thereby producing encoded data, wherein the encoding includes:

determining a luma QP;

determining a final chroma QP;

encoding the final chroma QP for the part of the picture based at least in part on the luma QP, a picture-level chroma QP offset, and a slice-level chroma QP offset, wherein an upper limit of range of quantization step size (QSS) indicated by the final chroma QP substantially matches an upper limit of range of QSS indicated by the luma QP, including:

determining a QP index using the luma QP; and

mapping the QP index to an intermediate chroma QP, including setting the intermediate chroma QP based on the QP index according to a piecewise mapping between different values of QP index and corresponding values of intermediate chroma QP; and

performing inverse quantization operations for the part of picture based at least in part on the luma QP and the final chroma QP; and

outputting the encoded data in at least part of a bitstream, the encoded data including syntax elements that indicate the picture-level chroma QP offset and the slice-level chroma QP offset.

15. The one or more computer-readable memory or storage devices of claim 14 , wherein, for a range of values of QP index associated with high QSS, the relationship is characterized by change in value of the luma QP causing a change of the same size in value of chroma QP, such that ratio of change in the luma QP to change in the chroma QP is 1.

16. The one or more computer-readable memory or storage devices of claim 14 , wherein the piecewise mapping is implemented as a piecewise linear function.

17. The one or more computer-readable memory or storage devices of claim 14 , wherein values of the picture-level chroma QP offset and the slice-level chroma QP offset are constrained such that range of the picture-level chroma QP offset plus the slice-level chroma QP offset is −12 to 12.

18. The one or more computer-readable memory or storage devices of claim 14 , wherein values of the picture-level chroma QP offset and the slice-level chroma QP offset are constrained such that:

range of the picture-level chroma QP offset is −12 to 12; and

range of the slice-level chroma QP offset is −12 to 12.

19. The one or more computer-readable memory or storage devices of claim 14 , wherein the encoded data further includes a flag in a picture parameter set that indicates presence of slice-level chroma QP offsets in slice headers.

20. The one or more computer-readable media of claim 9 , wherein, for a range of values of QP index associated with high QSS, the relationship is characterized by change in value of the luma QP causing a change of the same size in value of chroma QP, such that ratio of change in the luma QP to change in the chroma QP is 1.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2022
From: SULLIVAN, GARY J.; KANUMURI, SANDEEP
To: MICROSOFT CORPORATION
Reel/Frame 062073/0499 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2022
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 062073/0553 →
Continuity (7)
Continuation 17145535 · Jan 11, 2021
Continuation 16600287 · Oct 11, 2019
Continuation 16277704 · Feb 15, 2019
Continuation 15202933 · Jul 6, 2016
Division 13732356 · Dec 31, 2012
Provisional Application 61667381 · Jul 2, 2012
Related Publication 20230029534A1 · Feb 2, 2023
References Cited (66)
US 9414054B2 · Sullivan et al. · 2016 [cited by applicant]
US 9591302B2 · Sullivan · 2017 [cited by applicant]
US 9781421B2 · Sullivan · 2017 [cited by applicant]
US 10097832B2 · Sullivan · 2018 [cited by applicant]
US 10250882B2 · Sullivan et al. · 2019 [cited by applicant]
US 10313670B2 · Sullivan · 2019 [cited by applicant]
US 10491898B2 · Sullivan et al. · 2019 [cited by applicant]
US 10652542B2 · Sullivan · 2020 [cited by applicant]
US 10924740B2 · Sullivan et al. · 2021 [cited by applicant]
US 10972735B2 · Sullivan · 2021 [cited by applicant]
US 11457212B2 · Sullivan et al. · 2022 [cited by applicant]
US 11595651B2 · Sullivan · 2023 [cited by applicant]
US 20060050784A1 · Lappalainen · 2006 [cited by examiner]
US 20080317377A1 · Saigo · 2008 [cited by examiner]
US 20210211669A1 · Sullivan · 2021 [cited by applicant]
US 20220400262A1 · Sullivan et al. · 2022 [cited by applicant]
US 20230023086A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230026047A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230027377A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230029534A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230034128A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230036446A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230156194A1 · Sullivan · 2023 [cited by applicant]
US 20240314314A1 · Sullivan · 2024 [cited by applicant]
Notice of Allowance dated Nov. 14, 2022, from U.S. Appl. No. 17/190,839, 8 pp. [cited by applicant]
Notice of Preliminary Rejection dated Oct. 19, 2022, from Korean Patent Application No. 10-2022-7004735, 5 pp. [cited by applicant]
Office Action dated Jul. 22, 2022, from U.S. Appl. No. 17/190,839, 16 pp. [cited by applicant]
Notice of Allowance dated Dec. 27, 2023, from Korean Patent Application No. 10-2023-7020733, 4 pp. [cited by applicant]
Notice of Allowance dated Jan. 16, 2024, form U.S. Appl. No. 18/099,330, 8 pp. [cited by applicant]
Notice of Allowance dated Jan. 19, 2024, from Korean Patent Application No. 10-2023-7020719, 3 pp. [cited by applicant]
Notice of Allowance dated Jan. 19, 2024, from Korean Patent Application No. 10-2023-7020802, 3 pp. [cited by applicant]
Notice of Allowance dated Jan. 22, 2024, from Korean Patent Application No. 10-2023-7020737, 4 pp. [cited by applicant]
Notice of Allowance dated Jan. 22, 2024, from Korean Patent Application No. 10-2023-7020740, 4 pp. [cited by applicant]
Notice of Allowance dated Jan. 22, 2024, from Korean Patent Application No. 10-2023-7020809, 4 pp. [cited by applicant]
Office Action Issued in Korean Patent Application No. 10-2023-7020719, Mailed Date: Jul. 11, 2023, 10 Pages. [cited by applicant]
Office Action Issued in Korean Patent Application No. 10-2023-7020733, Mailed Date: Jul. 12, 2023, 11 Pages. [cited by applicant]
Office Action Issued in Korean Patent Application No. 10-2023-7020737, Mailed Date: Jul. 13, 2023, 11 Pages. [cited by applicant]
Office Action Issued in Korean Patent Application No. 10-2023-7020740, Mailed Date: Jul. 14, 2023, 10 Pages. [cited by applicant]
Office Action Issued in Korean Patent Application No. 10-2023-7020802, Mailed Date: Jul. 17, 2023, 12 Pages. [cited by applicant]
Office Action Issued in Korean Patent Application No. 10-2023-7020809, Mailed Date: Jul. 24, 2023, 10 Pages. [cited by applicant]
Office Action dated Aug. 17, 2023, from U.S. Appl. No. 18/099,330, 13 pp. [cited by applicant]
Notice of Allowance dated Mar. 23, 2023, from Korean Patent Application No. 10-2022-7004735, 6 pp. [cited by applicant]
U.S. Pat. U.S. Appl. No. 17/951,359, filed Sep. 23, 2022. [cited by applicant]
U.S. Pat. U.S. Appl. No. 17/951,409, filed Sep. 23, 2022. [cited by applicant]
U.S. Pat. U.S. Appl. No. 17/951,446, filed Sep. 23, 2022. [cited by applicant]
U.S. Pat. U.S. Appl. No. 17/890,496, filed Aug. 18, 2022. [cited by applicant]
U.S. Pat. U.S. Appl. No. 17/953,120, filed Sep. 26, 2022. [cited by applicant]
U.S. Pat. U.S. Appl. No. 17/953,145, filed Sep. 26, 2022. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Oct. 8, 2018, from European Patent Application No. 13737506.9, 7 pp. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Oct. 9, 2024, from European Patent Application No. 19190862.3, 4 pp. [cited by applicant]
Communication under Rule 71(3) EPC dated Oct. 8, 2024, from European Patent Application No. 19207170.2, 7 pp. [cited by applicant]
Decision to Grant dated Jan. 23, 2025, from European Patent Application No. 19207170.2, 3 pp. [cited by applicant]
Notice of Allowance dated Dec. 15, 2017, from Chinese Patent Application No. 201380045723.7, 3 pp. [cited by applicant]
Notice of Allowance dated Aug. 13, 2024, from U.S. Appl. No. 17/890,496, 11 pp. [cited by applicant]
Notice of Allowance dated Aug. 19, 2024, from U.S. Appl. No. 17/951,446, 9 pp. [cited by applicant]
Notice of Allowance dated Sep. 12, 2024, from U.S. Appl. No. 17/951,359, 9 pp. [cited by applicant]
Notice of Allowance dated Oct. 11, 2024, from U.S. Appl. No. 17/951,409, 9 pp. [cited by applicant]
Office Action dated Oct. 24, 2024, from U.S. Appl. No. 17/953,120, 14 pp. [cited by applicant]
Office Action dated Nov. 7, 2024, from U.S. Appl. No. 17/953,145, 13 pp. [cited by applicant]
Office Action dated Nov. 7, 2024, from U.S. Appl. No. 18/443,139, 11 pp. [cited by applicant]
No. U.S. Appl. No. 18/920,094, filed Oct. 18, 2024. [cited by applicant]
Extended European Search Report dated Apr. 17, 2025, from European Patent Application No. 25153992.0, 9 pp. [cited by applicant]
Extended European Search Report dated Apr. 17, 2025, from European Patent Application No. 25153993.8, 9 pp. [cited by applicant]
Extended European Search Report dated Apr. 17, 2025, from European Patent Application No. 25153995.3, 10 pp. [cited by applicant]
Final Office Action dated May 7, 2025, from U.S. Appl. No. 18/443,139, 10 pp. [cited by applicant]
Notice of Allowance dated Mar. 19, 2025, from U.S. Appl. No. 17/953,120, 5 pp. [cited by applicant]