IP Library Granted Patent US 10,491,899
Granted Patent B2
US 10,491,899 · App. 15/755,460 · Granted Nov 26, 2019

Method and apparatus for quantization in video encoding and decoding

Inventors: Franck Galpin (Thorigne-Fouillard, FR); Hadrien Gurnel (Paris, FR); Edouard Francois (Bourg des Comptes, FR)
Assignee: InterDigital VC Holdings, Inc.
H04N19/126H04N19/124H04N19/159H04N19/186H04N19/463
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,491,899
App. No.
15/755,460
Granted
Nov 26, 2019
Kind
B2
Abstract

Because human eyes may become less sensitive to dark areas around very bright areas in a video (known as glare masking), we may use coarser quantization in such dark areas. Considering the extra distortion that human eyes can tolerate in a block with glare masking, a quantization ratio for the block can be calculated. The quantization parameter for the block can then be scaled up using the quantization ratio to form an adjusted quantization parameter. In one embodiment, the adjusted quantization parameter can be derived at the decoder side, and thus, transmission of quantization ratio information is not needed. In particular, we can estimate the luminance of a current block based on a predicted block and de-quantized DC coefficient, and use the luminance of causal neighboring blocks and the estimated luminance of the current block to estimate the adjusted quantization parameter.

Claims (46)

1. A method of encoding a video, comprising:

accessing a quantization parameter and a residual block corresponding to a block of an image of said video;

transforming said residual block to form a DC transform coefficient and one or more AC transform coefficients;

quantizing and de-quantizing said DC transform coefficient responsive to said quantization parameter, to form a reconstructed DC transform coefficient;

adjusting said quantization parameter of said block responsive to said reconstructed DC transform coefficient and luminance of one or more neighboring reconstructed blocks of said block; and

encoding said one or more AC transform coefficients responsive to said adjusted quantization parameter.

2. The method of claim 1 , wherein said quantization parameter is adjusted based on a glare masking effect between said neighboring reconstructed blocks of said block and said block.

3. The method of claim 2 , further comprising:

determining a JND (Just Noticeable Difference) for a pixel of said block responsive to said glare masking effect, wherein said quantization parameter is adjusted based on said determined JND and said luminance of said block.

4. The method of claim 1 , wherein said quantization parameter is adjusted responsive to a sum of said reconstructed DC transform coefficient of said block and a predicted block for said block.

5. The method of claim 4 , wherein quantization of said AC transform coefficients of said block is based on said adjusted quantization parameter.

6. The method of claim 4 , further comprising:

determining a quantization ratio based on said sum of said block and said luminance of said neighboring reconstructed blocks of said block, wherein said quantization parameter is adjusted based on said quantization ratio.

7. A method of decoding a video, comprising:

accessing a quantization parameter of a block of an image;

accessing transform coefficients for said block of said image, said transform coefficients including a DC transform coefficient and one or more AC transform coefficients;

de-quantizing said DC transform coefficient responsive to said quantization parameter to form a reconstructed DC transform coefficient;

adjusting said quantization parameter responsive to said reconstructed DC transform coefficient and luminance of one or more neighboring reconstructed blocks of said block; and

decoding said one or more AC transform coefficients responsive to said adjusted quantization parameter.

8. The method of claim 7 , wherein said quantization parameter is adjusted based on a sum of said reconstructed DC transform coefficient of said block and a predicted block for said block.

9. The method of claim 8 , wherein de-quantization of said AC transform coefficients of said block is based on said adjusted quantization parameter.

10. The method of claim 8 , further comprising:

determining a quantization ratio based on said sum and said luminance of said neighboring reconstructed blocks of said block, wherein said quantization parameter is adjusted based on said quantization ratio.

11. An apparatus for encoding a video, comprising at least a memory and one or more processors, wherein said one or more processors are configured to:

access a quantization parameter and a residual block corresponding to a block of an image of said video;

transform said residual block to form a DC transform coefficient and one or more AC transform coefficients;

quantize and de-quantize said DC transform coefficient responsive to said quantization parameter, to form a reconstructed DC transform coefficient;

adjust said quantization parameter of said block responsive to said reconstructed DC transform coefficient and luminance of one or more neighboring reconstructed blocks of said block; and

encode said one or more AC transform coefficients responsive to said adjusted quantization parameter.

12. The apparatus of claim 11 , wherein said quantization parameter is adjusted based on a glare masking effect between said neighboring reconstructed blocks of said block and said block.

13. The apparatus of claim 12 , further comprising:

determining a JND (Just Noticeable Difference) for a pixel of said block responsive to said glare masking effect, wherein said quantization parameter is adjusted based on said determined JND and said luminance of said block.

14. The apparatus of claim 11 , wherein said quantization parameter is adjusted responsive to a sum of said reconstructed DC transform coefficient of said block and a predicted block for said block.

15. The apparatus of claim 14 , wherein quantization of said AC transform coefficients of said block is based on said adjusted quantization parameter.

16. The apparatus of claim 14 , wherein said one or more processors are further configured to:

determining a quantization ratio based on said sum and said luminance of said neighboring reconstructed blocks of said block, wherein said quantization parameter is adjusted based on said quantization ratio.

17. An apparatus for decoding a video, comprising at least a memory and one or more processors, wherein said one or more processors are configured to:

access a quantization parameter of a block of an image;

access transform coefficients for said block of said image, said transform coefficients including a DC transform coefficient and one or more AC transform coefficients;

decode said DC transform coefficient responsive to said quantization parameter to form a reconstructed DC transform coefficient;

adjust said quantization parameter responsive to said reconstructed DC transform coefficient and luminance of one or more neighboring reconstructed blocks of said block; and

de-quantize said one or more AC transform coefficients responsive to said adjusted quantization parameter.

18. The apparatus of claim 17 , wherein said quantization parameter is adjusted based on a sum of said reconstructed DC transform coefficient of said block and a predicted block for said block.

19. The apparatus of claim 18 , wherein de-quantization of said AC transform coefficients of said block is based on said adjusted quantization parameter.

20. The apparatus of claim 18 , wherein said one or more processors are further configured to:

determine a quantization ratio based on said sum and said luminance of said neighboring blocks of said block, wherein said quantization parameter is adjusted based on said quantization ratio.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE SHOULD BE THOMSON LICENSING NOT THOMSON LISENSING PREVIOUSLY RECORDED ON REEL 045045 FRAME 0477. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 28, 2019
From: GALPIN, FRANCK; GURNEL, HADRIEN; FRANCOIS, EDOUARD
To: THOMSON LICENSING
Reel/Frame 051592/0154 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2018
From: THOMSON LICENSING
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 047289/0698 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2018
From: GALPIN, FRANCK; GURNEL, HADRIEN; FRANCOIS, EDOUARD
To: THOMSON LISENSING
Reel/Frame 045045/0477 →
Priority Claims (1)
EP 15306348 · Sep 2, 2015 · regional
Continuity (1)
Related Publication 20180255302A1 · Sep 6, 2018
Cited By (1)
US 12,513,311