IP Library › Granted Patent US 12,335,494
Granted Patent B2
US 12,335,494 · App. 18/284,444 · Granted Jun 17, 2025

Smooth surface prediction

Inventors: Kenneth Andersson (Gävle, SE); Jack Enhorn (Bålsta, SE)
Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
H04N19/176H04N19/124H04N19/154H04N19/159H04N19/198
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,494
App. No.
18/284,444
Granted
Jun 17, 2025
Kind
B2
Abstract

A method for making a smooth prediction block of samples in a picture in an image or video encoder or decoder is provided. The method includes determining parameters r of a polynomial model by r=(B T B) −1 *(B T *x), where B is a matrix of bases and x is a source of samples in vector form. The method includes predicting a block x′ based on the parameters r and the matrix of bases B.

Claims (28)

1. A method for adjusting a quantization parameter (QP) for a block in an image, the method comprising:

determining that the block in the image is smooth, wherein determining that the block in the image is smooth is based on information at a sub-block level of granularity;

determining that the OP for the block would reduce the quality of the block after compression;

determining that the image is an intra-coded picture type; and

as a result of determining that: i) the block in the image is smooth, ii) the QP would reduce the quality of the block after compression, and iii) the image is an intra-coded picture type, decreasing the QP for the block so that the block is encoded with higher quality.

2. The method of claim 1 , wherein determining that a block in an image is smooth comprises:

determining parameters for a model based on low-frequency base functions;

predicting predicted samples with the determined parameters;

comparing the predicted samples with source samples of the block to determine an error; and

determining that the error is below a threshold.

3. The method of claim 2 , wherein

the low-frequency base functions comprise polynomial functions, and

comparing the predicted block with source samples to determine an error comprises computing one or more of a sum-of-absolute-differences (SAD) value and a sum-of-squared-differences (SSD) value for the differences between the source samples of the block and the predicted samples.

4. The method of claim 2 , wherein decreasing the QP for the block so that it is encoded with higher quality comprises determining the decrease of the QP based on a linear model such that the decrease is larger for higher QPs and that there is no decrease of the QP below a specified value.

5. The method of claim 4 , wherein the decrease of the QP is determined by min (0,QPscale*QP+QPoffset), where QPscale is a first parameter and QPoffset is a second parameter.

6. The method of claim 4 , wherein the decrease of QP is limited by a limiting value.

7. The method of claim 4 , wherein the decrease of the QP is determined by max (QPlimit, min (0,QPscale*QP+QPoffset)), where QPscale is a first parameter, QPoffset is a second parameter, and QPlimit is a third parameter.

8. The method of claim 1 , further comprising determining that the image has a sequence number within a sequence of images that is a multiple of a value M, wherein

decreasing the quantized parameter (QP) for the block so that it is encoded with higher quality is performed as a result of determining that the image has a sequence number that is a multiple of M.

9. The method of claim 8 , wherein M is 2, 4, 8, 16, or 32.

10. A non-transitory computer readable storage medium storing a computer program comprising instructions which when executed by processing circuitry of a node, causes the node to perform the method of claim 1 .

11. An apparatus, the apparatus comprising:

processing circuitry; and

a memory, the memory containing instructions executable by the processing circuitry, wherein the apparatus is configured to perform a method for adjusting a quantization parameter (OP) for a block in an image, the method comprising:

determining that the block in the image is smooth, wherein determining that the block in the image is smooth is based on information at a sub-block level of granularity;

determining that the QP for the block would reduce the quality of the block after compression;

determining that the image is an intra-coded picture type; and

as a result of determining that: i) the block in the image is smooth, ii) the QP would reduce the quality of the block after compression, and iii) the image is an intra-coded picture type, decreasing the QP for the block so that the block is encoded with higher quality.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2023
From: ANDERSSON, KENNETH; ENHORN, JACK
To: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
Reel/Frame 065460/0170 →
Continuity (2)
Provisional Application 63168613 · Mar 31, 2021
Related Publication 20240171757A1 · May 23, 2024
References Cited (22)
US 10897625B2 · Kwon et al. · 2021 [cited by applicant]
US 20070248164A1 · Zuo et al. · 2007 [cited by applicant]
US 20180288413A1 · Filippov et al. · 2018 [cited by applicant]
US 20190045192A1 · Socek et al. · 2019 [cited by applicant]
EP 2624558A2 · 2013 [cited by applicant]
EP 2993903A1 · 2016 [cited by applicant]
JP 2009533900A · 2009 [cited by applicant]
WO 2007117707A1 · 2007 [cited by applicant]
WO 2018209067A1 · 2018 [cited by applicant]
WO 2020041003A1 · 2020 [cited by applicant]
WO 2020125803A1 · 2020 [cited by applicant]
WO 2020130889A1 · 2020 [cited by applicant]
WO 2022037583A1 · 2022 [cited by applicant]
International Search Report and Written Opinion with Transmittal dated Apr. 27, 2022 issued in International Patent Application No. PCT/SE2022/050315 (19 pages). [cited by applicant]
Chen, J., et. al., “The Joint Exploration Model (JEM) for Video Compression With Capability Beyond HEVC”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, No. 5, May 2020 (18 pages). [cited by applicant]
Hu, W., et. al., “Multiresolution Graph Fourier Transform for Compression of Piecewise Smooth Images”, IEEE Transactions on Image Processing, vol. 24, No. 1, Jan. 2015 (15 pages). [cited by applicant]
Andersson, K., et. al., “AHG 10: QP control for very smooth blocks”, Document: JVET-V0078-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 22nd Meeting, by teleconference, Apr. 20-28, 202… [cited by applicant]
Andersson, K., et. al., “AHG 10: Alignment of smooth QP control with adaptive QP in VTM”, Document: JVET-W0043 v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 23rd Meeting, by teleconfer… [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Versatile video coding”, ITU-T Telecommunications Standardization Sector of ITU, Aug. 2020, pp. 1-516, No. H.… [cited by applicant]
Zhao, X.O. et al., “Lossless Image Compression Using Super-Spatial Structure Prediction”, IEEE Signal Processing Letters, vol. 17, No. 4, Apr. 2010 (4 pages). [cited by applicant]
Wu, X. et al., “Context-Based, Adaptive, Lossless Image Coding”, IEEE Transactions on Communications, vol. 45, No. 4, Apr. 1997 (8 pages). [cited by applicant]
Fernández, D.G. et al., “Complexity reduction in the HEVC/H265 standard based on smooth region classification”, Digital Signal Processing, Academic Press, vol. 73, Nov. 7, 2018 (16 pages). [cited by applicant]