IP Library Granted Patent US 12,192,534
Granted Patent B2
US 12,192,534 · App. 18/476,309 · Granted Jan 7, 2025

Image processing device and method for performing quality optimized deblocking

Inventors: Anand Meher Kotra (Munich, DE); Semih Esenlik (Munich, DE); Biao Wang (Shenzhen, CN); Han Gao (Shenzhen, CN); Zhijie Zhao (Shenzhen, CN); Jianle Chen (San Diego, CA)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/86H04N19/117H04N19/14H04N19/176H04N19/182H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,534
App. No.
18/476,309
Granted
Jan 7, 2025
Kind
B2
Abstract

An image processing device for use in an image encoder and/or an image decoder, for deblocking a block edge between a first block and a second block of an image encoded with a block code, is provided. The image processing device comprises a filter for filtering the block edge, configured to, for at least some of the pixels to be filtered, within a deblocking range from the block edge, the deblocking range being perpendicular to the block edge, determine a filtered pixel value from an original pixel value of the pixel and at least one further pixel value, determine a clipping value of the pixel, dependent upon a distance of the pixel from the block edge, and clip the filtered pixel value, using the clipping value resulting in a deblocked pixel value.

Claims (36)

1. An image processing device for use in an image encoder and/or an image decoder for deblocking a block edge between a first block and a second block of an image, the image processing device comprising:

at least one processor; and

one or more memories coupled to the at least one processor and storing programming instructions for execution by the at least one processor to cause the device to:

generate filtered pixel values from original pixel values of a first pixel, a second pixel and a third pixel, the second pixel and the third pixel being in a same decision pixel line and the first pixel is in a non-decision pixel line;

clip the filtered pixel values of the second pixel and the third pixel using a constant clipping value,

clip the filtered pixel value of the first pixel using a clipping value depending upon a distance of the first pixel from the block edge.

2. The image processing device of claim 1 , wherein a distance of the second pixel from the block edge is different from a distance of the third pixel from the block edge.

3. The image processing device of claim 1 , wherein the clipping the filtered pixel value of the first pixel using a clipping value depending upon a distance of the first pixel from the block edge comprises:

acquiring the clipping value using a function or a look-up table.

4. The image processing device of claim 1 , wherein the clipping value for the first pixel is a monotonically decreasing function of the distance of the first pixel from the block edge.

5. The image processing device of claim 1 , wherein the first pixel, the second pixel, and the third pixel are within a deblocking range from the block edge, the deblocking range comprising a number of pixels in a line perpendicular to the block edge.

6. The image processing device of claim 1 , wherein the at least one processor further executes the instructions to:

determine the filtered first pixel value from the original first pixel value of the first pixel and at least one further pixel value.

7. The image processing device of claim 1 , wherein the decision pixel line is used to determine a filtering to be performed.

8. A deblocking method for deblocking a block edge between a first block and a second block of an image, the method comprising:

generating filtered pixel values from original pixel values of a first pixel, a second pixel and a third pixel; second pixel and the third pixel being in a same decision pixel line and the first pixel is in a non-decision pixel line;

clipping the filtered pixel values of the second pixel and the third pixel using a constant clipping value,

clipping the filtered pixel value of the first pixel using a clipping value depending upon a distance of the first pixel from the block edge.

9. The method of claim 8 , wherein a distance of the second pixel from the block edge is different from a distance of the third pixel from the block edge.

10. The method of claim 8 , wherein the clipping the filtered pixel value of the first pixel using a clipping value depending upon a distance of the first pixel from the block edge comprises:

acquiring the clipping value using a function or a look-up table.

11. The method of claim 8 , wherein the clipping value for the first pixel is a monotonically decreasing function of the distance of the first pixel from the block edge.

12. The method of claim 8 , wherein the first pixel, the second pixel, and the third pixel are within a deblocking range from the block edge, the deblocking range comprising a number of pixels in a line perpendicular to the block edge.

13. The method of claim 8 , wherein the at least one processor further executes the instructions to:

determine the filtered first pixel value from the original first pixel value of the first pixel and at least one further pixel value.

14. The method of claim 8 , wherein the decision pixel line is used to determine a filtering to be performed.

15. A network device for transmitting encoded data, the encoded data includes specific information to allow an encoder to:

generate filtered pixel values from original pixel values of a first pixel, a second pixel and a third pixel; the second pixel and the third pixel being in a same decision pixel line and the first pixel is in a non-decision pixel line;

clip the filtered pixel values of the second pixel and the third pixel using a constant clipping value,

clip the filtered pixel value of the first pixel using a clipping value depending upon a distance of the first pixel from the block edge.

16. The network device of claim 15 , wherein a distance of the second pixel from the block edge is different from a distance of the third pixel from the block edge.

17. The network device of claim 15 , wherein the clipping the filtered pixel value of the first pixel using a clipping value depending upon a distance of the first pixel from the block edge comprises:

acquiring the clipping value using a function or a look-up table.

18. The network device of claim 15 , wherein the clipping value for the first pixel is a monotonically decreasing function of the distance of the first pixel from the block edge.

19. The network device of claim 15 , wherein the first pixel, the second pixel, and the third pixel are within a deblocking range from the block edge, the deblocking range comprising a number of pixels in a line perpendicular to the block edge.

20. The network device of claim 15 , wherein the decision pixel line is used to determine a filtering to be performed.

Continuity (4)
Continuation 17211638 · Mar 24, 2021
Continuation PCTCN2019107409 · Sep 24, 2019
Provisional Application 62735712 · Sep 24, 2018
Related Publication 20240107077A1 · Mar 28, 2024
References Cited (65)
US 7283588B2 · Bjontegaard · 2007 [cited by examiner]
US 7782339B1 · Hobbs · 2010 [cited by examiner]
US 9591306B2 · Wedi · 2017 [cited by examiner]
US 9906790B2 · Kim et al. · 2018 [cited by applicant]
US 10021428B2 · Wedi · 2018 [cited by examiner]
US 10194174B2 · Wedi · 2019 [cited by examiner]
US 10375417B2 · Wedi · 2019 [cited by examiner]
US 10469868B2 · Xi et al. · 2019 [cited by applicant]
US 10575021B2 · Norkin · 2020 [cited by examiner]
US 10616577B2 · Zhang · 2020 [cited by examiner]
US 20050024487A1 · Chen · 2005 [cited by applicant]
US 20050243911A1 · Kwon · 2005 [cited by examiner]
US 20070071106A1 · Graham et al. · 2007 [cited by applicant]
US 20110170793A1 · Sato et al. · 2011 [cited by applicant]
US 20110194614A1 · Norkin et al. · 2011 [cited by applicant]
US 20120287994A1 · Van der Auwera · 2012 [cited by examiner]
US 20130101027A1 · Narroschke · 2013 [cited by examiner]
US 20130170562A1 · Van Der Auwera et al. · 2013 [cited by applicant]
US 20130182762A1 · Seregin · 2013 [cited by examiner]
US 20130188733A1 · Van der Auwera · 2013 [cited by examiner]
US 20130208997A1 · Liu · 2013 [cited by examiner]
US 20130294525A1 · Norkin et al. · 2013 [cited by applicant]
US 20140023136A1 · Park et al. · 2014 [cited by applicant]
US 20140072041A1 · Seregin · 2014 [cited by examiner]
US 20140233648A1 · Kumar · 2014 [cited by examiner]
US 20150117793A1 · Deng et al. · 2015 [cited by applicant]
US 20150146795A1 · Norkin · 2015 [cited by applicant]
US 20150264406A1 · Kim · 2015 [cited by examiner]
US 20170032535A1 · Harding · 2017 [cited by examiner]
US 20170134759A1 · Wedi · 2017 [cited by examiner]
US 20180054632A1 · Nakagawa · 2018 [cited by applicant]
US 20180137629A1 · Mishma · 2018 [cited by examiner]
US 20180146213A1 · Andersson et al. · 2018 [cited by applicant]
US 20180192071A1 · Chuang et al. · 2018 [cited by applicant]
US 20180205948A1 · Kawamura · 2018 [cited by examiner]
US 20180205969A1 · Wedi · 2018 [cited by examiner]
US 20190116384A1 · Wedi · 2019 [cited by examiner]
US 20190261020A1 · Galpin et al. · 2019 [cited by applicant]
CN 1444408A · 2003 [cited by applicant]
CN 103385001A · 2013 [cited by applicant]
CN 106105201A · 2016 [cited by applicant]
CN 106604039A · 2017 [cited by applicant]
CN 107426571A · 2017 [cited by applicant]
EP 2870758B1 · 2016 [cited by applicant]
JP 2014207718A · 2014 [cited by applicant]
KR 101001676B1 · 2010 [cited by applicant]
RU 2557766C2 · 2015 [cited by applicant]
WO 2011113343A1 · 2011 [cited by applicant]
WO 2011126287A2 · 2011 [cited by applicant]
WO 2012096623A1 · 2012 [cited by applicant]
WO 2012119540A1 · 2012 [cited by applicant]
WO 2013034649A1 · 2013 [cited by applicant]
WO 2013064654A1 · 2013 [cited by applicant]
WO 2013104298A1 · 2013 [cited by applicant]
WO 2012096614A3 · 2013 [cited by applicant]
WO 2014007735A1 · 2014 [cited by applicant]
WO 2018057339A1 · 2018 [cited by applicant]
Document: JVET-L0226-r1, Anand Meher Kotra et al, CE11-related: Position dependent adaptive Tc clipping range for deblocking filter, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12t… [cited by applicant]
Document: JCTVC-C403, Thomas Wiegand et al, WD1: Working Draft 1 of High-Efficiency Video Coding, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 3rd Meeting: Guangzhou, C… [cited by applicant]
ITU-T H.261 (Mar. 1993), Line Transmission of Non-Telephone Signals, Video Codec for Audiovisual Services At p x 64 kbits, total 29 pages. [cited by applicant]
Norkin Andrey: “HEVC-based deblocking filter with ramp preservationproperties”, 2014 IEEE International Conference on Imageprocessing (ICIP), IEEE, 2014, 5 pages. [cited by applicant]
Anonymous: “Lookup table—Wikipedia, the free encyclopedia”, Mar. 23, 2016 (Mar. 23, 2016), pp. 1-7, XP055889099. [cited by applicant]
ITU-T H.264(Apr. 2017), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, total 812 pages. [cited by applicant]
Andrey Norkin et al: “Chapter 7: In-Loop Filters in HEVC” In: “High Efficiency Video Coding (HEVC)”, Aug. 23, 2014 (Aug. 23, 2014), Springer International Publishing, Cham, XP055614202. [cited by applicant]
ITU-T H.265(Feb. 2018), Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, total 692 pages. [cited by applicant]