IP Library › Granted Patent US 12,373,918
Granted Patent B2
US 12,373,918 · App. 17/928,437 · Granted Jul 29, 2025

Picture enhancement method and apparatus

Inventor: Fangdong Chen (Zhejiang, CN)
Assignee: HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO., LTD.
G06T5/20G06V10/751H04N19/117H04N19/82H04N19/86
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,918
App. No.
17/928,437
Granted
Jul 29, 2025
Kind
B2
Abstract

Provided are a picture enhancement method and apparatus. The picture enhancement method includes: for any one pixel, which meets a first filtering condition, in a current block, determining a first pixel value of the pixel after first filtering; and performing enhancement on a pixel value of the pixel based on the first pixel value and a second pixel value of the pixel point before the first filtering, so as to obtain a third pixel value, which has been subjected to enhancement, of the pixel.

Claims (57)

1. A picture enhancement method, comprising:

determining, for a pixel within a current block that meets a first filtering condition, a first pixel value of the pixel after first filtering; and

performing, based on the first pixel value and a second pixel value of the pixel before the first filtering, enhancement on a pixel value of the pixel to obtain an enhanced third pixel value of the pixel;

wherein the performing, based on the first pixel value and the second pixel value of the pixel before the first filtering, the enhancement on the pixel value of the pixel comprises:

performing, based on a difference between the first pixel value and the second pixel value, the enhancement on the pixel value of the pixel;

wherein the performing, based on the difference between the first pixel value and the second pixel value, the enhancement on the pixel value of the pixel comprises:

performing, based on a result of comparing the difference with predetermined thresholds, the enhancement on the pixel value of the pixel;

wherein the performing, based on the result of comparing the difference with the predetermined thresholds, the enhancement on the pixel value of the pixel comprises:

performing, in a case that the difference is greater than a first enhancement filtering threshold, the enhancement on the pixel value of the pixel based on a first enhancement filtering offset; and

performing, in a case that the difference is smaller than a second enhancement filtering threshold, the enhancement on the pixel value of the pixel based on a second enhancement filtering offset,

wherein the second enhancement filtering threshold is smaller than the first enhancement filtering threshold.

2. The method according to claim 1 , wherein the performing the enhancement on the pixel value of the pixel based on the first enhancement filtering offset comprises:

determining, based on the first pixel value and the second pixel value, a fourth pixel value; and

performing the enhancement on the fourth pixel value based on the first enhancement filtering offset to obtain the third pixel value.

3. The method according to claim 1 , wherein the performing the enhancement on the pixel value of the pixel based on the first enhancement filtering offset comprises:

performing the enhancement on the first pixel value based on the first enhancement filtering offset to obtain the third pixel value.

4. The method according to claim 1 , wherein the performing the enhancement on the pixel value of the pixel based on the second enhancement filtering offset comprises:

determining, based on the first pixel value and the second pixel value, a fourth pixel value; and

performing the enhancement on the fourth pixel value based on the second enhancement filtering offset to obtain the third pixel value.

5. The method according to claim 1 , wherein the performing the enhancement on the pixel value of the pixel based on the second enhancement filtering offset comprises:

performing the enhancement on the first pixel value based on the second enhancement filtering offset to obtain the third pixel value.

6. The method according to claim 1 , wherein the performing, based on the result of comparing the difference with the predetermined thresholds, the enhancement on the pixel value of the pixel comprises:

determining, in a case that the difference is smaller than or equal to the first enhancement filtering threshold and greater than or equal to the second enhancement filtering threshold, the first pixel value as the third pixel value.

7. The method according to claim 1 , further comprising:

the first enhancement filtering threshold is an opposite number of the second enhancement filtering threshold.

8. The method according to claim 1 , further comprising:

coding/decoding a threshold index, wherein the threshold index represents a position of the first enhancement filtering threshold or the second enhancement filtering threshold in a threshold candidate list; and

coding/decoding an offset index, wherein the offset index represents a position of the first enhancement filtering offset or the second enhancement filtering offset in an offset candidate list.

9. The method according to claim 1 , wherein the performing, based on the first pixel value and the second pixel value of the pixel before the first filtering, the enhancement on the pixel value of the pixel comprises:

determining the third pixel value by using machine learning or deep learning with the first pixel value and the second pixel value as input parameters.

10. The method according to claim 1 , wherein the performing, based on the first pixel value and the second pixel value of the pixel before the first filtering, the enhancement on the pixel value of the pixel comprises:

performing, in a case that enhancement filtering is enabled for the current block, the enhancement on the pixel value of the pixel based on the first pixel value and the second pixel value.

11. The method according to claim 10 , wherein whether the enhancement filtering is enabled for the current block is identified with a designated syntax, and

a level of the designated syntax comprises at least one of a syntax at a Sequence Parameter Set (SPS) level, a syntax at a Picture Parameter Set (PPS) level, or a syntax at a Slice level; or

the level of the designated syntax comprises at least one of a syntax at the SPS level, a syntax at the PPS level, a syntax at a Coding Tree Unit (CTU) level, or a syntax at a Coding Unit (CU) level.

12. The method according to claim 11 , further comprising:

determining, in a case that one or more candidate levels of the designated syntax comprise at least two levels, a level of the designated syntax based on a predetermined flag bit which indicates the level of the designated syntax.

13. The method according to claim 12 , wherein a syntax level of the predetermined flag bit matches with a non-lowest level in the candidate levels of the designated syntax.

14. The method according to claim 1 , wherein the first filtering comprises at least one of vertical DeBlocking Filter (DBF) filtering, horizontal DBF filtering, Sample Adaptive Offset (SAO) filtering, or Adaptive Loop Filter (ALF) filtering.

15. The method according to claim 1 wherein, in a case that the first filtering is a non-first filtering in a succession of filtering for the pixel, the second pixel value is a pixel value obtained by performing enhancement on a pixel value of the pixel on which previous filtering is performed.

16. The method according to claim 15 , wherein the first filtering is horizontal DeBlocking Filter (DBF) filtering,

in a case that the pixel meets a vertical DBF filtering condition, the second pixel value is a pixel value of the pixel obtained from performing enhancement on a fifth pixel value of the pixel, and the fifth pixel value is a pixel value obtained from performing vertical DBF filtering on the pixel.

17. The method according to claim 1 , wherein the first filtering is vertical DeBlocking Filter (DBF) filtering, and

when the pixel value of the pixel has been performed the enhancement, the method further comprises:

in a case that the pixel meets a horizontal DBF filtering condition, performing horizontal DBF filtering on the third pixel value to obtain a sixth pixel value of the pixel; and

performing enhancement on the pixel value of the pixel based on the third pixel value and the sixth pixel value to obtain an enhanced seventh pixel value of the pixel.

18. A picture enhancement apparatus, comprising a processor and a memory, wherein the memory stores a computer program and the processor is caused by the computer program to:

determine, for a pixel within a current block that meets a first filtering condition, a first pixel value of the pixel after first filtering; and

perform, based on the first pixel value and a second pixel value of the pixel before the first filtering, enhancement on a pixel value of the pixel to obtain an enhanced third pixel value of the pixel;

wherein the performing, based on the first pixel value and the second pixel value of the pixel before the first filtering, the enhancement on the pixel value of the pixel comprises:

performing, based on a difference between the first pixel value and the second pixel value, the enhancement on the pixel value of the pixel;

wherein the performing, based on the difference between the first pixel value and the second pixel value, the enhancement on the pixel value of the pixel comprises:

performing, based on a result of comparing the difference with predetermined thresholds, the enhancement on the pixel value of the pixel;

wherein the performing, based on the result of comparing the difference with the predetermined thresholds, the enhancement on the pixel value of the pixel comprises:

performing, in a case that the difference is greater than a first enhancement filtering threshold, the enhancement on the pixel value of the pixel based on a first enhancement filtering offset; and

performing, in a case that the difference is smaller than a second enhancement filtering threshold, the enhancement on the pixel value of the pixel based on a second enhancement filtering offset,

wherein the second enhancement filtering threshold is smaller than the first enhancement filtering threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2025
From: CHEN, FANGDONG
To: HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO., LTD.
Reel/Frame 071439/0883 →
Priority Claims (1)
CN 202010508167.4 · Jun 5, 2020 · national
Continuity (1)
Related Publication 20230214969A1 · Jul 6, 2023
References Cited (43)
US 5446501A · Takemoto et al. · 1995 [cited by applicant]
US 5694492A · Kim · 1997 [cited by applicant]
US 6778692B1 · Yazici · 2004 [cited by applicant]
US 7999972B2 · Goto et al. · 2011 [cited by applicant]
US 8139269B2 · Goto et al. · 2012 [cited by applicant]
US 8441701B2 · Goto et al. · 2013 [cited by applicant]
US 9344716B2 · Seregin · 2016 [cited by applicant]
US 10600156B2 · Kim · 2020 [cited by examiner]
US 20080123152A1 · Goto et al. · 2008 [cited by applicant]
US 20100165207A1 · Deng · 2010 [cited by examiner]
US 20110267655A1 · Goto et al. · 2011 [cited by applicant]
US 20120147432A1 · Goto et al. · 2012 [cited by applicant]
US 20120201311A1 · Sole · 2012 [cited by examiner]
US 20130243104A1 · Chen et al. · 2013 [cited by applicant]
US 20160180504A1 · Kounavis · 2016 [cited by examiner]
US 20170013280A1 · Norkin et al. · 2017 [cited by applicant]
US 20190297320A1 · Yoshiya et al. · 2019 [cited by applicant]
CN 107750459 · 2018 [cited by applicant]
CN 110495168 · 2019 [cited by applicant]
CN 111133757 · 2020 [cited by applicant]
EP 0680219A2 · 1995 [cited by examiner]
EP 2624555 · 2013 [cited by applicant]
JP 2002354256A · 2002 [cited by applicant]
JP 2008017291 · 2008 [cited by applicant]
KR 1020120140181 · 2012 [cited by applicant]
RU 2550541C2 · 2015 [cited by applicant]
RU 2651183C2 · 2018 [cited by applicant]
RU 2679190C2 · 2019 [cited by applicant]
WO 2012042821 · 2012 [cited by applicant]
WO 2017195532 · 2017 [cited by applicant]
WO 2018123800A1 · 2018 [cited by applicant]
WO 2021244617A1 · 2021 [cited by applicant]
European Patent Office, Extended European Search Report Issued in the corresponding European Application No. 21816788.0, Oct. 9, 2023. [cited by applicant]
Andrey Norkin et al, “Chapter 7: In-Loop Filters in HEVC”, In: High Efficiency Video Coding (HEVC), Springer International publishing, Cham, pp. 171-208, Aug. 23, 2014, 38 pages. [cited by applicant]
Yu-Ling Hsiao et al, “CE13-1.1: Convolutional neural network loop filter”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0110-v1, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 5 … [cited by applicant]
Australian Patent Office, Office Action Issued in the corresponding Australian Application No. 2021283592, Jul. 20, 2023, 3 pages. [cited by applicant]
Australian Patent Office, Office Action Issued in the corresponding Australian Application No. 2021283592, Oct. 31, 2023, 4 pages. [cited by applicant]
Japanese Patent Office Action, Office Action Issued in Application No. 2022-574287, Oct. 2, 2023, 8 pages, (Submitted with Partial Translation) . [cited by applicant]
TW Patent Office, Office Action Issued in the corresponding Taiwan Application No. 110120516, Jul. 24, 2023, 5 pages (Submitted with Partial Translation). [cited by applicant]
International Search Report for PCT/CN2021/098177 mailed on Aug. 18, 2021and its English translation provided by WIPO. [cited by applicant]
Written Opinion of the International Searching Authority for PCT/CN2021/098177 mailed on Aug. 18, 2021 and its English translation provided by Google Translate. [cited by applicant]
Chinese Office Action and Search Report for Application No. 2020105081674, issued on Mar. 28, 2022, with English translation provided by global dossier. [cited by applicant]
Fang Tao et al. “Research on deblocking filter in High Efficiency Video Coding (HEVC)”, Chinese Master's Theses Full-text Database, Feb. 15, 2018, and its English translation provided by applicant's foreign counsel. [cited by applicant]