IP Library › Granted Patent US 12,395,629
Granted Patent B2
US 12,395,629 · App. 18/530,476 · Granted Aug 19, 2025

Systems and methods for signaling neural network post-filter filter strength control information in video coding

Inventor: Sachin G. Deshpande (Camas, WA)
Assignee: Sharp Kabushiki Kaisha
H04N19/117H04N19/70H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,395,629
App. No.
18/530,476
Granted
Aug 19, 2025
Kind
B2
Abstract

A device may be configured to perform filtering based on information included in a neural network post-filter characteristics message. In one example, the neural network post-filter characteristics message includes a syntax element indicating auxiliary input data is present in an input tensor of the neural network post-filter. The device may derive a filtering strength control value array where each entry in the array is based on a quantization parameter of a respective input picture for the neural network post-filter.

Claims (15)

1. A method of performing neural network filtering for video data, the method comprising:

receiving a neural network post-filter characteristics message;

parsing a first syntax element from the neural network post-filter characteristics message indicating whether auxiliary input data is present in an input tensor of a neural network post-filter; and

deriving a filtering strength control value array where an entry in the filtering strength control value array is based on a quantization parameter of an input picture for the neural network post-filter,

where the entry in the filtering strength control value array is set equal to a value of (SliceQpY+QpBdOffset)÷(63+QpBdOffset) of a first slice of the input picture,

wherein SliceQpY is based on the quantization parameter, and

QpBdOffset is based on a bit depth.

2. A device comprising one or more processors configured to:

receive a neural network post-filter characteristics message;

parse a first syntax element from the neural network post-filter characteristics message indicating whether auxiliary input data is present in an input tensor of a neural network post-filter; and

derive a filtering strength control value array where an entry in the filtering strength control value array is based on a quantization parameter of an input picture for the neural network post-filter,

where the entry in the filtering strength control value array is set equal to a value of (SliceQpY+QpBdOffset)÷(63+QpBdOffset) of a first slice of the input picture,

wherein SliceQpY is based on the quantization parameter, and

QpBdOffset is based on a bit depth.

3. The device of claim 2 , wherein the device includes a video decoder.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2023
From: SHARP LABORATORIES OF AMERICA, INC
To: SHARP KABUSHIKI KAISHA
Reel/Frame 065777/0922 →
Continuity (2)
Provisional Application 63463211 · May 1, 2023
Related Publication 20240372997A1 · Nov 7, 2024
References Cited (23)
US 12113974B2 · Hannuksela · 2024 [cited by examiner]
US 20190385057A1 · Litichever · 2019 [cited by examiner]
US 20210395821A1 · Habib · 2021 [cited by examiner]
US 20220329837A1 · Li · 2022 [cited by examiner]
US 20220385896A1 · Ding · 2022 [cited by examiner]
US 20230096567A1 · Nalci · 2023 [cited by examiner]
JVET-AA2006-v1 “Additional SEI messages for VSEI (Draft 2)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 27th Meeting, by teleconference, Jul. 13-22, 2022. [cited by applicant]
JVET-Z0082-v2 “AHG11: Content-adaptive neural network post-filter” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 26th Meeting, by teleconference, Apr. 20-29, 2022. [cited by applicant]
“Test Model of Incremental Compression of Neural Networks for Multimedia Content Description and Analysis (INCTM),” ISO/IEC JTC 1/SC 29/WG 04, N0179. Feb. 4, 2022. [cited by applicant]
JVET-Z0052-v1 “AHG9: NNR post-filter SEI message” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 26th Meeting, by teleconference, Apr. 20-29, 2022. [cited by applicant]
JVET-Y2006 “Additional SEI messages for VSEI (Draft 6)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 25th Meeting, by teleconference, Jan. 12-21, 2022. [cited by applicant]
Rec. ITU-T H.274 “Versatile supplemental enhancement information messages for coded video bitstreams” (Aug. 2020). [cited by applicant]
Rec. ITU-T H.273 “Coding-independent code point for video signal type identification” (Jul. 2021). [cited by applicant]
JVET-G1001 “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017. [cited by applicant]
JVET-J1001-v2 “Verastile Video Coding (Draft 1)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, US, Apr. 10-20, 2018. [cited by applicant]
JVET-T2001-v2 “Verastile Video Coding Editorial Refinements on Draft 10)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 20th Meeting, by teleconference, Oct. 7-16, 2020. [cited by applicant]
ITU-T H.265 “High efficiency video coding” (Dec. 2016). [cited by applicant]
ITU-T H.264 “Advanced video coding for generic audiovisual services” (Oct. 2016). [cited by applicant]
ISO/IEC FDIS 15938-17. “Information technology—Multimedia content description interface—Part 17: Compression of neural networks for multimedia content description and analysis” ISO/IEC 15938-17:2020(E). 2021. [cited by applicant]
“Information technology—MPEG video technologies—Part 7: Versatile supplemental enhancement information messages for coded video bitstreams, Amendment 1: Additional SEI messages” 28th Meeting of ISO/IEC JTC1/SC29/WG5 9, … [cited by applicant]
“Improvements under consideration for neural network post filter SEI Messages” 29th Meeting of ISO/IEC JTC1/SC29/ WG5 9, Jan. 11-20, 2023, Teleconference, document JVET-AC2032-v2. [cited by applicant]
“New level and systems-related supplemental enhancement information for VVC (Draft 4)” 29th Meeting of ISO/IEC JTC1/SC29/WG11 Jan. 11-20, 2023, Teleconference, document JVET-AC2005-v1. [cited by applicant]
JVET-AD0362-v2 “BoG report on NNPF and SEI processing order SEI messages” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 30th Meeting, Antalya, TR, Apr. 21-28, 2023. [cited by applicant]