IP Library › Granted Patent US 12,301,885
Granted Patent B2
US 12,301,885 · App. 18/116,804 · Granted May 13, 2025

Systems and methods for signaling neural network post-filter resolution information in video coding

Inventor: Sachin G. Deshpande (Camas, WA)
Assignee: Sharp Kabushiki Kaisha
H04N19/80G06T9/002H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,885
App. No.
18/116,804
Granted
May 13, 2025
Kind
B2
Abstract

A device may be configured to perform filtering based on information included in a neural network post-filter characteristics message. In one example, the neural network post-filter characteristics message includes syntax elements specifying a height and width of a luma sample array of a picture resulting from applying a neural network post-filter.

Claims (17)

1. A method of performing neural network filtering for video data, the method comprising:

receiving a neural network post-filter characteristics message specifying a neural network post processing filter;

parsing a first syntax element in the neural network post-filter characteristics message, wherein the first syntax element plus one specifies a denominator of a resampling ratio of a width of a picture generated by the neural network post processing filter relative to a cropped width;

parsing a second syntax element in the neural network post-filter characteristics message, wherein the second syntax element plus one specifies a numerator of the resampling ratio of the width of the picture generated by the neural network post processing filter relative to the cropped width;

parsing a third syntax element in the neural network post-filter characteristics message, wherein the third syntax element plus one specifies a denominator of a resampling ratio of a height of a picture generated by the neural network post processing filter relative to a cropped height;

parsing a fourth syntax element in the neural network post-filter characteristics message, wherein the fourth syntax element plus one specifies a numerator of the resampling ratio of the height of the picture generated by the neural network post processing filter relative to the cropped height;

calculating a width of a luma sample array of the picture resulting from applying the neural network post processing filter by multiplying the cropped width by the resampling ratio of the width; and

calculating a height of the luma sample array of the picture resulting from applying the neural network post processing filter by multiplying the cropped height by the resampling ratio of the height.

2. A device comprising one or more processors configured to:

receive a neural network post-filter characteristics message specifying a neural network post processing filter;

parse a first syntax element from in the neural network post-filter characteristics message, wherein the first syntax element plus one specifies a denominator of a resampling ratio of a width of a picture generated by the neural network post processing filter relative to a cropped width;

parse a second syntax element in the neural network post-filter characteristics message, wherein the second syntax element plus one specifies a numerator of the resampling ratio of the width of the picture generated by the neural network post processing filter relative to the cropped width;

parse a third syntax element in the neural network post-filter characteristics message, wherein the third syntax element plus one specifies a denominator of a resampling ratio of a height of a picture generated by the neural network post processing filter relative to a cropped height;

parse a fourth syntax element in the neural network post-filter characteristics message, wherein the fourth syntax element plus one specifies a numerator of the resampling ratio of the height of the picture generated by the neural network post processing filter relative to the cropped height;

calculate a width of a luma sample array of the picture resulting from applying the neural network post processing filter by multiplying the cropped width by the resampling ratio of the width; and

calculate a height of the luma sample array of the picture resulting from applying the neural network post processing filter by multiplying the cropped height by the resampling ratio of the height.

3. The device of claim 2 , wherein the device includes a video decoder.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2023
From: DESHPANDE, SACHIN G.
To: SHARP KABUSHIKI KAISHA
Reel/Frame 062863/0620 →
Continuity (1)
Related Publication 20240298036A1 · Sep 5, 2024
References Cited (18)
WO WO2024039678A1 · 2024 [cited by examiner]
WO WO2024039680A1 · 2024 [cited by examiner]
JVET-AA2006-v1 “Additional SEI messages for VSEI (Draft 2)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 27th Meeting, by teleconference, Jul. 13-22, 2022. [cited by applicant]
JVET-Z0082-v2 “AHG11: Content-adaptive neural network post-filter” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 26th Meeting, by teleconference, Apr. 20-29, 2022. [cited by applicant]
“Test Model of Incremental Compression of Neural Networks for Multimedia Content Description and Analysis (INCTM),” ISO/IEC JTC 1/SC 29/WG 04, N0179. Feb. 4, 2022. [cited by applicant]
JVET-Z0052-v1 “AHG9: NNR post-filter SEI message” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 26th Meeting, by teleconference, Apr. 20-29, 2022. [cited by applicant]
JVET-Y2006 “Additional SEI messages for VSEI (Draft 6)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 25th Meeting, by teleconference, Jan. 12-21, 2022. [cited by applicant]
Rec. ITU-T H.274 “Versatile supplemental enhancement information messages for coded video bitstreams” (Aug. 2020). [cited by applicant]
Rec. ITU-T H.273 “Coding-independent code point for video signal type identification” (Jul. 2021). [cited by applicant]
JVET-G1001 “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017. [cited by applicant]
JVET-J1001-v2 “Verastile Video Coding (Draft 1)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, US, Apr. 10-20, 2018. [cited by applicant]
JVET-T2001-v2 “Verastile Video Coding Editorial Refinements on Draft 10)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 20th Meeting, by teleconference, Oct. 7-16, 2020. [cited by applicant]
ITU-T H.265 “High efficiency video coding” (Dec. 2016). [cited by applicant]
ITU-T H.264 “Advanced video coding for generic audiovisual services” (Oct. 2016). [cited by applicant]
ISO/IEC FDIS 15938-17. “Information technology—Multimedia content description interface—Part 17: Compression of neural networks for multimedia content description and analysis” ISO/IEC 15938-17:2020(E). 2021. [cited by applicant]
“Information technology—MPEG video technologies—Part 7: Versatile supplemental enhancement information messages for coded video bitstreams, Amendment 1: Additional SEI messages” 28th Meeting of ISO/IEC JTC1/SC29/WG5 9, … [cited by applicant]
“Improvements under consideration for neural network post filter SEI Messages” 29th Meeting of ISO/IEC JTC1/SC29/WG5 9, Jan. 11-20, 2023, Teleconference, document JVET-AC2032-v2. [cited by applicant]
Y-K Wang (Bytedance): “AHG9: A summary of proposals on NNPF SEI messages”, 28. JVET Meeting; Oct. 21, 2022-Oct. 28, 2022; Mainz; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No. JVET-AB0… [cited by applicant]