IP Library Granted Patent US 11,889,070
Granted Patent B2
US 11,889,070 · App. 17/040,404 · Granted Jan 30, 2024

Image filtering apparatus, image decoding apparatus, and image coding apparatus

Inventors: Tomohiro Ikai (Sakai, JP); Norio Itoh (Sakai, JP); Takeshi Chujoh (Sakai, JP); Yasuaki Tokumo (Sakai, JP); Hiroshi Watanabe (Tokyo, JP)
Assignee: SHARP KABUSHIKI KAISHA
H04N19/117G06N3/08H04N19/124H04N19/159H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,889,070
App. No.
17/040,404
Granted
Jan 30, 2024
Kind
B2
Abstract

A filtered image with enhanced image quality is output. Provided is a loop filter including: a filtering processing unit configured to apply a filter to an unfiltered image; and an ALF unit configured to receive input of a DL image to which a filter is applied by a first filtering processing unit out of the filtering processing unit. The ALF unit further receives input of the unfiltered image.

Claims (16)

1. An image filtering apparatus for filtering an input image, the image filtering apparatus comprising:

a loop filter that includes (i) at least a first neural network filter and a second neural network filter, and (ii) an adaptive loop filter,

wherein:

the first neural network filter receives (i) the input image and (ii) an image of a quantization parameter which is defined by an array of two dimensions, and outputs a first output image,

the second neural network filter receives the input image or the first output image, and outputs a second output image, and

the adaptive loop filter receives (i) the input image, (ii) the first output image, and (iii) the second output image, and outputs a filtered image, as a third output image.

2. The image filtering apparatus according to claim 1 , wherein:

a neural network includes a plurality of layers in each of which filters applied, and

the adaptive loop filter receives (i) the first output image in which the filters are applied in all of the plurality of layers and (ii) the second output image in which the filters are applied in one or multiple layers of the plurality of layers.

3. An image decoding apparatus for decoding an image, the image decoding apparatus comprising:

the image filtering apparatus according to claim 1 as a filter to be applied to a decoded image.

4. An image encoding apparatus for encoding an image, the image encoding apparatus comprising:

the image filtering apparatus according to claim 1 as a filter to be applied to the input image.

5. The image filtering apparatus according to claim 1 , wherein:

the second neural network filter is a subset of the first neural network filter, and

the second neural network filter outputs one or multiple inter-mediate layers of the first neural network filter as the second output image.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2023
From: SHARP KABUSHIKI KAISHA; SHARP CORPORATION
To: SHARP KABUSHIKI KAISHA
Reel/Frame 063374/0217 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2023
From: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
To: SHARP KABUSHIKI KAISHA; SHARP CORPORATION
Reel/Frame 062389/0715 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2021
From: IKAI, TOMOHIRO; ITOH, NORIO; CHUJOH, TAKESHI; TOKUMO, YASUAKI; WATANABE, HIROSHI
To: SHARP KABUSHIKI KAISHA; FG INNOVATION COMPANY LIMITED
Reel/Frame 056254/0121 →