IP Library › Granted Patent US 11,200,639
Granted Patent B1
US 11,200,639 · App. 17/237,775 · Granted Dec 14, 2021

Apparatus and method for performing artificial intelligence encoding and decoding on image by using low-complexity neural network

Inventors: Jaehwan Kim (Suwon-si, KR); Youngo Park (Suwon-si, KR); Kwangpyo Choi (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T3/4046G06N3/0454G06N3/08G06T9/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,200,639
App. No.
17/237,775
Granted
Dec 14, 2021
Kind
B1
Abstract

An artificial intelligence (AI) encoding apparatus includes a processor configured to execute one or more instructions stored in the AI encoding apparatus to: input, to a downscale deep neural network (DNN), a first reduced image downscaled from an original image and a reduction feature map having a resolution lower than a resolution of the original image; obtain a first image AI-downscaled from the original image in the downscale DNN; generate image data by performing a first encoding process on the first image; and output the image data.

Claims (25)

1. A server for providing an image using artificial intelligence (AI), the server comprising:

a processor configured to execute one or more instructions stored in the server to:

obtain, as a reduction feature map having a resolution lower than a resolution of an original image, a residual image between a first reduced image and a second reduced image that are downscaled from the original image;

obtain a first image by inputting, to a downscale neural network (NN), the first reduced image and the reduction feature map, and by adding an output image of a last layer of the downscale NN and the second reduced image;

encode the first image to generate image data; and

provide an electronic device with the image data.

2. The server of claim 1 , wherein the processor is further configured to:

obtain a plurality of first reduced images comprising pixels located at different points from each other within pixel groups of the original image; and

obtain, as the reduction feature map, a plurality of residual images between the plurality of first reduced images and the second reduced image.

3. The server of claim 2 , wherein a sum of a number of the plurality of first reduced images and a number of the plurality of residual images is equal to a number of input channels of a first layer of the downscale NN.

4. The server of claim 1 , wherein the processor is further configured to obtain an edge map corresponding to the original image as the reduction feature map.

5. The server of claim 1 , wherein the processor is further configured to:

upscale the second reduced image is downscaled from the original image; and

obtain, as the reduction feature map, the residual image between the second reduced image that is upscaled after being downscaled and the first reduced image.

6. The server of claim 1 , wherein output data of any one layer of a plurality of layers of the downscale NN is added to output data of preceding layers prior to the any one layer, and a sum of the output data of the any one layer and the output data of the preceding layers is input to a next layer of the any one layer.

7. A method for providing an image by a server configured to use artificial intelligence (AI), the method comprising:

obtaining, as a reduction feature map having a resolution lower than a resolution of an original image, a residual image between a first reduced image and a second reduced image that are downscaled from the original image

obtaining a first image by inputting, to a downscale neural network (NN), the first reduced image and the reduction feature map and by adding an output image of a last layer of the downscale NN and the second reduced image;

encoding the first image to generate image data; and

providing an electronic device with the image data.

8. The method of claim 1 , further comprising:

obtaining a plurality of first reduced images comprising pixels located at different points from each other within pixel groups of the original image; and

obtaining, as the reduction feature map, a plurality of residual images between the plurality of first reduced images and the second reduced image.

9. The method of claim 8 , wherein a sum of a number of the plurality of first reduced images and a number of the plurality of residual images is equal to a number of input channels of a first layer of the downscale NN.

10. A computer-readable recording medium having recorded thereon a program for executing the method of claim 7 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2021
From: KIM, JAEHWAN; PARK, YOUNGO; CHOI, KWANGPYO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 056027/0267 →
Priority Claims (2)
KR 10-2020-0070984 · Jun 11, 2020 · national
KR 10-2020-0128878 · Oct 6, 2020 · national
Cited By (2)
US 12,634,495 US 12,682,236