IP Library Patent Application 17120770
Patent Application
App. No. 17/120,770

INFORMATION PROCESSING APPARATUS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/120,770
Abstract

An information processing apparatus includes a processor configured to perform a resolution reduction process on a target image to generate a low-resolution image, the resolution reduction process being a process in which a degree of resolution reduction changes depending on a size of the target image or a size of dispensable information contained in the target image; and perform a generation process of generating, based on the low-resolution image, a super-resolution image having a predetermined resolution corresponding to a resolution of the target image.

Claims (58)

1 . An information processing apparatus comprising:

a processor configured to

perform a resolution reduction process on a target image to generate a low-resolution image, the resolution reduction process being a process in which a degree of resolution reduction changes depending on a size of the target image or a size of dispensable information contained in the target image, and

perform a generation process of generating, based on the low-resolution image, a super-resolution image having a predetermined resolution corresponding to a resolution of the target image.

2 . The information processing apparatus according to claim 1 , wherein in the resolution reduction process, as a deviation between the size of the target image and the size of the dispensable information decreases, the degree of resolution reduction is increased.

3 . The information processing apparatus according to claim 2 , wherein in the resolution reduction process, as the size of the target image increases, the degree of resolution reduction is increased.

4 . The information processing apparatus according to claim 2 , wherein in the resolution reduction process, as the size of the dispensable information increases, the degree of resolution reduction is increased.

5 . The information processing apparatus according to claim 1 ,

wherein the processor is further configured to divide an input image into a plurality of regions,

wherein the resolution reduction process is performed on images of the plurality of regions resulting from the division to generate low-resolution images, each of the images of the plurality of regions serving as the target image, and

wherein the processor is configured to

generate, based on the low-resolution images corresponding to the respective target images, super-resolution images having the predetermined resolution, and

generate, from the generated super-resolution images, a super-resolution image corresponding to the input image.

6 . The information processing apparatus according to claim 2 ,

wherein the processor is further configured to divide an input image into a plurality of regions,

wherein the resolution reduction process is performed on images of the plurality of regions resulting from the division to generate low-resolution images, each of the images of the plurality of regions serving as the target image, and

wherein the processor is configured to

generate, based on the low-resolution images corresponding to the respective target images, super-resolution images having the predetermined resolution, and

generate, from the generated super-resolution images, a super-resolution image corresponding to the input image.

7 . The information processing apparatus according to claim 3 ,

wherein the processor is further configured to divide an input image into a plurality of regions,

wherein the resolution reduction process is performed on images of the plurality of regions resulting from the division to generate low-resolution images, each of the images of the plurality of regions serving as the target image, and

wherein the processor is configured to

generate, based on the low-resolution images corresponding to the respective target images, super-resolution images having the predetermined resolution, and

generate, from the generated super-resolution images, a super-resolution image corresponding to the input image.

8 . The information processing apparatus according to claim 4 ,

wherein the processor is further configured to divide an input image into a plurality of regions,

wherein the resolution reduction process is performed on images of the plurality of regions resulting from the division to generate low-resolution images, each of the images of the plurality of regions serving as the target image, and

wherein the processor is configured to

generate, based on the low-resolution images corresponding to the respective target images, super-resolution images having the predetermined resolution, and

generate, from the generated super-resolution images, a super-resolution image corresponding to the input image.

9 . The information processing apparatus according to claim 5 , wherein in the resolution reduction process, as the size of a region among the plurality of regions increases, the degree of resolution reduction is increased.

10 . The information processing apparatus according to claim 6 , wherein in the resolution reduction process, as the size of a region among the plurality of regions increases, the degree of resolution reduction is increased.

11 . The information processing apparatus according to claim 7 , wherein in the resolution reduction process, as the size of a region among the plurality of regions increases, the degree of resolution reduction is increased.

12 . The information processing apparatus according to claim 8 , wherein in the resolution reduction process, as the size of a region among the plurality of regions increases, the degree of resolution reduction is increased.

13 . The information processing apparatus according to claim 5 ,

wherein in the division, the input image is divided into the plurality of regions according to kinds of objects in the input image, and

wherein in the resolution reduction process, the resolution of each of the images of the plurality of regions is reduced at the degree of resolution reduction according to the kind of the object corresponding to the region.

14 . The information processing apparatus according to claim 6 ,

wherein in the division, the input image is divided into the plurality of regions according to kinds of objects in the input image, and

wherein in the resolution reduction process, the resolution of each of the images of the plurality of regions is reduced at the degree of resolution reduction according to the kind of the object corresponding to the region.

15 . The information processing apparatus according to claim 7 ,

wherein in the division, the input image is divided into the plurality of regions according to kinds of objects in the input image, and

wherein in the resolution reduction process, the resolution of each of the images of the plurality of regions is reduced at the degree of resolution reduction according to the kind of the object corresponding to the region.

16 . The information processing apparatus according to claim 9 ,

wherein in the division, the input image is divided into the plurality of regions according to kinds of objects in the input image, and

wherein in the resolution reduction process, the resolution of each of the images of the plurality of regions is reduced at the degree of resolution reduction according to the kind of the object corresponding to the region.

17 . The information processing apparatus according to claim 1 ,

wherein the generation process is performed using a generator included in a trained generative adversarial network including the generator and a discriminator, and

wherein in training of the generative adversarial network, the generator is trained to generate the super-resolution image having the predetermined resolution from the low-resolution image corresponding to the target image, and the discriminator is trained to differentiate between the target image and the super-resolution image having the predetermined resolution.

18 . The information processing apparatus according to claim 17 , wherein in the training of the generative adversarial network, a loss is calculated based on information on a region of an object of interest in the target image, and the generator is trained based on the calculated loss.

19 . The information processing apparatus according to claim 1 , wherein the generation process is performed with a mechanism including

a first neural network configured to extract an image feature from the low-resolution image,

an attention mechanism configured to process the image feature, and

a second neural network configured to generate the super-resolution image having the predetermined resolution from an output of the attention mechanism.

20 . An information processing apparatus comprising:

first generation circuitry configured to perform a resolution reduction process on a target image to generate a low-resolution image, the resolution reduction process being a process in which a degree of resolution reduction changes depending on a size of the target image or a size of dispensable information contained in the target image; and

second generation circuitry configured to perform a process of generating, based on the low-resolution image, a super-resolution image having a predetermined resolution corresponding to a resolution of the target image.

Assignments (2)
CHANGE OF NAME Recorded Apr 28, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 056078/0098 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2020
From: MACHII, YUSUKE; YAMAURA, YUSUKE; WANG, YIOU
To: FUJI XEROX CO., LTD.
Reel/Frame 054637/0827 →