IP Library Granted Patent US 11,205,251
Granted Patent B2
US 11,205,251 · App. 15/987,469 · Granted Dec 21, 2021

Method of image completion

Inventors: Shang-Hong Lai (Hsinchu, TW); Ching-Wei Tseng (Hsinchu, TW); Hung-Jin Lin (Taichung, TW)
Assignee: NATIONAL TSING HUA UNIVERSITY
G06T5/005G06K9/6257G06N3/0454G06N3/088G06T3/60G06T5/20G06T2207/20076G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,205,251
App. No.
15/987,469
Granted
Dec 21, 2021
Kind
B2
Abstract

A method of image completion comprises: constructing the image repair model and constructing a plurality of conditional generative adversarial networks according to a plurality of object types; inputting the training image corresponding to the plurality of objective types such that the plurality of conditional generative adversarial networks respectively conduct a corruption feature training; inputting the image in need of repair and respectively conducting an image repair through the plurality of conditional generative adversarial networks to generate a plurality of repaired images; and judging a reasonable probability of the plurality of repaired images through a probability analyzer, choosing an accomplished image and outputting the accomplished image through an output interface.

Claims (19)

1. A method of image completion, comprising:

configuring, in an image processor, an image repair model and constructing a plurality of conditional generative adversarial networks corresponding to a plurality of object types;

inputting respectively, by an input interface, training images corresponding to the plurality of object types such that each of the plurality of conditional generative adversarial networks conducts corruption feature training respectively;

inputting, by the input interface, an image in need of repair and conducting image repair through the plurality of conditional generative adversarial networks to generate a plurality of repaired images respectively; and

computing, by a first judging model, a reasonable probability of each of the plurality of repaired images, choosing an accomplished image and outputting the accomplished image through an output interface.

2. The method of image completion of claim 1 , wherein the image repair model comprises an image transferring model and a second judging model; the image transferring model transfers the image in need of repair to a sample image; and the second judging model judges whether or not the sample image conforms to a real image.

3. The method of image completion of claim 1 , wherein the corruption feature training further comprises steps below:

generating a plurality of corruption types by a mask processor;

conducting destruction of the plurality of corruption types to the training image to form a plurality of corrupted images; and

amending the image repair model through the plurality of corrupted images and the originally inputted training image.

4. The method of image completion of claim 3 , wherein the plurality of corruption types comprise text corruption, line corruption, scribble corruption, random corruption or corruption of arbitrary polygons.

5. The method of image completion of claim 3 , wherein the destruction to the training image comprises rotating the plurality of corrupted images with a predetermined angle.

6. The method of image completion of claim 1 , wherein the step of inputting the image in need of repair through the input interface further comprises steps below:

marking, by the input interface, a repair area on the image in need of repair; repairing the repair area of the image in need of repair through the plurality of conditional generative adversarial networks; and generating the plurality of repaired images.

7. The method of image completion of claim 1 , wherein the step of inputting the image in need of repair through the input interface further comprises steps below:

marking, by the input interface, an erasure area on the image in need of repair; erasing an image of the erasure area and then conducting the image repair to the erasure area through the plurality of conditional generative adversarial networks; and generating the plurality of repaired images.

8. The method of image completion of claim 1 , wherein the plurality of object types comprise a car, a human being, a dog, a tree, a road or combination thereof.

9. The method of image completion of claim 1 , wherein the plurality of object types comprise facial features of human being, accessories or combination thereof.

10. The method of image completion of claim 1 , wherein the plurality of conditional generative adversarial networks are stored in a database respectively; the image processor connects to each of the databases and simultaneously accesses the plurality of conditional generative adversarial networks for conducting the image repair.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2018
From: LAI, SHANG-HONG; TSENG, CHING-WEI; LIN, HUNG-JIN
To: NATIONAL TSING HUA UNIVERSITY
Reel/Frame 045894/0367 →
Priority Claims (1)
TW 107103068 · Jan 29, 2018 · national
Continuity (1)
Related Publication 20190236759A1 · Aug 1, 2019
Cited By (1)
US 12,423,963