IP Library › Granted Patent US 10,565,684
Granted Patent B2
US 10,565,684 · App. 15/526,138 · Granted Feb 18, 2020

Super-resolution method and system, server, user device and method therefor

Inventors: Lijie Zhang (Beijing, CN); Jianmin He (Beijing, CN); Pablo Navarrete Michelini (Beijing, CN); Xingxing Zhao (Beijing, CN)
Assignee: BOE Technology Group Co., Ltd.
G06T3/4053G06F16/51G06F16/56G06F16/5838G06K9/00624G06K9/4604G06K9/6202G06K9/6269G06K9/6274
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,565,684
App. No.
15/526,138
Granted
Feb 18, 2020
Kind
B2
Abstract

A super-resolution method, a super-resolution system, a user equipment and a server. The super-resolution method includes: training an image sample at a server; obtaining a server-side image database; updating a local image database in a user device by using the server-side image database; and displaying an input low-resolution image as a high-resolution image.

Claims (38)

1. A super-resolution method, comprising:

training image samples at a server, including:

receiving new image samples, and making a selection on the new image samples to select image samples among the new image samples;

obtaining a category for each of the selected image samples; and

performing training according to the category for each of the selected image samples to obtain a new parameter or a new set of parameters of the category for each of the selected image samples;

obtaining a server-side image database, including:

updating a template vector in the server-side image database and a low-resolution-high-resolution dictionary block in the server-side image database by using each of the selected image samples and the new parameter or the new set of parameters of the category of each of the selected image samples;

using the server-side image database, updating a local image database in a user device by updating a template vector in the local image database and a low-resolution-high-resolution dictionary block in the local image database based on the updated template vector in the server-side image database and the low-resolution-high-resolution dictionary block in the server-side image database, wherein the template vector in the server-side image database and the template vector in the local image database include the category and the new parameter or the new set of parameters of the category; and

displaying an input low-resolution image as a high-resolution image.

2. The super-resolution method according to claim 1 , wherein the template vector in the server-side image database and the template vector in the local image database have different levels.

3. The super-resolution method according to claim 1 , wherein the image samples are images or a video.

4. A method for performing super-resolution in a user device, comprising:

receiving update data from a server and updating a template vector in a local image database in the user device and a low-resolution-high-resolution dictionary block in the local image database, wherein the template vector includes a category and parameters corresponding to the category, wherein the update data is obtained by the server performing the following steps:

receiving new image samples, and making a selection on the new image samples to select image samples among the new image samples;

obtaining a category for each of the selected image samples;

performing training according to the category for each of the selected image samples to obtain a new parameter or a new set of parameters of the category for each of the selected image samples; and

updating a template vector in a server-side image database and a low-resolution-high-resolutions dictionary block in the server-side side image database by using each of the selected image samples and the new parameter or the new set of parameters of the category of each of the selected image samples, wherein the updated template vector in the server-side image database and the low-resolution-high-resolution dictionary block in the server-side image database are served as the update data; and

based on the local image database, displaying an input low-resolution image as a high-resolution image.

5. The method according to claim 4 , wherein the displaying the input low-resolution image as the high-resolution image comprises:

preprocessing the input low-resolution image;

performing categorization and feature extraction on the preprocessed low-resolution image;

matching the low-resolution image based on the local image database; and

performing an image fusion on the matched low-resolution image to display the high-resolution image.

6. The method according to claim 4 , wherein the template vector in the server-side image database and the template vector in the local image database have different levels, and

wherein updating the template vector in the local image database includes selecting a level of the template vector to perform updating.

7. A method for performing super-resolution on a server, comprising:

training image samples at the server, including:

receiving new image samples, and performing selection on the new image samples to select image samples among the new image samples;

obtaining a category for each of the selected image samples, and

performing training according to the category for each of the selected image samples to obtain a new parameter or a new set of parameters of the category for each of the selected image samples;

obtaining a server-side image database, including:

updating a template vector in the server-side image database and a low-resolution-high-resolution dictionary block in the server-side image database by using each of the selected image samples and the new parameter or the new set of parameters of the category of each of the selected image samples; and

transmitting update data to a user device to update a template vector in a local image database in the user device and a low-resolution-high-resolution dictionary block in the local image database based on the updated template vector in the server-side image database and the low-resolution-high-resolution dictionary block in the server-side image database, enabling the user device to display an input low-resolution image as a high-resolution image based on the server-side image database, wherein the template vector in the server-side image database and the template vector in the local image database include the category and the new parameter or the new set of parameters of the category.

8. The method according to claim 7 , wherein the template vector in the server-side image database and the template vector in the local image database have different levels.

9. The method according to claim 7 , wherein the image samples are images or a video.

10. A super-resolution system comprising a server and a user device, configured to perform the super-resolution method according to claim 1 .

11. A user device, comprising a processor and a memory, wherein the memory stores instructions that, when executed by the processor, cause the user device to perform the method according to claim 4 .

12. A server, comprising a processor and a memory, wherein the memory stores instructions that, when executed by the processor, cause the server to perform the method according to claim 7 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2017
From: ZHANG, LIJIE; HE, JIANMIN; NAVARRETE MICHELINI, PABLO; ZHAO, XINGXING
To: BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 042352/0630 →
Priority Claims (1)
CN 2015 1 0559699 · Sep 6, 2015 · national
Continuity (1)
Related Publication 20170316548A1 · Nov 2, 2017
Cited By (1)
US 12,682,419