IP Library › Granted Patent US 10,516,890
Granted Patent B2
US 10,516,890 · App. 15/680,708 · Granted Dec 24, 2019

Accelerating machine optimisation processes

Inventors: Zehan Wang (London, GB); Robert David Bishop (London, GB); Wenzhe Shi (London, GB); Jose Caballero (London, GB); Andrew Peter Aitken (London, GB); Johannes Totz (London, GB)
Assignee: Magic Pony Technology Limited
H04N19/36G06K9/46G06K9/6215G06K9/66G06N3/04G06N3/049G06N3/0445G06N3/0454G06N3/08G06T3/40G06T3/4007G06T3/4046G06T3/4053G06T5/001G06T5/002G06T7/11H04N7/0117H04N19/117H04N19/142H04N19/154H04N19/172H04N19/177H04N19/31H04N19/33H04N19/46H04N19/59H04N19/80H04N19/86G06T2207/10016G06T2207/20081G06T2207/20084H04N19/176H04N19/87
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,516,890
App. No.
15/680,708
Granted
Dec 24, 2019
Kind
B2
Abstract

A method for training learned hierarchical algorithms, the method comprising the steps of receiving input data and generating metrics from the input data. At least one hierarchical algorithm is then selected from a plurality of predetermined hierarchical algorithms based on comparing the generated metrics from the input data and like metrics for each of the plurality of predetermined hierarchical algorithms. The selected hierarchical algorithm is developed based on the input data and the developed hierarchical algorithm is outputted.

Claims (37)

1. A method for training learned hierarchical algorithms, the method comprising the steps of:

receiving input data;

generating metric data from the input data, the metric data measuring quality of output data produced for the input data by a plurality of pre-trained hierarchical algorithms stored in a library, wherein each of the plurality of pre-trained hierarchical algorithms is associated with respective metric data and each is trained on different input data;

selecting at least one hierarchical algorithm from the plurality of pre-trained hierarchical algorithms based on comparing the respective metric data;

training, using a deep learning approach, the at least one hierarchical algorithm based on the input data to generate a new trained hierarchical algorithm; and

adding the new trained a hierarchical algorithm to the library.

2. The method of claim 1 , wherein each of the plurality of pre-trained hierarchical algorithms are stored with features extracted from the input data used in training the hierarchical algorithm.

3. The method of claim 1 , wherein training the at least one hierarchical algorithm includes training the at least one hierarchical algorithm for a predetermined number of iterations.

4. The method of claim 1 , wherein the metric data includes an error rate, a peak signal-to-noise ratio, a distance metric, a similarity measure, or a structural similarity index.

5. The method of claim 1 , wherein training the at least one hierarchical algorithm includes training the at least one hierarchical algorithm until a predetermined value of reconstruction error is reached.

6. The method of claim 1 , wherein the input data is a section of video and the metric data is based on a style of the section of video.

7. The method of claim 1 , wherein the hierarchical algorithm is a non-linear hierarchical algorithm.

8. The method of claim 1 , wherein the hierarchical algorithm performs image enhancement, using super-resolution techniques.

9. The method of claim 1 , wherein the hierarchical algorithm uses a spatio-temporal approach.

10. The method of claim 1 , wherein each of the pre-trained hierarchical algorithms in the library has a library reference identifier.

11. A method for training neural networks, the method comprising the steps of:

receiving input data;

generating metric data from the input data, the metric data measuring quality of output data produced for the input data by a plurality of pre-trained neural networks stored in a library, wherein each of the plurality of pre-trained neural networks is associated with respective metric data and each is trained on different input data;

selecting at least one neural network from the plurality of pre-trained neural networks based on comparing the respective metric data;

training, using a deep learning approach, the at least one neural network based on the input data to generate a new trained neural network; and

adding the new trained neural network to the library.

12. The method of claim 11 , further comprising the step of:

storing the new trained neural network with features generated from the input data.

13. The method of claim 11 , wherein the metric data is based on generating the highest quality output data, and wherein the quality is defined using an error rate, a peak signal-to-noise ratio, a distance metric, a similarity measure, or a structural similarity index.

14. The method of claim 11 , wherein the at least one neural network is a convolutional neural network.

15. The method of claim 11 , wherein the metric data is a similarity measure, generating the metric data from the input data includes extracting features of the input data and selecting the at least one neural network includes:

using the extracted features to select the at least one pre-trained neural network from the plurality of neural networks as associated with features most similar to the features of the input data.

16. The method of claim 11 , wherein each of the pre-trained neural networks in the library has a library reference identifier.

17. The method of claim 11 , wherein the respective metric data measures how optimal the pre-trained neural network is for providing initialisation data for generating the new neural network.

18. The method of claim 11 , wherein the input data comprises any of: a sequence of frames of visual data and a region within a sequence of frames of visual data.

19. The method of claim 11 , wherein the training occurs for a pre-determined number of iterations to limit computational time.

20. A computer program product embodied on a non-transitory storage medium and comprising instructions that, when executed, cause a system to train learned hierarchical algorithms, by performing the steps of:

receiving input data;

generating metric data from the input data, the metric data measuring quality of output data produced for the input data by a plurality of pre-trained hierarchical algorithms stored in a library, wherein each of the plurality of pre-trained hierarchical algorithms is associated with respective metric data and each is trained on different input data;

selecting at least one hierarchical algorithm from the plurality of pre-trained hierarchical algorithms based on comparing the respective metric data;

training, using a deep learning approach, the at least one hierarchical algorithm based on the input data to generate a new trained hierarchical algorithm; and

adding the new trained hierarchical algorithm to the library.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2017
From: WANG, ZEHAN; BISHOP, ROBERT DAVID; SHI, WENZHE; CABALLERO, JOSE; AITKEN, ANDREW PETER; TOTZ, JOHANNES
To: MAGIC PONY TECHNOLOGY LIMITED
Reel/Frame 043618/0412 →
Priority Claims (8)
GB 1502753.5 · Feb 19, 2015 · national
GB 1503427.5 · Feb 27, 2015 · national
GB 1505544.5 · Mar 21, 2015 · national
GB 1507141.8 · Apr 27, 2015 · national
GB 1508742.2 · May 21, 2015 · national
GB 1511231.1 · Jun 25, 2015 · national
GB 1519425.1 · Nov 3, 2015 · national
GB 1519687.6 · Nov 6, 2015 · national
Continuity (2)
Continuation PCTGB2016050427 · Feb 19, 2016
Related Publication 20180129918A1 · May 10, 2018
Cited By (1)
US 12,619,867