System and method for lossy image and video compression and transmission utilizing neural networks
A system and method for lossy image and video compression and transmission that utilizes a neural network as a function to map a known noise image to a desired or target image, allowing the transfer only of hyperparameters of the function instead of a compressed version of the image itself. This allows the recreation of a high-quality approximation of the desired image by any system receiving the hyperparameters, provided that the receiving system possesses the same noise image and a similar neural network. The amount of data required to transfer an image of a given quality is dramatically reduced versus existing image compression technology. Being that video is simply a series of images, the application of this image compression system and method allows the transfer of video content at rates greater than existing technologies in relation to the same image quality.
1. A system for lossy image and video compression and transmission utilizing neural networks, comprising:
an image compression engine comprising a first processor, a first memory, and a first plurality of programming instructions stored in the first memory, wherein the first plurality of programming instructions, when operating on the first processor, cause the first processor to:
receive a desired image;
retrieve a noise image;
map the noise image to the desired image using a first neural network to find hyperparameters such that the hyperparameters, when applied to the noise image using the first neural network, produce an approximation of the desired image within an error that is less than a pre-determined threshold; and
transmit the hyperparameters; and
an image decompression engine comprising a second processor, a second memory, and a second plurality of programming instructions stored in the memory, wherein the second plurality of programming instructions, when operating on the second processor, cause the second processor to:
receive the hyperparameters;
retrieve the noise image; and
apply the hyperparameters to the noise image using a second neural network to produce an approximation of the desired image within an error that is less than the pre-determined threshold.
2. The system of claim 1 , wherein the image compression engine further comprises a dedicated 2D convolutional processor to accelerate the operation of the first neural network.
3. The system of claim 1 , wherein the image decompression engine further comprises a dedicated 2D convolutional processor to accelerate the operation of the second neural network.
4. A method for lossy image and video compression and transmission utilizing neural networks, comprising the steps of:
receiving a desired image at a first computing device;
retrieving a noise image using the first computing device;
mapping, using the first computing device, the noise image to the desired image using a first neural network to find hyperparameters such that the hyperparameters, when applied to the noise image using the first neural network, produce an approximation of the desired image within an error that is less than a pre-determined threshold; and
transmitting the hyperparameters to a second computing device; and
receive the hyperparameters at a second computing device;
retrieving the noise image at the second computing device; and
applying, using the second computing device, the hyperparameters to the noise image using a second neural network to produce an approximation of the desired image within an error that is less than the pre-determined threshold.
5. The method of claim 4 , wherein the image compression engine further comprises a dedicated 2D convolutional processor to accelerate the operation of the first neural network.
6. The system of claim 4 , wherein the image decompression engine further comprises a dedicated 2D convolutional processor to accelerate the operation of the second neural network.