IP Library Granted Patent US 10,083,499
Granted Patent B1
US 10,083,499 · App. 15/290,666 · Granted Sep 25, 2018

Methods and apparatus to reduce compression artifacts in images

Inventors: Peyman Milanfar (Menlo Park, CA); Yi Shen (Palo Alto, CA); Feng Yang (Sunnyvale, CA); Jingbin Wang (Mountain View, CA)
Assignee: GOOGLE LLC
G06T5/005G06T5/50G06T2207/10024G06T2207/20024G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,083,499
App. No.
15/290,666
Filed
Oct 11, 2016
Granted
Sep 25, 2018
Kind
B1
Art Unit
2667
USPC
382/167
Abstract

Methods and apparatus to reduce compression artifacts in images are disclosed herein. An example method includes separating at least a portion of an image into a first component and a second component, reducing a first artifact in the first component to form a first cleaned component, reducing, using the first cleaned component, a second artifact in the second component to form a second cleaned component, and combining the first cleaned component and the second cleaned component to form a cleaned image.

Claims (28)

1. A method comprising:

separating at least a portion of an image into a first component and a second component;

reducing a first artifact in the first component to form a first cleaned component by applying a convolutional neural network to the first component;

reducing, using the first cleaned component, a second artifact in the second component to form a second cleaned component by applying a filter having coefficients based on the first cleaned component; and

combining the first cleaned component and the second cleaned component to form a cleaned image.

2. The method of claim 1 , further comprising training the convolutional neural network using luma channels of a plurality of images.

3. The method of claim 2 , wherein the convolutional neural network is trained using a cropped luma patch to recover a center pixel.

4. The method of claim 1 , wherein the image is a frame of a video signal.

5. The method of claim 1 , wherein the image is an RGB image, the first component represents a luma component, and the second component represents a chroma component.

6. The method of claim 1 , wherein the filter computes a sum of products of the second component and the coefficients.

7. An apparatus comprising:

a splitter to separate at least a portion of an image into a first component and a second component;

a convolutional neural network to reduce a first artifact in the first component to form a first cleaned component;

a filter having coefficients determined based on the first cleaned component to filter a second artifact in the second component to form a second cleaned component; and

a combiner to combine the first cleaned component and the second cleaned component to form a cleaned image.

8. The apparatus of claim 7 , wherein the convolutional network comprises three convolutional layers.

9. The apparatus of claim 7 , wherein the convolutional neural network is trained using luma channels of a plurality of images.

10. The apparatus of claim 9 , wherein the convolutional neural network is trained using a luma patch to recover a center pixel.

11. The apparatus of claim 7 , wherein the image is a frame of a video signal.

12. The apparatus of claim 7 , wherein the image is an RGB image, the first component represents a luma component, and the second component represents a chroma component.

13. The apparatus of claim 7 , wherein the filter computes a sum of products of the second component and the coefficients.

14. A non-transitory machine-readable media storing machine-readable instructions that, when executed, cause a machine to at least:

separate at least a portion of an RGB image into a luma component and a chroma component;

reduce a first artifact in the luma component to form a cleaned luma component by applying a convolutional neural network to the luma component;

reduce, using the cleaned luma component, a second artifact in the chroma component to form a cleaned chroma component by applying a filter having coefficients based on the cleaned luma component; and

combine the cleaned luma component and the cleaned chroma component to form a cleaned RGB image.

15. The non-transitory machine-readable media storing machine-readable instructions of claim 14 that, when executed, cause the machine to train the convolutional neural network using a luma patch to recover a center pixel.

16. The non-transitory machine-readable media storing machine-readable instructions of claim 14 that, when executed, cause the machine to apply the filter by computing a sum of products of the chroma component and the coefficients.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2016
From: MILANFAR, PEYMAN; SHEN, YI; YANG, FENG; WANG, JINGBIN
To: GOOGLE INC.
Reel/Frame 040035/0890 →
Cited By (2)
US 12,469,105 US 12,632,932