IP Library Granted Patent US 9,934,560
Granted Patent B2
US 9,934,560 · App. 15/081,924 · Granted Apr 3, 2018

User sliders for simplified adjustment of images

Inventors: Daniel Pettigrew (Mountain View, CA); Jason Chang (Mountain View, CA); Ronald Frank Wotzlaw (Mountain View, CA); Sevket Derin Babacan (San Francisco, CA); Aravind Krishnaswamy (San Jose, CA)
Assignee: Google LLC
G06T5/008G06F3/04845G06F3/04847G06K9/00228G06T5/009G06T5/40G11B27/034G11B27/34
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,934,560
App. No.
15/081,924
Filed
Mar 27, 2016
Granted
Apr 3, 2018
Kind
B2
Examiner
ALAVI, AMIR
Art Unit
2668
USPC
382/311
Abstract

Methods and systems for modifying an image by applying an effect to an image are described. The effects include a pop effect, a light adjustment, or a color adjustment to an image. The methods and systems include providing a user slider for applying an effect to the image. The methods and systems further include determining a first portion of the image including a face and creating a protection mask to protect the face in the first portion during image modification. The protection mask may include an enhancement threshold for modifying the first portion of the image. The modification of the image may include modifying the second portion of the image differently than the first portion of the image. A method for enforcing different resolutions of a same input image to produce similar visual results is also described.

Claims (92)

1. A computer-implemented method for modifying an image, the method comprising:

receiving, using one or more computing devices, an input selecting the image for modification;

detecting, using the one or more computing devices, a face in the image;

determining, using the one or more computing devices, a first portion of the image including the face;

determining, using the one or more computing devices, an enhancement threshold of the first portion of the image;

providing, using the one or more computing devices, a user slider for modification of the image;

modifying, using the one or more computing devices, a second portion of the image for image enhancement in response to the user slider being selected to apply an effect, the second portion of the image excluding the first portion;

modifying, using the one or more computing devices, the first portion of the image for image enhancement without exceeding the enhancement threshold in response to the user slider being selected; and

storing, using the one or more computing devices, the modified image.

2. The computer-implemented method of claim 1 , wherein the effect is a pop effect, the user slider controls the pop effect, and the method further comprises:

determining, using the one or more computing devices, an amount of the pop effect to apply to the image based on the user slider;

adjusting, using the one or more computing devices, the image by applying the pop effect to the first portion of the image; and

applying, using the one or more computing devices, the pop effect to the second portion of the image based on the user slider.

3. The computer-implemented method of claim 2 , wherein the pop effect includes one of the group of a saturation boost, a brightness adjustment, and use of a local contrast to enhance details of the image.

4. The computer-implemented method of claim 1 , wherein the effect is a light adjustment, the user slider controls the light adjustment to the image, and the method further comprises:

extending, using the one or more computing devices, a histogram range to include an available range for the light adjustment and to spread out distributions based on a desired light adjustment amount selected using the user slider;

adjusting, using the one or more computing devices, a shadow associated with the image based on the desired light adjustment amount; and

adjusting, using the one or more computing devices, gamma associated with the image based on the desired light adjustment amount.

5. The computer-implemented method of claim 1 , wherein the effect is a light adjustment, the user slider controls the light adjustment to the image, and the method further comprises:

extending, using the one or more computing devices, a histogram range to include an available range for the light adjustment and to spread out distributions based on a desired light adjustment amount selected using the user slider;

adjusting, using the one or more computing devices, highlight details associated with the image based on the desired light adjustment amount; and

adjusting, using the one or more computing devices, gamma associated with the image based on the desired light adjustment amount.

6. The computer-implemented method of claim 1 , wherein the effect is a color adjustment, the user slider controls the color adjustment to the image, and the method further comprises:

determining, using the one or more computing devices, a color in the image that is saturated; and

saturating, using the one or more computing devices, the second portion of the image based on a color adjustment amount selected using the user slider.

7. The computer-implemented method of claim 1 , wherein the modification is resizing the image into a fixed lower resolution image, and the method further comprises:

determining, using the one or more computing devices, a number of pyramid levels to match a pre-defined fixed lower resolution image;

selecting, using the one or more computing devices, a remapping level to be a fixed offset from a top level of the pyramid levels; and

applying, using the one or more computing devices, a local Laplacian smoothing to ensure similar frequency bands are processed for differently-sized images to produce similar visual results for the fixed lower resolution image.

8. The computer implemented method of claim 1 , wherein providing the user slider for the modification of the image includes providing a user interface, the user interface including a pop slider, a color slider, a light slider, and a preview of the image.

9. A computer program product comprising a non-transitory computer usable medium including a computer program, wherein the computer program when executed on a computer causes the computer to:

receive an input selecting an image for modification;

determine a face in the image;

determine a first portion of the image including the face;

determine an enhancement threshold of the first portion of the image;

provide a user slider for modification of the image;

modify a second portion of the image for image enhancement in response to the user slider being selected to apply an effect, the second portion of the image excluding the first portion;

modify the first portion of the image for image enhancement without exceeding the enhancement threshold in response to the user slider being selected; and

store the modified image.

10. The computer program product of claim 9 , wherein the effect is a pop effect, the user slider controls the pop effect, and the computer program when executed on the computer further causes the computer to:

determine an amount of the pop effect to apply to the image based on the user slider;

adjust the image by applying the pop effect to the first portion of the image; and

apply the pop effect to the second portion of the image based on the user slider.

11. The computer program product of claim 10 , wherein the pop effect includes one from the group of a saturation boost, a brightness adjustment, and use of a local contrast to enhance details of the image.

12. The computer program product of claim 9 , wherein the effect is a light adjustment, the user slider controls the light adjustment to the image, and the computer program when executed on the computer further causes the computer to:

extend a histogram range to include an available range for the light adjustment and to spread out distributions based on a desired light adjustment amount selected using the user slider;

adjust a shadow associated with the image based on the desired light adjustment amount; and

adjust gamma associated with the image based on the desired light adjustment amount.

13. The computer program product of claim 9 , wherein the effect is a light adjustment, the user slider controls the light adjustment to the image, and the computer program when executed on the computer further causes the computer to:

extend a histogram range to include an available range for the light adjustment and to spread out distributions based on a desired light adjustment amount selected using the user slider;

adjust highlight details associated with the image based on the desired light adjustment amount; and

adjust gamma associated with the image based on the desired light adjustment amount.

14. The computer program product of claim 9 , wherein the effect is a color adjustment, the user slider controls the color adjustment to the image, and the computer program when executed on the computer further causes the computer to:

determine a color in the image that is saturated; and

saturate the second portion of the image based on a color adjustment amount selected using the user slider.

15. The computer program product of claim 9 , wherein the modification is resizing the image into a fixed lower resolution image, the computer program when executed on the computer further causes the computer to:

determine a number of pyramid levels to match a pre-defined fixed lower resolution image;

select a remapping level to be a fixed offset from a top level of the pyramid levels; and

apply a local Laplacian smoothing to ensure similar frequency bands are processed for differently-sized images to produce similar visual results for the fixed lower resolution image.

16. The computer program product of claim 9 , wherein to provide the user slider for the modification of the image, the computer program when executed on the computer further causes the computer to provide a user interface, the user interface including a pop slider, a color slider, a light slider, and a preview of the image.

17. A system comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to:

receive an input selecting an image for modification;

determine a face in the image;

determine a first portion of the image including the face;

determine an enhancement threshold of the first portion of the image;

provide a user slider for modification of the image;

modify a second portion of the image for image enhancement in response to the user slider being selected to apply an effect, the second portion of the image excluding the first portion;

modify the first portion of the image for image enhancement without exceeding the enhancement threshold in response to the user slider being selected; and

store the modified image.

18. The system of claim 17 , wherein the effect is a pop effect, the user slider controls the pop effect, and the memory stores further instructions that, when executed, cause the system to:

determine an amount of the pop effect to apply to the image based on the user slider;

adjust the image by applying the pop effect to apply to the first portion of the image; and

apply the pop effect to the second portion of the image based on the user slider.

19. The system of claim 18 , wherein the pop effect includes one from the group of a saturation boost, a brightness adjustment, and use of a local contrast to enhance details of the image.

20. The system of claim 17 , wherein the effect is a light adjustment slider, the user slider controls the light adjustment to the image, and the memory stores further instructions that, when executed, cause the system to:

extend a histogram range to include an available range for the light adjustment and to spread out distributions based on a desired light adjustment amount selected using the user slider;

adjust a shadow associated with the image based on the desired light adjustment amount; and

adjust gamma associated with the image based on the desired light adjustment amount.

21. The system of claim 17 , wherein the effect is a light adjustment slider, the user slider controls the light adjustment to the image, and the memory stores further instructions that, when executed, cause the system to:

extend a histogram range to include an available range for the light adjustment and to spread out distributions based on a desired light adjustment amount selected using the user slider;

adjust highlight details associated with the image based on the desired light adjustment amount; and

adjust gamma associated with the image based on the desired light adjustment amount.

22. The system of claim 17 , wherein the effect is a color adjustment, the user slider controls the color adjustment to the image, and the memory stores further instructions that, when executed, cause the system to:

determine a color in the image that is saturated; and

saturate the second portion of the image based on a color adjustment amount selected using the user slider.

23. The system of claim 17 , wherein the modification is resizing the image into a fixed lower resolution image, and the memory stores further instructions that, when executed, cause the system to:

determine a number of pyramid levels to best match a pre-defined fixed lower resolution image;

select a remapping level to be a fixed offset from a top level of the pyramid levels; and

apply a local Laplacian smoothing to ensure similar frequency bands are processed for differently-sized images to produce similar visual results for the fixed lower resolution image.

24. The system of claim 17 , wherein to provide the user slider for the modification of the image, the memory stores further instructions that, when executed, cause the system to provide a user interface, the user interface including a pop slider, a color slider, a light slider, and a preview of the image.

Assignments (2)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2016
From: BABACAN, SEVKET DERIN; CHANG, JASON; PETTIGREW, DANIEL; KRISHNASWAMY, ARAVIND; WOTZLAW, RONALD FRANK
To: GOOGLE INC.
Reel/Frame 038254/0001 →
Continuity (2)
Provisional Application 62139621 · Mar 27, 2015
Related Publication 20160284070A1 · Sep 29, 2016