IP Library Granted Patent US 10,049,435
Granted Patent B2
US 10,049,435 · App. 15/160,932 · Granted Aug 14, 2018

Controlling smoothness of a transmission between images

Inventors: Sylvain Paris (Jamaica Plain, MA); Sohrab Amirghodsi (Seattle, WA); Aliakbar Darabi (San Jose, CA); Elya Shechtman (Seattle, WA)
Assignee: Adobe Systems Incorporated
G06T5/002G06T3/4038G06T5/005G06T11/60G06T2207/10024G06T2207/20192G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,049,435
App. No.
15/160,932
Granted
Aug 14, 2018
Kind
B2
Abstract

Embodiments described herein are directed to methods and systems for facilitating control of smoothness of transitions between images. In embodiments, a difference of color values of pixels between a foreground image and the background image are identified along a boundary associated with a location at which to paste the foreground image relative to the background image. Thereafter, recursive down sampling of a region of pixels within the boundary by a sampling factor is performed to produce a plurality of down sampled images having color difference indicators associated with each pixel of the down sampled images. Such color difference indicators indicate whether a difference of color value exists for the corresponding pixel. To effectuate a seamless transition, the color difference indicators are normalized in association with each recursively down sampled image.

Claims (41)

1. A computer-implemented method for compositing a first image and a second image with a seamless transition, the method comprising:

determining a difference of color values of pixels between a first image and a second image along a boundary associated with a position at which to composite the first image relative to the second image;

generating an initial set of pixel data for each pixel within a selected region of pixels including the boundary, each set of pixel data for the pixels along the boundary including:

one or more color difference components representing a difference in color of the pixel between the first image and the second image based on the determined difference of color values of pixels, and

a color difference indicator that indicates that a difference of color value exists for that pixel;

using the initial set of pixel data to recursively down sample the selected region of pixels by a sampling factor to produce a plurality of down sampled images until an extent of pixels of a last down sampled image, produced at a recursive down sampling instance, correspond with color difference indicators indicating existing differences of color values;

recursively up sampling the last down sampled image to generate a set of final color difference values for the pixels within the selected image region; and

producing a composition with a seamless transition between the first image and the second image using the set of final color difference values for the pixels within the selected image region.

2. The method of claim 1 , wherein the selected region of pixels include pixels within the boundary.

3. The method of claim 1 , wherein the color difference components representing a difference in a red color, a difference in a green color, and a difference in a blue color.

4. The method of claim 1 , wherein each down sampling instance comprises:

identifying a largest color difference indicator,

dividing each color difference component and color difference indicator associated with the corresponding down sampled image by the largest color difference indicator, and

multiplying each color difference component and color difference indicator associated with the corresponding down sampled image by a predetermined factor.

5. The method of claim 1 , wherein the first image comprises a foreground image, and the second image comprises a background image.

6. The method of claim 1 , wherein the extent of pixels of a last down sampled image comprises each pixel of the last down sampled image.

7. The method of claim 1 , wherein the set of final color difference values are generated by dividing each of the color value differences of a final up sampled image by a color difference indicator associated with the final up sampled image.

8. The method of claim 7 , wherein the set of final color difference values are used to modify pixels of the first image.

9. A computer-implemented method for compositing a first image and a second image with a seamless transition between the first image and the second image, the method comprising:

identifying a boundary associated with a selected region of pixels that correspond with a position at which to composite the first image relative to the second image;

determining a difference of color values of pixels between the first image and the second image along the boundary;

using the difference of color values of pixels between the first image and the second image along the boundary to recursively down sample the selected region of pixels by a sampling factor to produce a plurality of down sampled images, wherein each pixel of the down sampled images corresponds with a color difference indicator that indicates whether a difference of color value exists for the pixel; and

producing a composition with a seamless transition between the first image and the second image using a set of final color difference values for the region of pixels within the boundary, wherein the set of final color difference values is generated based on recursively up sampling a last down sampled image.

10. The method of claim 9 further comprising normalizing the color difference indicators in association with each recursively down sampled image, wherein the normalizing comprises:

identifying a largest color difference indicator from among the color difference indicators associated with the corresponding down sampled image, and

dividing each of the color difference indicators associated with the corresponding down sampled image by the largest color difference indicator.

11. The method of claim 10 , wherein the normalizing further comprises dividing each color difference component associated with the corresponding down sampled image by the largest color difference indicator.

12. The method of claim 10 further comprising augmenting the normalization by multiplying each color difference indicator by a predetermined factor.

13. The method of claim 11 further comprising augmenting the normalization by multiplying each color difference indicator and each color difference component by a predetermined factor.

14. The method of claim 10 , wherein the difference of color values of pixels comprises a first difference representing a difference of a red color value, a second difference representing a difference of a green color value, and a third difference representing a difference of a blue color value.

15. A system comprising:

a processor for executing instructions stored in computer-readable medium on one or more devices,

the instructions comprising one or more modules configured to perform the steps comprising:

identifying a difference of color values of pixels between a foreground image and the background image along a boundary associated with a location at which to paste the foreground image relative to the background image;

recursively down sampling a region of pixels within the boundary by a sampling factor to produce a plurality of down sampled images having color difference indicators associated with each pixel of the down sampled images, wherein the color difference indicators indicate whether a difference of color value exists for the corresponding pixel; and

producing a composition with a seamless transition between the foreground image and the background image using a set of final color difference values for the region of pixels within the boundary, wherein the set of final color difference values is generated based on recursively up sampling a last down sampled image.

16. The system of claim 15 further comprises normalizing the color difference indicators in association with each recursively down sampled image, wherein the normalizing comprises:

identifying a largest color difference indicator from among the color difference indicators associated with the corresponding down sampled image, and

dividing each of the color difference indicators associated with the corresponding down sampled image by the largest color difference indicator.

17. The system of claim 16 , wherein the normalizing is augmented by multiplying each color difference indicator by a predetermined factor.

18. The system of claim 15 , wherein the difference of color values of pixels comprises a first difference representing a difference of a red color value, a second difference representing a difference of a green color value, and a third difference representing a difference of a blue color value.

Assignments (2)
CHANGE OF NAME Recorded Apr 8, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048867/0882 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2016
From: PARIS, SYLVAIN; AMIRGHODSI, SOHRAB; DARABI, ALIAKBAR; SHECHTMAN, ELYA
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 039202/0463 →
Continuity (2)
Provisional Application 62175361 · Jun 14, 2015
Related Publication 20160364846A1 · Dec 15, 2016
Cited By (1)
US 12,322,074