IP Library Granted Patent US 9,483,815
Granted Patent B2
US 9,483,815 · App. 14/522,425 · Granted Nov 1, 2016

Systems and methods for computational lighting

Inventors: Ivaylo Boyadzhiev (Ithaca, NY); Kavita Bala (Ithaca, NY); Sylvain Paris (Jamaica Plain, MA)
Assignee: Cornell University
G06T5/50G06T11/60G06T2200/21G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,483,815
App. No.
14/522,425
Granted
Nov 1, 2016
Kind
B2
Abstract

A device for creating a digital image is described. The device that may receive two or more input images. The input images may have a common viewpoint with unique lighting configurations. The device may utilize basis light functions and modifiers to create a final composite image. The device may include a computing device configured to provide user a graphical user interface enabling a user to create a final composite image. Devices described herein may be useful for computational light workflows in photography.

Claims (32)

1. A method for creating a digital image, comprising:

receiving a plurality of input images, wherein each input image is taken from a fixed viewpoint with a different lighting configuration;

selecting a linear combination of the plurality of input images to determine basis lights elements, wherein one or more basis light elements include one or more of:

an edge light element configured to accentuate edges,

a diffuse color light element configured to enhance color,

a fill light element configured to add illumination; and

applying one or more basis light elements to one or more input images to create a digital image.

2. The method of claim 1 , further comprising applying one or more modifier control elements to one or more input images to create a revised digital image.

3. The method of claim 2 , wherein each of the one or more modifier control elements include one or more of: a per-object lighting modifier element configured to restrict the extent of light in the input image, a regional lighting modifier control element configured to balance the illumination intensity between different regions of a digital image, and a soft lighting modifier configured to control element to produce softer shadows and highlights occurring in input images.

4. The method of claim 3 , further comprising enabling a user to change values associated with a modifier control element by manipulating a control.

5. The method of claim 1 , wherein each of edge light element, diffuse color light element, and fill light element are associated with a respective energy function.

6. The method of claim 5 , further comprising enabling a user to change values associated with a respective energy function by manipulating a control.

7. A device for creating a digital image, comprising one or more processors configured to:

receive a plurality of input images, wherein each input image is taken from a fixed viewpoint with a different lighting configuration;

select a linear combination of the plurality of input images to determine basis lights elements, wherein one or more basis light elements include one or more of:

an edge light element configured to accentuate edges,

a diffuse color light element configured to enhance color,

a fill light element configured to add illumination; and

apply one or more basis light elements to one or more input images to create a digital image.

8. The device of claim 7 , wherein the one or more processors are further configured to apply one or more modifier control elements to one or more input images to create a revised digital image.

9. The device of claim 8 , wherein each of the one or more modifier control elements include one or more of: a per-object lighting modifier element configured to restrict the extent of light in the input image, a regional lighting modifier control element configured to balance the illumination intensity between different regions of a digital image, and a soft lighting modifier configured to control element to produce softer shadows and highlights occurring in input images.

10. The device of claim 9 , wherein the one or more processors are further configured to enable a user to change values associated with a modifier control element by manipulating a control.

11. The device of claim 7 , wherein each of edge light element, diffuse color light element, and fill light element are associated with a respective energy function.

12. The device of claim 11 , wherein the one or more processors are further configured to enable a user to change values associated with a respective energy function by manipulating a control.

13. A non-transitory computer-readable storage medium comprising instructions stored thereon that upon execution cause one or more processors of a device to:

receive a plurality of input images, wherein each input image is taken from a fixed viewpoint with a different lighting configuration;

select a linear combination of the plurality of input images to determine basis lights elements, wherein one or more basis light elements include one or more of: an edge light element configured to accentuate edges, a diffuse color light element configured to enhance color, and a fill light element configured to add illumination; and

apply one or more basis light elements to one or more input images to create a digital image.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the instructions further cause one or more processors to apply one or more modifier control elements to one or more input images to create a revised digital image.

15. The non-transitory computer-readable storage medium of claim 14 , wherein each of edge light element, diffuse color light element, and fill light element are associated with a respective energy function.

16. The non-transitory computer-readable storage medium of claim 14 , wherein each of the one or more modifier control elements include one or more of: a per-object lighting modifier element configured to restrict the extent of light in the input image, a regional lighting modifier control element configured to balance the illumination intensity between different regions of a digital image, and a soft lighting modifier configured to control element to produce softer shadows and highlights occurring in input images.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions further cause one or more processors to: enable a user to change values associated with a basis light element or a modifier control element by manipulating a control.

Assignments (4)
CONFIRMATORY LICENSE Recorded Dec 14, 2016
From: CORNELL UNIVERSITY
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 040940/0020 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2015
From: PARIS, SYLVAIN; BOYADZHIEV, IVAYLO
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 035493/0498 →
CONFIRMATORY LICENSE Recorded Apr 9, 2015
From: CORNELL UNIVERSITY
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 035398/0956 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2015
From: BOYADZHIEV, IVAYLO; BALA, KAVITA
To: CORNELL UNIVERSITY, CENTER FOR TECHNOLOGY LICENSING ("CTL") AT CORNELL UNIVERSITY
Reel/Frame 035362/0230 →
Continuity (2)
Provisional Application 61894526 · Oct 23, 2013
Related Publication 20150109303A1 · Apr 23, 2015