IP Library Granted Patent US 9,036,070
Granted Patent B2
US 9,036,070 · App. 13/633,456 · Granted May 19, 2015

Displaying of images with lighting on the basis of captured auxiliary images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,036,070
App. No.
13/633,456
Granted
May 19, 2015
Kind
B2
Abstract

For displaying a stored photographic image, an auxiliary image is captured, and light direction information is determined from the captured auxiliary image. On the basis of the determined light direction information, a lighted image is generated from the stored photographic image. The lighted image is then displayed.

Claims (37)

1. A method of displaying a stored photographic image, the method comprising:

capturing an auxiliary image;

determining light direction information from the captured auxiliary image;

on the basis of the determined light direction information, generating a lighted image from the stored photographic image; and

displaying the lighted image,

wherein the stored photographic image comprises stored light direction information, and

wherein said generating the lighted image comprises combining the stored light direction information with the determined light direction information.

2. The method according to claim 1 , comprising:

capturing a sequence of images;

determining a sequence of light direction information from the captured images; and

on the basis of the determined sequence of light direction information, generating a sequence of lighted images from the stored photographic image; and

displaying the sequence of lighted images.

3. The method according to claim 1 ,

wherein said capturing the auxiliary image, determining the light direction information, generating the lighted image, and displaying the lighted image is accomplished in real-time.

4. The method according to claim 1 ,

wherein the stored light direction information and the determined light direction information are provided in the form of normal maps.

5. The method according to claim 1 ,

wherein said determining of the light direction information is accomplished by analyzing an object in the captured auxiliary image.

6. The method according to claim 1 ,

wherein said capturing of the auxiliary image is accomplished by a light field camera; and

wherein said determining of the light direction information is accomplished on the basis of output signals of the light field camera.

7. The method according to claim 1 ,

wherein said capturing of the auxiliary image is accomplished by a fisheye camera; and

wherein said determining of the light direction information is accomplished on the basis of output signals of the fisheye camera.

8. The method according to claim 1 ,

wherein said capturing of the auxiliary image and said displaying of the lighted image is accomplished by the same device.

9. A device for displaying a stored photographic image, the device comprising:

a camera for capturing an auxiliary image; and

a processor configured to determine light direction information from the captured auxiliary image, configured to generate on the basis of the determined light direction information, a lighted image from the stored photographic image, and configured to control displaying of the lighted image on a display,

wherein the stored photographic image comprises stored light direction information, and

wherein the generated lighted image comprises the stored light direction information combined with the determined light direction information.

10. The device according to claim 9 ,

wherein the camera is a video camera and the processor is configured to determine the light direction information and to generate the lighted image in real-time from output signals of the video camera.

11. The device according to claim 9 ,

wherein the camera comprises a light field camera or a fisheye camera.

12. The device according to claim 9 ,

wherein the processor is configured to determine the light direction information by analyzing an object in the captured auxiliary image.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: SONY MOBILE COMMUNICATIONS, INC.
To: SONY CORPORATION
Reel/Frame 048691/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2017
From: SONY MOBILE COMMUNICATIONS AB
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 043951/0529 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2017
From: SONY CORPORATION
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 043943/0631 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2015
From: SONY MOBILE COMMUNICATIONS AB
To: SONY CORPORATION; SONY MOBILE COMMUNICATIONS AB
Reel/Frame 035408/0264 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2012
From: THORN, OLA
To: SONY MOBILE COMMUNICATIONS AB
Reel/Frame 029063/0067 →