IP Library Granted Patent US 9,170,723
Granted Patent B2
US 9,170,723 · App. 13/514,135 · Granted Oct 27, 2015

Method, graphical user interface, and computer program product for processing of a light field image

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,170,723
App. No.
13/514,135
Granted
Oct 27, 2015
Kind
B2
Abstract

A method and a graphical user interface for processing of an object in light field data is provided. The method and graphical user interface may be used to remove an object or obstruction blocking another object or background of a captured scene. The method and graphical user interface may also be used for high precision edge detection in a light field image.

Claims (13)

1. A method of processing a first light field image comprising light field data of a scene captured by a light field camera with known configuration, wherein the light field data comprises angular information of the captured scene, the method comprising:

rendering a first image from the light field data, corresponding to a first focal plane at which an object of the captured scene is in focus,

selecting the object in the rendered image;

applying a mask at least covering the pixels related to the edge of the selected object;

deleting the pixels associated with the applied mask from the light field data, resulting in a first set of modified light field data;

filling the pixels relating to the deleted pixels associated with the applied mask with data from the first set of modified light field data being relevant for the corresponding pixel position using the remaining angular information of the first set of modified light field data, resulting in a second set of modified light field data;

rendering a further image from the second set of modified light field data, corresponding to the first focal plane;

constructing a fourth image based on the pixel difference or a comparison between the first image and the further image;

applying a further mask based on the pixels of the fourth image;

extracting the pixels encompassed by the further mask in the light field data; and

pasting the extracted pixels into a second light field image.

2. The method according to claim 1 , wherein the data being relevant for the corresponding pixel position, is obtained from at least one of two subset images of the light field data, wherein each of the at least two subset images comprises different angular information of the captured scene.

3. A computer program product stored on a non-transitory computer-readable medium comprising software code adapted to perform the steps of the method according to claim 1 .

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2019
From: SONY MOBILE COMMUNICATIONS AB
To: SONY CORPORATION
Reel/Frame 048825/0737 →
CHANGE OF NAME Recorded Mar 25, 2019
From: SONY ERICSSON MOBILE COMMUNICATIONS AB
To: SONY MOBILE COMMUNICATIONS AB
Reel/Frame 048690/0974 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2012
From: WERNERSSON, MATS
To: SONY ERICSSON MOBILE COMMUNICATIONS AB
Reel/Frame 028328/0260 →