IP Library Granted Patent US 9,684,966
Granted Patent B2
US 9,684,966 · App. 14/834,111 · Granted Jun 20, 2017

Foreground / background separation in digital images

Inventors: Eran Steinberg (San Francisco, CA); Peter Corcoran (Claregalway, IE); Yury Prilutsky (San Mateo, CA); Petronel Bigioi (Galway, IE); Alexei Pososin (Galway, IE); Mihai Ciuc (Bucharest, RO); Adrian Zamfir (Bucharest, RO); Adrian Capata (Bucharest, RO)
Assignee: FotoNation Limited
G06T7/0081G06K9/00234G06K9/38G06K9/4652G06K9/6202G06T7/11G06T7/136G06T7/194
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,684,966
App. No.
14/834,111
Granted
Jun 20, 2017
Kind
B2
Abstract

A method for providing improved foreground/background separation in a digital image of a scene is disclosed. The method comprises providing a first map comprising one or more regions provisionally defined as one of foreground or background within the digital image; and providing a subject profile corresponding to a region of interest of the digital image. The provisionally defined regions are compared with the subject profile to determine if any of the regions intersect with the profile region. The definition of one or more of the regions in the map is changed based on the comparison.

Claims (8)

1. An apparatus for providing improved separation between foreground and background regions in a digital image of a scene, comprising a processor and one or more processor-readable media for programming the processor to control the apparatus to perform a method comprising: acquiring a main digital image; providing a first map comprising one or more regions within a main digital image, each having one or more pixels with a common characteristic; providing an object profile corresponding to a region of interest of said main digital image including an object candidate; determining that the object candidate within the region of interest matches an object portion of the object profile; determining an orientation of the region of interest within said main digital image; defining said object profile as comprising said object portion and at least a second portion adjacent said object portion having a known association and orientation relative to the object portion; comparing said region of interest with said object profile to determine whether said region of interest matches said object profile; and designating said region of interest as a foreground or background region based on said comparison.

2. An apparatus as claimed in claim 1 wherein providing said first map comprises provisionally defining each of said one or more regions of said main digital image as foreground or background and wherein said one or more regions comprise at least one region provisionally defined as foreground.

3. An apparatus as claimed in claim 1 wherein the providing of said first map is based on a comparison of two or more images approximately of said scene.

4. An apparatus as claimed in claim 1 wherein the providing of said first map comprises: providing two of more images each of different focus and nominally of said scene; calculating from said images a depth of focus map indicating pixels of said main digital image as either foreground or background; blurring said focus map; thresholding said blurred map to an intermediate focus map indicating regions as either foreground or background; and filling regions within said intermediate focus map to provide said first map.

5. An apparatus as claimed in claim 1 , wherein the providing of said first map comprises: providing two or more images each of different focus and nominally of said scene; and comparing high frequency coefficients of corresponding regions in said images to determine whether said one or more of said one or more regions comprise foreground or background to provide said first map.

6. An apparatus as claimed in claim 1 wherein the providing of said first map comprises: providing two or more images at different exposure levels approximately of said scene; and comparing luminance levels of corresponding regions in said images to determine whether said one or more of said one or more regions are foreground or background to provide said first map.

7. An apparatus as claimed in claim 1 wherein said providing a first map comprises: analyzing at least one region of the main digital image in a color space to determine a color distribution within said at least one region, said color distribution having a plurality of distinct color peaks; and segmenting said at least one region based on proximity of a pixel's color to said color peaks.

8. An apparatus as claimed in claim 1 wherein said main digital image is one of a stream of images and the method comprises: determining at least one region of said main image that includes an object; detecting the object in at least one image of said stream acquired prior to said main digital image; and tracking said object through said stream of images to determine said object in said main digital image.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2024
From: FOTONATION LIMITED
To: XPERI PRODUCT SPINCO CORPORATION
Reel/Frame 067260/0382 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2024
From: XPERI PRODUCT SPINCO CORPORATION
To: XPERI HOLDING CORPORATION
Reel/Frame 067260/0426 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2024
From: XPERI HOLDING CORPORATION
To: ADEIA IMAGING LLC
Reel/Frame 067260/0462 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2024
From: STEINBERG, ERAN; CORCORAN, PETER; PRILUTSKY, YURY; BIGIOI, PETRONEL; POSOSIN, ALEXEI; CIUC, MIHAI; ZAMFIR, ADRIAN; CAPATA, ADRIAN
To: FOTONATION VISION LIMITED
Reel/Frame 067260/0713 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2024
From: FOTONATION VISION LIMITED
To: TESSERA TECHNOLOGIES IRELAND LIMITED
Reel/Frame 067260/0719 →
CHANGE OF NAME Recorded Apr 29, 2024
From: TESSERA TECHNOLOGIES IRELAND LIMITED
To: DIGITALOPTICS CORPORATION EUROPE LIMITED
Reel/Frame 067260/0724 →
CHANGE OF NAME Recorded Apr 29, 2024
From: DIGITALOPTICS CORPORATION EUROPE LIMITED
To: FOTONATION LIMITED
Reel/Frame 067260/0727 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
Continuity (4)
Continuation 13751973 · Jan 28, 2013
Continuation 11744020 · May 3, 2007
Provisional Application 60746363 · May 3, 2006
Related Publication 20160078630A1 · Mar 17, 2016