IP Library Granted Patent US 11,398,037
Granted Patent B2
US 11,398,037 · App. 16/812,346 · Granted Jul 26, 2022

Method and apparatus for performing segmentation of an image

Inventors: Tarek El Dokor (Phoenix, AZ); Joshua King (Mesa, AZ); Jordan Cluster (Tempe, AZ); James Edward Holmes (Mesa, AZ)
Assignee: Edge 3 Technologies
G06T7/11G06T7/10G06T7/174G06T7/187G06T7/194G06T7/50G06T7/55G06T7/593G06V10/26G06V10/267H04N13/128G06T2207/10012G06T2207/10021G06T2207/20112G06T2207/20228H04N2013/0081H04N2013/0092
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,398,037
App. No.
16/812,346
Granted
Jul 26, 2022
Kind
B2
Abstract

A method and system for segmenting a plurality of images. The method comprises the steps of segmenting the image through a novel clustering technique that is, generating a composite depth map including temporally stable segments of the image as well as segments in subsequent images that have changed. These changes may be determined by determining one or more differences between the temporally stable depth map and segments included in one or more subsequent frames. Thereafter, the portions of the one or more subsequent frames that include segments including changes from their corresponding segments in the temporally stable depth map are processed and are combined with the segments from the temporally stable depth map to compute their associated disparities in one or more subsequent frames. The images may include a pair of stereo images acquired through a stereo camera system at a substantially similar time.

Claims (20)

1. A method for performing segmentation in a stereo image capture device, comprising the steps of:

determining one or more segments present in a first image acquired at a first time;

determining one or more segments present in a second image acquired at the first time corresponding to one or more of the one or more segments present in the first image;

determining a disparity of one of the one or more segments in the first image;

assigning the determined disparity to every pixel comprising the one of the one or more segments in the first image;

determining a disparity of one or more of the one or more segments in the second image;

determining one or more corresponding segments in the first and second images that include at least one pixel having different disparity values between the first and second images; and

for each corresponding segment of the determined one or more corresponding segments in the first and second images, assigning a disparity of the corresponding segment in the first image to every pixel in the respective corresponding segment in the second image.

2. The method of claim 1 , wherein the first and second images comprise a stereo pair of images.

3. The method of claim 2 , further comprising the step of generating a composite segmentation image in accordance with the one or more segments present in the first and second images.

4. A computer program stored in a non-transitory storage medium for performing segmentation in a stereo image capture device, the computer program, when implemented on a processor, causes the processor to perform the steps of:

determining one or more segments present in a first image acquired at a first time;

determining one or more segments present in a second image acquired at the first time corresponding to one or more of the one or more segments present in the first image;

determining a disparity of one of the one or more segments in the first image;

assigning the determined disparity to every pixel comprising the one of the one or more segments in the first image;

determining a disparity of one or more of the one or more segments in the second image;

determining one or more corresponding segments in the first and second images that include at least one pixel having different disparity values between the first and second images; and

for each corresponding segment of the determined one or more corresponding segments in the first and second images, assigning a disparity of the corresponding segment in the first image to every pixel in the respective corresponding segment in the second image.

5. The computer program of claim 4 , wherein the first and second images comprise a stereo pair of images.

6. The computer program of claim 4 , further comprising generating a composite segmentation image in accordance with the one or more segments present in the first and second images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: EDGE3 TECHNOLOGIES, INC.; EDGE3 TECHNOLOGIES, LLC
To: GOLDEN EDGE HOLDING CORPORATION
Reel/Frame 064415/0683 →
Continuity (4)
Continuation 14148761 · Jan 7, 2014
Division 13025038 · Feb 10, 2011
Provisional Application 61379706 · Sep 2, 2010
Related Publication 20200211196A1 · Jul 2, 2020