IP Library Granted Patent US 10,909,426
Granted Patent B2
US 10,909,426 · App. 15/986,898 · Granted Feb 2, 2021

Method and apparatus for spawning specialist belief propagation networks for adjusting exposure settings

Inventor: Tarek El Dokor (Phoenix, AZ)
Assignee: Edge 3 Technologies, Inc.
G06K9/6267G06K9/00221G06K9/00335G06K9/00664G06K9/00771G06K9/4661G06K9/6262G06K9/6271G06N3/02H04N5/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,909,426
App. No.
15/986,898
Granted
Feb 2, 2021
Kind
B2
Abstract

A method and apparatus for processing image data is provided. The method includes the steps of employing a main processing network for classifying one or more features of the image data, employing a monitor processing network for determining one or more confusing classifications of the image data, and spawning a specialist processing network to process image data associated with the one or more confusing classifications.

Claims (34)

1. A method for processing image data, comprising the steps of:

a) acquiring one or more images by a main deep belief propagation network;

b) determining one or more features of the acquired images;

c) determining a settled minimum error level associated with one or more of the one or more features of acquisition;

d) employing a monitoring belief propagation network to determine whether the settled minimum error level is greater than a predetermined threshold;

e) employing the monitoring belief propagation network to classify the type of confusion that is generating the settled minimum error level; and

f) employing an appropriate specialist deep belief propagation network to process the one or more determined features in accordance with the determined classification of the type of confusion.

2. The method of claim 1 , further comprising the steps of:

wherein if it is determined that maximum exposure settings have been employed upon acquiring of the one or more images, then employing a near infrared sensor for imaging of the data to be processed; and

returning to step b) to further process the imaged near infrared data.

3. The method of claim 1 , wherein the step of employing the specialist deep belief propagation network further comprises the steps of:

employing a main deep belief propagation network for classifying one or more features of the image data;

employing a monitor deep belief propagation network for determining one or more classifications of the image data; and

spawning a specialist deep belief propagation network to process image data associated with the one or more determined classifications.

4. The method of claim 3 , further comprising the steps of:

employing the monitor deep belief propagation network for determining one or more classifications of the image data by the specialist deep belief propagation network; and

employing a second specialist deep belief propagation network to process image data associated with one or more of the one or more determined classifications of the image data processed by the specialist deep belief propagation network.

5. The method of claim 4 wherein the second specialist deep belief propagation network further employs a third or more specialist deep belief propagation networks.

6. The method of claim 3 , wherein image data processed by the specialist deep belief propagation network is provided to the main deep belief propagation network directly or via analysis and updates by the monitor deep belief propagation network.

7. The method of claim 3 , wherein the monitor deep belief propagation network employs a volatility index for determining one or more classifications of the image data as belonging to one of the background, foreground or both.

8. The method of claim 7 , wherein image data comprising two or more objects located at a single (x,y) pixel location may comprise classifications having different (z) depths.

9. The method of claim 7 , wherein one or more of a foreground object, an occluded object and a background object may occupy a single (x,y) pixel location.

10. The method of claim 3 , wherein the classifications comprise one or more scene objects, one or more salient scene features being used to train one or more of the main belief propagation networks and specialist deep belief propagation network.

11. The method of claim 3 , wherein the step of classifying the one or more features of the image data further comprises the steps of:

classifying one or more scene exposure settings by the main deep propagation network according to one of scene exposure and scene quality;

employing one or more specialist deep belief propagation networks, each adapted to process image data related to one or more of the one or more scene exposure setting classifications;

wherein each of the one or more specialist deep belief propagation networks is adapted to modify one or more exposure settings associated with the associated classification of exposure settings, thereby improving the exposure conditions thereof.

12. The method of claim 11 , wherein the specialist deep belief propagation network is also adapted to modify one or more of chroma settings, saturation settings, color relevant settings and texture relevant settings.

13. The method of claim 3 , wherein the determined classifications of the image data allow for a performance of disparity space decomposition via disparity decomposition metrics that change thresholds adaptively with disparity values.

14. The method of claim 13 wherein the performance of disparity space decomposition further comprises the step of extraction of “energy nodules” that are used in training one or more of the specialist deep belief propagation networks on various scene settings.

15. The method of claim 3 , further comprising the step of computing a volatility index associated with the performance of the disparity space decomposition in accordance with training one or more specialist deep belief propagation networks in accordance with one or more scene analysis and stability metrics.

16. The method of claim 3 , wherein a more comprehensive topology is employed comprising a plurality of subnets branching from the main deep belief propagation network to deal with various modalities including one or more of gesture and facial expression.

17. The method of claim 16 , wherein one or more additional specialist subnets are spawned unrelated to either facial or gesture expression recognition.

18. The method of claim 1 , wherein the image data comprises data from a pair of stereo cameras sensitive to visible light, and data from a pair of stereo cameras sensitive to infrared light.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: EDGE3 TECHNOLOGIES, INC.; EDGE3 TECHNOLOGIES, LLC
To: GOLDEN EDGE HOLDING CORPORATION
Reel/Frame 064415/0683 →
Continuity (6)
Continuation 14517844 · Oct 18, 2014
Continuation 14145945 · Jan 1, 2014
Continuation 13897470 · May 20, 2013
Continuation 13221903 · Aug 31, 2011
Provisional Application 61379706 · Sep 2, 2010
Related Publication 20180268261A1 · Sep 20, 2018