IP Library Granted Patent US 10,070,054
Granted Patent B2
US 10,070,054 · App. 14/563,997 · Granted Sep 4, 2018

Methods for background subtraction using focus differences

Inventors: Mohamed Nabil Hajj Chehade (Los Angeles, CA); Sina Fateh (Mountain View, CA); Sleiman Itani (East Palo Alto, CA); Allen Yang Yang (Richmond, CA)
Assignee: Atheer, Inc.
H04N5/23229G06K9/4671G06T7/11G06T7/174G06T7/194G06T7/557G06T7/571H04N5/2258H04N5/232H04N5/23212H04N13/0239G06T2207/10004G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,070,054
App. No.
14/563,997
Granted
Sep 4, 2018
Kind
B2
Abstract

First and second images are captured at first and second focal lengths, the second focal length being longer than the first focal length. Element sets are defined with a first element of the first image and a corresponding second element of the second image. Element sets are identified as background if the second element thereof is more in-focus than or as in-focus as the first element. Background elements are subtracted from further analysis. Comparisons are based on relative focus, e.g. whether image elements are more or less in-focus. Measurement of absolute focus is not necessary, nor is measurement of absolute focus change; images need not be in-focus. More than two images, multiple element sets, and/or multiple categories and relative focus relationships also may be used.

Claims (50)

1. A method, comprising:

receiving a first image with a first focal length and a first field of view;

receiving a second image with a second focal length and a second field of view, wherein the second focal length is longer than the first focal length, and wherein the second field of view is similar to the first field of view;

defining a set of elements comprising a first element in the first image and a second element in the second image, wherein the first element substantially corresponds to the second element;

determining a first rate of change of an image property of the first element, the first rate of change is indicative of a first focus level of the first element;

determining a second rate of change of the image property of the second element, the second rate of change is indicative of a second focus level of the second element; and

assigning the set of elements as background elements when the second focus level is greater than or equal to the first focus level.

2. The method of claim 1 , further comprising:

determining that an element in the set of elements is not substantially in-focus in the first image or the second image; and

assigning the element as a foreground object in the first image and the second image.

3. The method of claim 1 , wherein the first focal length is less than a distance to a foreground object in the first field of view.

4. The method of claim 1 , wherein the first focal length is substantially equal to a distance to a foreground object in the first field of view.

5. The method of claim 1 , wherein the first focal length is greater than a distance to a foreground object in the first field of view.

6. The method of claim 1 , wherein the second focal length is less than a distance to a foreground object in the second field of view.

7. The method of claim 1 , wherein the second focal length is substantially equal to a distance to a foreground object in the second field of view.

8. The method of claim 1 , wherein the second focal length is greater than a distance to a foreground object in the second field of view.

9. The method of claim 1 , wherein the first focal length is approximately at least a defined distance to a foreground object in the first field of view.

10. The method of claim 1 , wherein the first focal length corresponds to a length of an of an individual operating a device to capture the first image.

11. The method of claim 1 , wherein the first focal length corresponds to a maximum extension of a hand of an individual operating a device to capture the first image.

12. The method of claim 1 , wherein the first focal length is at least 0.5 meters.

13. A method, comprising;

receiving a first image with a first focal length and a first field of view;

receiving a second image with a second focal length and a second field of view, the second focal length is longer than the first focal length, and wherein the first field of view is substantially similar to the second field of view;

defining a set of elements comprising a first element in the first image and a second element in the second image, wherein the first element substantially corresponds to the second element;

determining a first rate of change of an image property of the first element, the first rate of change is in of a first focus level of the first element;

determining a second rate of change of the image property of the second element, the second rate of change is indicative of a second focus level of the second element; and

assigning the set of elements to a category when the second focus level is greater than or equal to the first focus level.

14. The method of claim 13 , further comprising:

determining that an element in the set of elements is not substantially in-focus in the first image or the second image; and

assigning the element as a foreground object in the first image and the second image.

15. The method of claim 13 , wherein the first focal length is less than a distance to a foreground object in the first field of view.

16. The method of claim 13 , wherein the first focal length is substantially equal to a distance to a foreground object in the first field of view.

17. The method of claim 13 , wherein the first focal length is greater than a distance to a foreground object in the first field of view.

18. The method of claim 13 , wherein the second focal length is less than a distance to a foreground object in the second field of view.

19. The method of claim 13 , wherein the second focal length is substantially equal to a distance to a foreground object in the second field of view.

20. The method of claim 13 , wherein the second focal length is greater than a distance to a foreground object in the second field of view.

21. The method of claim 13 , wherein the first focal length is approximately at least a defined distance to a foreground object in the second field of view.

22. The method of claim 13 , wherein the first focal length corresponds to a length of an arm of an individual operating a device to capture the first image.

23. The method of claim 13 , wherein the first focal length corresponds to a maximum extension of a hand of an individual operating a device to capture the first image.

24. The method of claim 13 , wherein the first focal length is at least 0.5 meters.

25. A method, comprising:

receiving a first image with a first focal length and a first field of view;

receiving a second image with a second focal length and a second field of view, wherein the second focal length is longer than the first focal length, and wherein the first field of view is substantially similar to the second field of view;

defining a set of elements comprising a first element in the first image and a second element in the second image, wherein the first element substantially corresponds to the second element;

determining a first rate of change of an Image property of the first element, the first rate of change is indicative of a first focus level of the first element;

determining a second rate of change of the property of the second element, the second rate of change is indicative of a second focus level of the second element; and

assigning the set of elements as background elements when:

none of the elements in the set of elements is substantially fully in-focus;

the first focal length or the second focal length is less than a distance to a foreground object in the first image or the second image; or

the first focal length or the second focal length is greater than the distance to the foreground object in the first image or the second image.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
SECURITY INTEREST Recorded Nov 20, 2018
From: ATHEER, INC.
To: COTA CAPITAL MASTER FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 048154/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: CHEHADE, MOHAMED NABIL HAJJ; FATEH, SINA; ITANI, SLEIMAN; YANG, ALLEN YANG
To: ATHEER, INC.
Reel/Frame 034436/0315 →
Continuity (3)
Division 13786225 · Mar 5, 2013
Provisional Application 61720957 · Oct 31, 2012
Related Publication 20150093030A1 · Apr 2, 2015