IP Library Granted Patent US 9,734,401
Granted Patent B2
US 9,734,401 · App. 14/432,466 · Granted Aug 15, 2017

Detection and tracking of item features

Inventor: Shawn Hunt (Pinckney, MI)
Assignee: RoboticVISIONTech, Inc.
G06K9/00664G06T7/246G05B2219/40565
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,734,401
App. No.
14/432,466
Granted
Aug 15, 2017
Kind
B2
Abstract

Technologies are generally described for detection and tracking of item features. In some examples, features of an object may be initially found through detection of one or more edges and one or more corners of the object from a first perspective. In addition, determination may be made whether the detected edges and corners of the object are also detectable from one or more other perspectives. In response to an affirmative determination, the detected edges and of the object may be marked as features to be tracked, for example, in subsequent frames of a camera feed. The perspectives may correspond to distributed locations in a substantially umbrella-shaped formation centered over the object. In other examples, lighting conditions of an environment where the object is being tracked may be programmatically controlled.

Claims (61)

1. A method to detect and track item features, the method comprising:

selecting a plurality of perspectives from randomly distributed locations in a substantially umbrella-shaped formation centered over an item;

detecting one or more edges and one or more corners of the item from a first perspective of the plurality of perspectives;

determining whether the one or more edges and the one or more corners of the item are detectable from at least a second perspective of the plurality of perspectives;

in response to a determination that the one or more edges and the one or more corners of the item are detectable from the at least the second perspective of the plurality of perspectives, marking the one or more edges and the one or more corners of the item as features to be tracked; and

tracking the item through at least two captured image frames based on a correlation of the one or more edges and the one or more corners.

2. The method of claim 1 , wherein detecting the one or more edges and the one or more corners of the item comprises:

detecting the one or more edges based on a substantial change of brightness of pixels in a captured image of the item.

3. The method of claim 1 , wherein detecting the one or more edges and the one or more corners of the item comprises:

detecting the one or more corners as intersections of pairs of the one or more edges.

4. The method of claim 1 , further comprising:

determining one or more geometric features within the item based on the one or more edges and the one or more corners.

5. The method of claim 4 , further comprising:

determining an edge distance from an edge of each determined geometric feature, of the one or more geometric features, to a nearest outer edge of the item.

6. A method to detect and track item features, the method comprising:

detecting one or more edges and one or more corners of an item from a first perspective;

determining whether the one or more edges and the one or more corners of the item are detectable from at least a second perspective;

in response to a determination that the one or more edges and the one or more corners of the item are detectable from the at least the second perspective, marking the one or more edges and the one or more corners of the item as features to be tracked;

determining one or more geometric features within the item based on the marked one or more edges and the marked one or more corners of the item;

determining an edge distance from an edge of each determined geometric feature, of the one or more geometric features, to a nearest outer edge of the item; and

tracking the item through at least two captured image frames based on a correlation of the one or more geometric features and corresponding edge distances.

7. The method of claim 1 , further comprising:

detecting a change in a lighting intensity or a lighting color composition in an environment in which the item is detected.

8. The method of claim 7 , further comprising:

compensating for the detected change in the lighting intensity or the lighting color composition by using one or more light sources in the environment.

9. An apparatus configured to detect and track item features, the apparatus comprising:

at least one image capture module that comprises a plurality of image sensors positioned at a plurality of locations in a substantially umbrella-shaped formation centered over an item, wherein the at least one image capture module is configured to capture images of the item from a plurality of perspectives; and

at least one analysis module communicatively coupled to the at least one image capture module, wherein the at least one analysis module is configured to:

detect one or more edges and one or more corners of the item from a first perspective;

in response to a detection of a change in a lighting intensity or a lighting color composition in an environment in which the one or more edges and the one or more corners of the item are being detected, compensate for the detected change by use of one or more light sources;

determine whether the one or more edges and the one or more corners of the item are detectable from at least a second perspective; and

in response to a determination that the one or more edges and the one or more corners of the item are detectable from the at least the second perspective, mark the one or more edges and the one or more corners of the item as features to be tracked.

10. The apparatus of claim 9 , wherein the plurality of perspectives correspond to the plurality of locations in the substantially umbrella-shaped formation centered over the item.

11. The apparatus of claim 10 , wherein the first perspective corresponds to a particular location of the substantially umbrella-shaped formation.

12. An apparatus configured to detect and track item features, the apparatus comprising:

at least one image capture module that comprises a plurality of image sensors, wherein the at least one image capture module is configured to capture images of an item from a plurality of perspectives;

a movable support configured to move the at least one image capture module to a plurality of positions in a substantially umbrella-shaped formation centered over the item, wherein the plurality of perspectives correspond to the plurality of positions in the substantially umbrella-shaped formation; and

at least one analysis module communicatively coupled to the at least one image capture module, wherein the at least one analysis module is configured to:

detect one or more edges and one or more corners of the item from a first perspective;

in response to a detection of a change in a lighting intensity or a lighting color composition in an environment in which the one or more edges and the one or more corners of the item are being detected, compensate for the detected change by use of one or more light sources;

determine whether the one or more edges and the one or more corners of the item are detectable from at least a second perspective; and

in response to a determination that the one or more edges and the one or more corners of the item are detectable from the at least the second perspective, mark the one or more edges and the one or more corners of the item as features to be tracked.

13. The apparatus of claim 9 , wherein the plurality of image sensors comprises at least one of a complementary metal oxide semiconductor (CMOS) image sensor, a charged coupled device (CCD) image sensor, and an N-type metal oxide semiconductor (NMOS) image sensor.

14. The apparatus of claim 9 , wherein the one or more light sources include light emitting diodes (LEDs) of one or more colors.

15. A system to detect and track item features, the system comprising:

at least one image capture module that comprises a plurality of image sensors, wherein the at least one image capture module is configured to capture images of an item from a plurality of perspectives;

at least one movable support mechanically coupled to the at least one image capture module, wherein the at least one movable support is configured to move the at least one image capture module to a plurality of positions in a substantially umbrella-shaped formation, wherein the plurality of positions correspond to the plurality of perspectives; and

at least one processor communicatively coupled to the at least one image capture module and the at least one movable support, wherein the at least one processor is configured to:

detect one or more edges and one or more corners of the item from a first perspective;

in response to a detection of a change in a lighting intensity or a lighting color composition in an environment in which the one or more edges and the one or more corners of the item are being detected, compensate for the detected change by use of one or more light sources;

determine whether the one or more edges and the one or more corners of the item are detectable from at least a second perspective; and

in response to a determination that the one or more edges and the one or more corners of the item are detectable from the at least the second perspective, mark the one or more edges and the one or more corners of the item as features to be tracked.

16. The system of claim 15 , wherein the at least one processor is configured to:

detect the one or more edges based on a substantial change of brightness of pixels in a captured image of the item; and

detect the one or more corners as intersections of pairs of the one or more edges.

17. The system of claim 15 , wherein the at least one processor is further configured to:

determine one or more geometric features within the item based on the one or more edges and the one or more corners; and

determine an edge distance from an edge of each determined geometric feature, of the one or more geometric features to a nearest outer edge of the item.

18. The system of claim 15 , wherein the at least one processor comprises a graphics processor and a central processor, and wherein the graphics processor is configured to:

mark the one or more edges and the one or more corners as features to be tracked; and

provide a list of the features to the central processor for frame-by-frame tracking.

Assignments (4)
LICENSE Recorded Mar 27, 2019
From: IDF HOLDINGS I LLC
To: ROBOTIC VISION TECH INC
Reel/Frame 048709/0479 →
CHANGE OF NAME Recorded Jun 7, 2017
From: ROBOTICVISIONTECH LLC
To: ROBOTICVISIONTECH, INC.
Reel/Frame 042712/0984 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2015
From: HUNT, SHAWN
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 035292/0671 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2015
From: EMPIRE TECHNOLOGY DEVELOPMENT LLC
To: ROBOTIC VISION TECHNOLOGIES, LLC
Reel/Frame 035292/0702 →
Continuity (1)
Related Publication 20160042517A1 · Feb 11, 2016