IP Library Granted Patent US 9,471,828
Granted Patent B2
US 9,471,828 · App. 14/444,560 · Granted Oct 18, 2016

Accelerating object detection

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,471,828
App. No.
14/444,560
Granted
Oct 18, 2016
Kind
B2
Abstract

Accelerating object detection techniques are described. In one or more implementations, adaptive sampling techniques are used to extract features from an image. Coarse features are extracted from the image and used to generate an object probability map. Then, dense features are extracted from high-probability object regions of the image identified in the object probability map to enable detection of an object in the image. In one or more implementations, cascade object detection techniques are used to detect an object in an image. In a first stage, exemplars in a first subset of exemplars are applied to features extracted from the multiple regions of the image to detect object candidate regions. Then, in one or more validation stages, the object candidate regions are validated by applying exemplars from the first subset of exemplars and one or more additional subsets of exemplars.

Claims (62)

1. A computer-implemented method comprising:

receiving an image;

extracting coarse features from the image;

generating an object probability map based on the coarse features extracted from the image, the object probability map indicating high-probability object regions in the image that are likely to contain an object; and

extracting dense features from the high-probability object regions of the image identified in the object probability map to enable detection of one or more objects in the image, wherein the dense features are features extracted using smaller sampling steps than sampling steps used to extract the coarse features.

2. The computer-implemented method of claim 1 , wherein the object probability map further indicates low-probability object regions in the image that are not likely to contain an object, and wherein dense features are not extracted from the low-probability object regions of the image.

3. The computer-implemented method of claim 1 , further comprising detecting one or more objects in the image based on the dense features extracted from the image.

4. The computer-implemented method of claim 1 , wherein the generating the object probability map comprises:

quantizing the extracted features into visual words;

locating corresponding visual words from a feature vocabulary, the feature vocabulary associating visual words with corresponding importance weights;

assigning the corresponding importance weights of the corresponding visual word to the coarse features extracted from the image;

accumulating the importance weights of the coarse features to generate probability scores; and

assigning the probability scores to positions on the object probability map that correspond to respective locations of the coarse features in the image.

5. The computer-implemented method of claim 4 , wherein the extracting dense features from the high-probability object regions of the image further comprises:

comparing the probability score of each dense feature to a predetermined threshold; and

extracting the dense feature if the probability score is greater than the threshold.

6. The computer-implemented method of claim 1 , further comprising:

generating a new object probability map based on the dense features, the new object probability map indicating additional high-probability object regions in the image; and

extracting further dense features from the additional high-probability object regions of the image.

7. The computer-implemented method of claim 1 , wherein the one or more objects each comprise a face.

8. A system comprising:

one or more processors;

one or more memories having instructions stored thereon that, responsive to execution by the one or more processors, perform operations comprising:

receiving an image;

extracting coarse features from the image;

generating an object probability map based on the extracted coarse features, the object probability map indicating high-probability object regions in the image that are likely to contain an object; and

extracting dense features from the high-probability object regions of the image identified in the object probability map;

applying a first subset of exemplars to the dense features to detect object candidate regions;

extracting additional features from the object candidate regions; and

applying one or more additional subsets of exemplars to the additional features extracted from the object candidate regions to validate one or more of the object candidate regions.

9. The system of claim 8 , wherein the object probability map further indicates low-probability object regions in the image that are not likely to contain an object, and wherein dense features are not extracted from the low-probability object regions of the image.

10. The system of claim 8 , wherein the generating the object probability map further comprises:

quantizing the extracted features into visual words;

locating corresponding visual words from a feature vocabulary, the feature vocabulary associating visual words with corresponding importance weights;

assigning the corresponding importance weights of the corresponding visual word to the coarse features extracted from the image;

accumulating the importance weights of the coarse features to generate probability scores; and

assigning the probability scores to positions on the object probability map that correspond to respective locations of the coarse features in the image.

11. The system of claim 10 , wherein the extracting dense features from the high-probability object regions of the image further comprises:

comparing the probability score of each dense feature to a predetermined threshold; and

extracting the dense feature if the probability score is greater than the threshold.

12. The system of claim 8 , wherein the number of exemplars in the first subset of exemplars is less than the number of exemplars in each of the one or more additional subsets of exemplars.

13. The system of claim 8 , wherein validating the object candidate regions further comprises detecting at least one of the object candidate regions as a false positive region, and removing the false positive region from the object candidate regions.

14. A system implemented at least partially in hardware, the system comprising:

an adaptive sampling module to:

extract coarse features from an image;

generate an object probability map based on the coarse features extracted from the image, the object probability map indicating high-probability object regions in the image that are likely to contain an object; and

extract dense features from the high-probability object regions of the image identified in the object probability map to enable detection of one or more objects in the image, wherein the dense features are features extracted using smaller sampling steps than sampling steps used to extract the coarse features.

15. The system of claim 14 , wherein the object probability map further indicates low-probability object regions in the image that are not likely to contain an object, and wherein dense features are not extracted from the low-probability object regions of the image.

16. The system of claim 14 , wherein the adaptive sampling module is further configured to detect one or more objects in the image based on the dense features extracted from the image.

17. The system of claim 14 , wherein the adaptive sampling module is configured to generate the object probability map by:

quantizing the extracted features into visual words;

locating corresponding visual words from a feature vocabulary, the feature vocabulary associating visual words with corresponding importance weights;

assigning the corresponding importance weights of the corresponding visual word to the coarse features extracted from the image; and

accumulating the importance weights of the coarse features to generate probability scores; and

assigning the probability scores to positions on the object probability map that correspond to respective locations of the coarse features in the image.

18. The system of claim 14 , wherein the adaptive sampling module is configured to extract dense features from the high-probability object regions of the image further by:

comparing the probability score of each dense feature to a predetermined threshold; and

extracting the dense feature if the probability score is greater than the threshold.

19. The system of claim 14 , wherein the adaptive sampling module is further configured to:

generate a new object probability map based on the dense features, the new object probability map indicating additional high-probability object regions in the image; and

extract further dense features from the additional high-probability object regions of the image.

20. The system of claim 14 , wherein the one or more objects each comprise a face.

Assignments (2)
CHANGE OF NAME Recorded Apr 8, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048867/0882 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2014
From: SHEN, XIAOHUI; LIN, ZHE; BRANDT, JONATHAN W.
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 033405/0096 →