Methods and systems for facial point-of-recognition (POR) provisioning

1. A facial recognition method, said method comprising the steps of:

extracting a feature descriptor from a detected feature point of a detected face in an input image frame from a video/image capturing device; and

matching the extracted feature descriptor with at least one of a pre-stored facial image that is index-mapped using a constrained deformable part-based model (CDPBM) that uses Histogram-of-Gradient (HoG) as part-based filters and trained by latent Support Vector Machine (SVM) to determine face feature point location and geometry, comprising at least a first and second round of matching, wherein the second round of matching only selects the index-mapped facial images that matched above a pre-defined threshold from the first round of matching.

2. The method of claim 1 , wherein the index mapping generating an index map, is in at least one of an array, hash table, lookup table, or a k-dimensional (k-d) tree format in order to speed up identifying a matching image among the pre-stored images for the input image for facial recognition.

3. The method of claim 2 , further comprising the step of pruning the k-dimensional (k-d) tree.

4. The method of claim 1 , further comprising the step of comparing a signature of the input image with the one or more feature descriptors of the pre-stored image using at least one of spatial consistency or a temporal verification check on the matching image.

5. The method of claim 1 , further comprising the step of computing a matching score between the input image and the pre-stored image.

6. The method of claim 1 , further comprising the step of clustering a set of training images into Similar Image Clusters (SICs).

7. The method of claim 1 , further comprising the step of receiving the input image frame from at least one of an access control point or surveillance point, wherein the access control point or surveillance point further comprises at least one of the following provisioning: allow access to a venue/event; deny access to a venue/event; process a purchasing transaction; or provide admission to a mass transit.

8. A facial recognition system comprising:

an image input unit;

a feature extraction unit;

an index mapping unit;

a matching unit;

a processor, a non-transitory storage element coupled to the processor, encoded instructions stored in the non-transitory storage element, wherein the encoded instructions when implemented by the processor, configure the system to:

receive a video and/or image from a surveillance or access-control point for parsing into image frames or segments by the image input unit;

extract a feature descriptor using a constrained deformable part-based model (CDPM) that uses Histogram of Gradient (HoG) as part-based filters and trained by latent Support Vector Machine (SVM) to determine face feature point location and geometry by the feature extraction unit; and

match the extracted feature descriptor with at least one of a pre-stored facial image that is index-mapped, comprising at least a first and second round of matching, wherein the second round of matching only selects the index-mapped facial images that matched above a pre-defined threshold from the first round of matching by the matching unit.

9. The system of claim 8 , wherein the image input unit receives input from at least one of a real-time streaming system, video/image archive, computer system, video capture device, remote server, or hand-held device.

10. The system of claim 8 , wherein the image input unit or feature extraction unit selects the best appearance of the face across the frames based on at least one of a sharpness, size, noise, motion blur, or pose variation.

11. The system of claim 8 , further comprising a face alignment and normalization unit further configured to normalize the detected feature point by at least one of a Gamma Correction, Difference of Gaussian (DoG) filtering, Masking, or Contrast Equalization.

12. The system of claim 11 , wherein the masking further comprises detecting an upper and lower edge of glasses and applying a filter to remove masking effects of the glasses on the face.

13. The system of claim 11 , wherein the masking further comprises detecting outer edges of facial hair and applying a filter to remove masking effects of the facial hair on the face.

14. The system of claim 8 , wherein the feature extraction unit is further configured to

transform the feature descriptors to a lower dimensional space.

15. The system of claim 14 , wherein the transformation is performed using at least one

of a discriminate analysis approach such as Fisher Discriminant Analysis, Principle Component Analysis and Independent Component Analysis (ICA).

16. The system of claim 8 , further comprising the step of computing a matching score

between the input image and the pre-stored image and determining the threshold based on the surveillance or access control point by the matching unit.

17. The system of claim 8 , wherein the access control point further comprises at least one of the following provisioning: allow access to a venue/event, deny access to a venue/event, or process a purchasing transaction.

18. A facial recognition system comprising:

a processor, a non-transitory storage element coupled to the processor, encoded instructions stored in the non-transitory storage element, wherein the encoded instructions when implemented by the processor, configure the system to:

receive a video and/or image from a surveillance or access-control point for parsing into image frames or segments;

extract a feature descriptor from a detected feature point of a detected face in the input image frame or segment; and

match the extracted feature descriptor with at least one of a pre-stored facial image using a constrained deformable part-based model (CDPM) that uses Histogram of Gradient (HoG) as part-based filters and trained by latent Support Vector Machine (SVM) to determine face feature point location and geometry, comprising at least a first and second round of matching, wherein the second round of matching only selects the facial images that matched above a pre-defined threshold from the first round of matching wherein the access control point further comprises at least one of the following provisioning: allow access to a venue/event, deny access to a venue/event, or process a purchasing transaction.