SYSTEM AND METHOD FOR MULTI-MODAL BIOMETRICS
A system and method relate to multi-modal biometrics. A single modality score is generated for each of a plurality of biometric modalities. A classifier is selected from a database of multi-modal classifiers, and a multi-modal fusion is applied to the single modality scores using the classifier. The single modality scores are then aggregated. A context dependent model is generated, and a measure of the context in which the biometric samples were obtained is applied to the aggregated single modality scores. It is then determined whether there is a match between two or more biometric samples.
1 . A computerized process comprising:
receiving at a processor a plurality of biometric samples relating to a plurality of biometric modalities;
generating with the processor a single modality score for each of the plurality of biometric modalities;
selecting a classifier from a database of multi-modal classifiers;
applying a multi-modal fusion to the single modality scores using the processor and the classifier;
aggregating the single modality scores;
generating a context dependent model and applying a measure of the context in which the biometric samples were obtained to the aggregated single modality scores; and
determining whether there is a match between two or more biometric samples.
2 . The process of claim 1 , wherein the measure of the context comprises one or more of data relating to prior events, data relating to relationships of persons in a database of biometric data, and data relating to relationships to other objects.
3 . The process of claim 2 , wherein the prior events and persons in the biometric samples are modeled as nodes in a network structure, and relationships and interactions among the prior events and nodes are represented by weighted edges in a graph.
4 . The process of claim 3 , wherein the determining whether there is a match is performed as a function of the weighted edges in a graph.
5 . The process of claim 1 , comprising:
receiving at the processor operator feedback to improve the multimodal matching of biometrics; and
modifying the context dependent models as a function of the operator feedback.
6 . The process of claim 1 , comprising applying the context dependent model to generate a probability distribution over scores of missing modalities.
7 . The process of claim 1 , comprising applying a priori knowledge about interdependencies across biometric systems within each modality, and generating a score for a missing biometric system such that a more accurate modality score is generated.
8 . The process of claim 1 , comprising receiving at the computer processor scores from a plurality of biometric sampling systems, and first fusing the scores from the plurality of biometric sampling systems into a single score, and then aggregating the fused score from the plurality of biometric sampling systems with one or more scores from other modalities.
9 . The process of claim 1 , wherein the biometric samples comprise subjects of interest, and further comprising a gallery of registered subjects, and further wherein the process comprises relationships among the registered subjects and relationships among the subjects of interest.
10 . The process of claim 1 , comprising applying Bayesian reasoning to the context and a relationship among subjects to generate a probability distribution over a plurality of scores of missing modalities.
11 . A computerized process comprising:
receiving at a processor a plurality of biometric samples relating to a plurality of biometric modalities;
generating with the processor a single modality score for each of the plurality of biometric modalities;
applying a multi-modal fusion to the single modality scores using the processor and a classifier;
aggregating the single modality scores;
generating a context dependent model and applying a measure of the context in which the biometric samples were obtained to the aggregated single modality scores; and
determining whether there is a match between two or more biometric samples.
12 . The process of claim 11 , wherein a bank of classifiers covering a plurality of subsets of a plurality of biometric subsystems is used for one or more of recognition or verification.
13 . The process of claim 11 , wherein the measure of the context comprises data relating to prior events and data relating to relationships of persons in a database of biometric data.
14 . The process of claim 11 , wherein the measure of the context comprises data relating to relationships between biometric systems within a biometric modality.
15 . The process of claim 11 , comprising applying Bayesian reasoning to the context and a relationship among biometric samples to generate a probability distribution over a plurality of scores of missing modalities.
16 . The process of claim 11 , comprising applying a priori knowledge about interdependency between biometric modalities to generate a probability distribution over scores of missing modalities.
17 . A machine-readable medium storing instructions, which, when executed by a processor, cause the processor to perform a process comprising:
receiving at a processor a plurality of biometric samples relating to a plurality of biometric modalities;
generating with the processor a single modality score for each of the plurality of biometric modalities;
applying a multi-modal fusion to the single modality scores using the processor and a classifier;
aggregating the single modality scores;
generating a context dependent model and applying a measure of the context in which the biometric samples were obtained to the aggregated single modality scores; and
determining whether there is a match between two or more biometric samples.
18 . The machine-readable medium of claim 17 ,
wherein a bank of classifiers covering a plurality of subsets of a plurality of biometric subsystems is used for one or more of recognition or verification;
wherein the measure of the context comprises data relating to prior events and data relating to relationships of persons in a database of biometric data; and
wherein the measure of the context comprises data relating to relationships between biometric modalities.
19 . The machine-readable medium of claim 17 , comprising instructions for applying Bayesian reasoning to the context and a relationship among biometric samples to generate a probability distribution over a plurality of scores of missing modalities.
20 . The machine-readable medium of claim 17 , comprising instructions for applying a priori knowledge about interdependency between biometric modalities to generate a probability distribution over scores of missing modalities.