Pattern recognition systems
Methods, apparatuses and systems directed to pattern identification and pattern recognition. In some particular implementations, the invention provides a flexible pattern recognition platform including pattern recognition engines that can be dynamically adjusted to implement specific pattern recognition configurations for individual pattern recognition applications. In some implementations, the present invention also provides for a partition configuration where knowledge elements can be grouped and pattern recognition operations can be individually configured and arranged to allow for multi-level pattern recognition schemes.
1. A system, comprising:
an interface configured to receive unstructured data;
a feature extraction module configured to extract a plurality of feature sets from the unstructured data;
a pattern recognition module configured to perform learning operations by which a knowledge base is generated based on first feature sets of the plurality of feature sets, the pattern recognition module also being configured to perform recognition operations in which second feature sets of the plurality of feature sets are compared to the knowledge base; and
memory configured to store the knowledge base;
wherein the interface, the feature extraction module, the pattern recognition module, and the memory are integrated in a single device.
2. The system of claim 1 , wherein each feature set represents a corresponding one of a plurality of portions of the unstructured data, each feature set also representing a point in a corresponding multi-dimensional space, and wherein the pattern recognition module is configured to perform the learning operations by generating a plurality of data objects from the feature sets, each data object corresponding to one or more of the feature sets, each data object representing a shape that includes the one or more points that the corresponding one or more feature sets represent.
3. The system of claim 2 , wherein the pattern recognition module is configured to perform the learning operations by associating metadata with each data object, the metadata for each data object identifying each portion of the unstructured data to which the data object corresponds.
4. The system of claim 3 , wherein the metadata for each data object also identifies a source of each portion of the unstructured data to which the data object corresponds.
5. The system of claim 1 , wherein the pattern recognition module is configured to perform the learning operations as supervised operations or unsupervised operations.
6. The system of claim 1 , wherein the pattern recognition module is configured to perform the recognition operations by comparing the second feature sets to knowledge elements of the knowledge base, wherein the knowledge elements of the knowledge base are organized in a plurality of partitions, each partition being configured to support a corresponding subset of the recognition operations.
7. The system of claim 6 , wherein the pattern recognition module is configured to perform the recognition operations by combining pattern recognition results from more than one of the partitions to generate a higher-level result.
8. The system of claim 1 , wherein the knowledge base includes a plurality of knowledge elements, and wherein the pattern recognition module is configured to maintain a count for each knowledge element, each count representing a number of the feature sets corresponding to that knowledge element, the counts collectively representing statistical regularities of patterns represented by the unstructured data.
9. The system of claim 1 , wherein the knowledge base includes a plurality of knowledge elements, and wherein the pattern recognition module is configured to perform the learning operations by associating metadata with each knowledge element, the metadata for each knowledge element identifying training data used in one or more of the learning operations associated with the knowledge element.
10. The system of claim 9 , wherein the pattern recognition module is configured to perform the recognition operations by retrieving the training data associated with a first knowledge element in response to a first recognition operation corresponding to the first knowledge element.
11. The system of claim 1 , wherein the knowledge base includes a plurality of knowledge elements, and wherein the pattern recognition module is configured to perform the learning operations by associating metadata with each knowledge element, the metadata for each knowledge element identifying remote data stored in a remote database separate from the knowledge base.
12. The system of claim 11 , wherein the pattern recognition module is configured to perform the recognition operations by retrieving the remote data associated with a first knowledge element in response to a first recognition operation corresponding to the first knowledge element.
13. The system of claim 1 , wherein different subsets of the feature sets include different numbers of features.
14. The system of claim 1 , wherein the unstructured data represent signals generated by one or more sensors, wherein the knowledge base includes a plurality of knowledge elements, and wherein the pattern recognition module is configured to perform the learning operations by associating metadata with each knowledge element, the metadata for each knowledge element identifying either or both of a corresponding sensor or corresponding sensor type.
15. The system of claim 1 , wherein the single device in which the interface, the feature extraction module, the pattern recognition module, and the memory are integrated is a controller for a data sensor.
16. A method, comprising:
receiving unstructured data;
extracting a plurality of feature sets from the unstructured data;
performing learning operations by which a knowledge base is generated based on first feature sets of the plurality of feature sets;
performing recognition operations in which second feature sets of the plurality of feature sets are compared to the knowledge base; and
storing the knowledge base;
wherein receiving the unstructured data, extracting the feature sets, performing the learning operations, performing the recognition operations, and storing the knowledge base are all performed by a single device.
17. The method of claim 16 , wherein each feature set represents a corresponding one of a plurality of portions of the unstructured data, each feature set also representing a point in a corresponding multi-dimensional space, and wherein the performing the learning operations includes generating a plurality of data objects from the feature sets, each data object corresponding to one or more of the feature sets, each data object representing a shape that includes the one or more points that the corresponding one or more feature sets represent.
18. The method of claim 17 , wherein performing the learning operations includes associating metadata with each data object, the metadata for each data object identifying each portion of the unstructured data to which the data object corresponds.
19. The method of claim 18 , wherein the metadata for each data object also identifies a source of each portion of the unstructured data to which the data object corresponds.
20. The method of claim 16 , wherein the learning operations are supervised operations or unsupervised operations.
21. The method of claim 16 , wherein performing the recognition operations includes comparing the second feature sets to knowledge elements of the knowledge base, wherein the knowledge elements of the knowledge base are organized in a plurality of partitions, each partition being configured to support a corresponding subset of the recognition operations.
22. The method of claim 21 , wherein performing the recognition operations includes combining pattern recognition results from more than one of the partitions to generate a higher-level result.
23. The method of claim 16 , wherein the knowledge base includes a plurality of knowledge elements, and wherein the method further comprises maintaining a count for each knowledge element, each count representing a number of the feature sets corresponding to that knowledge element, the counts collectively representing statistical regularities of patterns represented by the unstructured data.
24. The method of claim 16 , wherein the knowledge base includes a plurality of knowledge elements, and wherein performing the learning operations includes associating metadata with each knowledge element, the metadata for each knowledge element identifying training data used in one or more of the learning operations associated with the knowledge element.
25. The method of claim 24 , wherein performing the recognition operations includes retrieving the training data associated with a first knowledge element in response to a first recognition operation corresponding to the first knowledge element.
26. The method of claim 16 , wherein the knowledge base includes a plurality of knowledge elements, and wherein performing the learning operations includes associating metadata with each knowledge element, the metadata for each knowledge element identifying remote data stored in a remote database separate from the knowledge base.
27. The method of claim 26 , wherein performing the recognition operations includes retrieving the remote data associated with a first knowledge element in response to a first recognition operation corresponding to the first knowledge element.
28. The method of claim 16 , wherein different subsets of the feature sets include different numbers of features.
29. The method of claim 16 , wherein the unstructured data represent signals generated by one or more sensors, wherein the knowledge base includes a plurality of knowledge elements, and wherein performing the learning operations includes associating metadata with each knowledge element, the metadata for each knowledge element identifying either or both of a corresponding sensor or corresponding sensor type.
30. The method of claim 16 , wherein the single device is a controller for a data sensor.