Methods and systems for identifying a level of similarity between a plurality of data representations
A method for identifying a level of similarity between binary vectors includes storing, by a processor on a computing device, in each of a plurality of memory cells on the computing device, one of a plurality of binary vectors, each of the plurality of memory cells including a bitwise comparison circuit. The processor provides, to each of the plurality of memory cells, a received binary vector. Each of the bitwise comparison circuits determines a level of overlap between the received binary vector and the binary vector stored in the memory cell associated with the bitwise comparison circuit. Each of the comparison circuits that determines that the level of overlap satisfies a threshold provides, to the processor, an identification of the stored binary vector with the satisfactory level of overlap. The processor provides an identification of each stored binary vector satisfying the threshold.
1. A computer-implemented method for identifying a level of similarity between a first data item and a data item within a set of data documents, the method comprising:
clustering, by a reference map generator executing on a first computing device, in a two-dimensional metric space, a set of data documents selected according to at least one criterion, generating a semantic map;
associating, by the semantic map, a coordinate pair with each of the set of data documents;
generating, by a parser executing on the first computing device, an enumeration of data items occurring in the set of data documents;
determining, by a representation generator executing on the first computing device, for each data item in the enumeration, occurrence information including: (i) a number of data documents in which the data item occurs, (ii) a number of occurrences of the data item in each data document, and (iii) the coordinate pair associated with each data document in which the data item occurs;
generating, by the representation generator, for each data item in the enumeration, a sparse distributed representation (SDR) using the occurrence information, resulting in a plurality of generated SDRs;
storing, by a processor on a second computing device, in each of a plurality of memory cells on the second computing device, one of the plurality of generated SDRs, each of the plurality of memory cells including a bitwise comparison circuit;
receiving, by the second computing device, from a third computing device, a first data item;
providing, by the processor, via a data bus, to each of the plurality of memory cells, an SDR of the first data item;
determining, by each of the plurality of bitwise comparison circuits, a level of overlap between the SDR of the first data item and the generated SDR stored in the memory cell associated with the bitwise comparison circuit;
determining, by each of the plurality of bitwise comparison circuits, whether the level of overlap satisfies a threshold provided by the processor;
providing, to the processor, by each of the comparison circuits that determined the level of overlap did satisfy the threshold, a document reference number stored in the associated memory cell, the document reference number identifying a document including the data item from which the SDR stored in the memory cell was generated; and
providing, by the second computing device, to the third computing device, an identification of each data item from which the SDRs stored in the memory cells satisfying the threshold were generated and a level of similarity between the data item from which the stored SDR was generated and the received data item.
2. A computer-implemented method for identifying a level of similarity between binary vectors, the method comprising:
storing, by a processor on a computing device, in each of a plurality of memory cells on the computing device, one of a plurality of binary vectors, each of the plurality of memory cells including a bitwise comparison circuit;
receiving, by the computing device, a binary vector for comparing to each of the stored plurality of binary vectors;
providing, by a processor, via a data bus, to each of the plurality of memory cells, the received binary vector;
determining, by each of the bitwise comparison circuits, a level of overlap between the received binary vector and the binary vector stored in the memory cell associated with the bitwise comparison circuit;
determining, by each of the plurality of bitwise comparison circuits, whether the level of overlap satisfies a threshold provided by the processor;
providing, to the processor, by each of the comparison circuits that determined the level of overlap did satisfy the threshold, an identification of the stored binary vector with the satisfactory level of overlap; and
providing, by the processor, an identification of each stored binary vector satisfying the threshold and a level of similarity between the stored binary vector and the received binary vector.