Systems and methods for providing a microdocument framework for storage, retrieval, and aggregation

1. A method implemented on a machine having at least one processor, storage, and a communication platform connected to a network for providing a microdocument framework, the method comprising:

receiving a query;

obtaining, based on the query, a plurality of microdocuments;

obtaining annotation data associated with the plurality of microdocuments;

filtering the plurality of microdocuments based on criteria associated with the annotation data;

extracting tokens from the annotation data associated with the filtered microdocuments;

identifying a trend based on the extracted tokens;

obtaining, based on the query, a set of web documents that are independent of the filtered microdocuments;

summarizing content included in the filtered microdocuments;

merging summarized content with the set of web documents to generate a blended search result; and

providing the blended search result and additional content related to the trend in response to the query.

2. The method of claim 1 further comprising:

receiving a search request for searching the plurality of microdocuments, the search request including a plurality of search terms; and

performing the search operations using the plurality of search terms.

3. The method of claim 1 wherein indexing of the microdocuments is done on a real-time basis.

4. The method of claim 1 further comprising:

filtering the plurality of microdocuments based on the identified trend.

5. The method of claim 1 , further comprises:

tokenizing each of the plurality of microdocuments into one or more predefined components based on a determined respective format.

6. The method of claim 1 , further comprising:

performing requested operations on the blended search result, wherein the requested operations comprise one or more of: sort by field, find average or variance, group by subject, group by sentiment, count by field or group, and find documents above or below a threshold.

7. The method of claim 1 , wherein the microdocuments are obtained from a plurality of microdocument providers and comprise instant messages or small content messages found on one or more social network web locations.

8. The method of claim 1 wherein the plurality of microdocuments are obtained from a first database and annotation data is obtained from a second database that is different than the first database.

9. A system for providing a microdocument framework, the system comprising:

a processing device; and

a computer readable medium having executable instructions stored thereon such that the processing device, in response to the executable instructions, is operative to:

receive a query;

obtain, based on the query, a plurality of microdocuments;

obtain annotation data associated with the plurality of microdocuments;

filter from the plurality of microdocuments based on criteria associated with the annotation data;

extract tokens from the annotation data associated with the filtered microdocuments;

identify a trend based on the extracted tokens;

obtain, based on the query, a set of web documents that are independent of the filtered microdocuments;

summarize content included in the filtered microdocuments;

merge summarized content with the set of web documents to generate a blended search result; and

provide the blended search result and additional content related to the trend in response to the query.

10. The system of claim 9 , the processing device, in response to executable instructions, further operative to:

receive a search request for searching the plurality of microdocuments, the search request including a plurality of search terms; and

perform the searching operations using the plurality of search terms.

11. The system of claim 9 , the processing device, in response to executable instructions, further operative to:

filter the plurality of microdocuments based on the identified trend.

12. A non-transitory machine readable medium having information for providing a microdocument framework, wherein the information, when read by the machine, causes the machine to perform the following:

receiving a query;

obtaining, based on the query, a plurality of microdocuments;

obtaining annotation data associated with the plurality of microdocuments;

filtering the plurality of microdocuments based on criteria associated with the annotation data;

extracting tokens from the annotation data associated with the filtered microdocuments;

identifying a trend based on the extracted tokens;

obtaining, based on the query, a set of web documents that are independent of the filtered microdocuments;

summarizing content included in the filtered microdocuments;

merging summarized content with the set of web documents to generate a blended search result; and

providing the blended search result and additional content related to the trend in response to the query.

13. The medium of claim 12 , the information, when read by the machine, further causing the machine to perform the following:

receiving a search request for searching the plurality of microdocuments, the search request including a plurality of search terms; and

performing the search operations using the plurality of search terms.

14. The medium of claim 12 , the information, when read by the machine, further causing the machine to perform the following:

filtering the plurality of microdocuments based on the identified trend.