Method and system for data mining

1. A method, implemented on a machine having at least one processor, storage, and a communication platform capable of connecting to a network for generating a stream of content items, the method comprising:

obtaining a plurality of entities associated with a time-window, wherein each entity of the plurality of entities is associated with at least one of content items;

computing for each entity, a first parameter corresponding to a number of occurrences of the entity in the time-window and a second parameter corresponding to an average number of occurrences of the entity in previous time-windows;

calculating for each entity, a trendiness score based on a difference between the first parameter and the second parameter;

generating a graph including one or more entity-pairs with respect to the plurality of entities, wherein a co-occurrence count of entities included in each of the one or more entity-pairs with respect to at least one of the content items exceeds a threshold;

generating one or more clusters of content items associated with each of the one or more entity-pairs, based on categories of the content items associated with each of the one or more entity-pairs;

ranking content items in each of the one or more clusters based on an average trendiness score of entities included in at least one corresponding entity-pair associated with the content items in the cluster; and

generating the stream of content items by selecting a highest ranked content item from each of the one or more clusters to be included in the stream.

2. The method of claim 1 , wherein the step of generating the stream of content items is further based on an average trendiness score of each entity-pair included in the graph.

3. The method of claim 1 , wherein the step of generating the stream of content items further comprises:

ranking each content item in the stream of content items based on trendiness scores of entities included in the entity-pair corresponding to the content item; and

providing the stream of content items based on the ranking.

4. The method of claim 1 , wherein the entity is associated with the time-window based on a second criterion related with the at least one of the content items from which the entity is extracted being satisfied.

5. The method of claim 4 , wherein the second criterion corresponds to a time instant of extracting the entity from the at least one of the content items being within a duration of the time-window.

6. A non-transitory machine-readable medium having information recorded thereon for generating a stream of content items, wherein the information, when read by the machine, causes the machine to perform following:

obtaining a plurality of entities associated with a time-window, wherein each entity of the plurality of entities is associated with at least one of content items;

computing for each entity, a first parameter corresponding to a number of occurrences of the entity in the time-window and a second parameter corresponding to an average number of occurrences of the entity in previous time-windows;

calculating for each entity, a trendiness score based on a difference between the first parameter and the second parameter;

generating a graph including one or more entity-pairs with respect to the plurality of entities, wherein a co-occurrence count of entities included in each of the one or more entity-pairs with respect to at least one of the content items exceeds a threshold;

generating one or more clusters, of content items associated with each of the one or more entity-pairs, based on categories of the content items associated with each of the one or more entity-pairs;

ranking content items in each of the one or more clusters based on an average trendiness score of entities included in at least one corresponding entity-pair associated with the content items in the cluster; and

generating the stream of content items by selecting a highest ranked content item from each of the one or more clusters to be included in the stream.

7. The medium of claim 6 , wherein the step of generating the stream of content items is further based on an average trendiness score of each entity-pair included in the graph.

8. The medium of claim 6 , wherein the step of generating the stream of content items further comprises:

ranking each content item in the stream of content items based on trendiness scores of entities included in the entity-pair corresponding to the content item; and

providing the stream of content items based on the ranking.

9. The medium of claim 6 , wherein the entity is associated with the time-window based on a second criterion related with the al least one of the content items from which the entity is extracted being satisfied.

10. The medium of claim 9 , wherein the second criterion corresponds to a time instant of extracting the entity from the at least one of the content items being within a duration of the time-window.

11. A system for generating a stream of content items comprising:

a retrieving unit implemented by a processor coupled to a memory and configured to obtain a plurality of entities associated with a time-window, wherein each entity of the plurality of entities is associated with at least one of content items;

a computing unit implemented by the processor and configured to compute for each entity, a first parameter corresponding to a number of occurrences of the entity in the time-window and a second parameter corresponding to an average number of occurrences of the entity in previous time-windows, and

calculate for each entity, a trendiness score based on a difference between the first parameter and the second parameter;

a graph generator implemented by the processor and configured to generate a graph including one or more entity-pairs with respect to the plurality of entities, wherein a co-occurrence count of entities included in each of the one or more entity-pairs with respect to at least one of the content items exceeds a threshold;

a clustering unit implemented by the processor and configured to generate one or more clusters, of content items associated with each of the one or more entity-pairs, based on categories of the content items associated with each of the one or more entity-pairs;

a ranking unit implemented by the processor and configured to rank content items in each of the one or more clusters based on an average trendiness score of entities included in at least one corresponding entity-pair associated with the content items in the cluster; and

a data stream generator implemented by the processor and configured to generate the stream of content items by selecting a highest ranked content item from each of the one or more clusters to be included in the stream.

12. The system of claim 11 , wherein the data stream generator is configured to generate the stream of content items further based on an average trendiness score of each entity-pair included in the graph.

13. The system of claim 11 , further comprising a ranking unit implemented by the processor and configured to rank each content item in the stream of content items based on trendiness scores of entities included in the entity-pair corresponding to the content item, and wherein the data stream generator is further configured to provide the stream of content items based on the ranking.

14. The system of claim 11 , wherein the entity is associated with the time-window based on a second criterion related with the at least one of the content items from which the entity is extracted being satisfied, the second criterion corresponding to a time instant of extracting the entity from the at least one of the content items being within a duration of the time-window.