Method for aggregating web feed minimizing redundancies
View Patent ↗When aggregating syndicated Web content, updated content is retrieved from predetermined Web feeds. The updated content is compared with stored content previously retrieved. If the updated content is determined to be different from the stored content, the updated content is stored. If the updated content is determined to be identical to the stored content, the updated content is delete.
1. A method for aggregating syndicated Web content, comprising:
retrieving updated content from predetermined Web feeds;
comparing said updated content with stored content previously retrieved;
storing the updated content if it is considered different from the stored content;
deleting the updated content if it is considered identical to the stored content;
wherein a similarity index S k j that denotes a degree of similarity between the updated content and the stored content is compared to two thresholds S min and S max wherein:
if the similarity index S k j is lower than S min , the updated content is considered different from the stored content; and
if the similarity index S k j is greater than S max , the updated content is considered identical to the stored content.
2. The method according to claim 1 , further including adding the updated content to a stored content if it is considered complementary thereto.
3. The method according to claim 1 , including computing the similarity index S k j to denote a degree of similarity between the updated content and the stored content.
4. The method according to claim 3 , including comparing said similarity index S k j to one or more thresholds.
5. The method according to claim 4 , wherein:
if the similarity index S k j is between S min and S max , the updated content is considered complementary to the stored content.
6. The method according to claim 1 , wherein updated content considered identical to a stored content is added to said stored content.
7. The method according to claim 1 , wherein previously retrieved content is stored as an entry within a feeds historic database.
8. A feed aggregator comprising:
a feed reader configured for checking for and retrieving updated content from predetermined Web feeds;
a filtering module configured for managing comparison of said updated content to stored content previously retrieved; and
a feeds historic database for storing content;
wherein the filtering module compares a similarity index S k j that denotes a degree of similarity between the updated content and the stored content to two thresholds S min and S max wherein:
if the similarity index S k j is lower than S min , the updated content is considered different from the stored content; and
if the similarity index S k j is greater than S max , the updated content is considered identical to the stored content.
9. The feed aggregator according to claim 8 , further comprising one or more entry analyzers linked to the filtering module, configured for comparing said updated content to stored content.
10. The feed aggregator according to claim 8 , wherein one or more entry analyzer is configured for computing the similarity index S k j denoting a degree of similarity between the updated content and the stored content, and wherein said filtering module is configured for comparing said similarity index to one or more thresholds to determine whether the updated content is to be removed or added to the feeds historic database.