Methods and systems for grouping uniform resource locators based on masks
A method and system for grouping metadata search results associated with media on a computer network, such as multimedia and streaming media include binning and iterative masking. The media metadata has an associated media file, which has an associated uniform resource locator (URL). Each URL has at least one field, and each field has at least one character. Binning includes selecting, sorting, and putting URLs having a common attribute into the same bin. Masking includes creating a mask of masking characters. Each field in each URL in each bin is compare with the mask. If a masking character matches a character in a field, the character in the field is removed from the field. This produces at least one resultant URL, i.e., URL that has been compared with a mask. Identical resultant URLs are collapsing into one URL. Thus, redundant and variant URLs are collapsed into a single URL, which may be provided to a search system (e.g., search engine) and/or to a user.
1. A computer-implemented method for consolidating a plurality of uniform resource locators (URLs), each URL comprising at least one character, the method comprising:
receiving a plurality of masks, each mask comprising a string of one or more characters;
accessing a list of URLs;
for each URL in the list of URLs:
identifying any portions of the URL that match the one or more characters in the plurality of masks, and
removing from the URL the identified portions to create a resultant URL; and
collapsing all identical resultant URLs into one URL.
2. The method of claim 1 further comprising, prior to comparing each URL and collapsing all identical resultant URLs into one URL, sorting the plurality of URLs into one or more bins, wherein each URL comprises at least one field and each bin comprises at least one URL, each URL in a bin having common contents for at least one field.
3. The method of claim 1 , wherein one or more of the URLs are associated with media and one or more of the plurality of masks indicates a bit rate of the media.
4. The method of claim 1 , wherein one or more of the URLs are associated with media and one or more of the plurality of masks indicates a format of the media.
5. The method of claim 1 , wherein one or more of the URLs are associated with media and include content indicating an artist of the media.
6. The method of claim 1 , wherein one or more of the URLs include content indicating a linking URL associated with media.
7. The method of claim 1 , wherein one or more of the URLs are associated with media and include content indicating a title of the media.
8. The method of claim 1 , wherein one or more of the URLs are associated with media and include content indicating a copyright of the media.
9. The method of claim 1 , wherein one or more of the URLs are associated with media and include content indicating at least one of a host of the media, a bit rate of the media, a sampling rate of the media, and a duration of the media.
10. A computing system, comprising:
a processor configured to execute instructions; and
a memory system comprising one or more computer readable media, wherein the memory system stores computer instructions that, when executed by the process, cause the processor to perform a method comprising:
receiving a plurality of masks, each mask comprising a string of one or more characters;
accessing a list of URLs;
for each URL in the list of URLs:
identifying any portions of the URL that match the one or more characters in the plurality of masks, and
removing from the URL the identified portions to create a resultant URL; and
collapsing all identical resultant URLs into one URL.
11. The system of claim 10 , the method stored in the memory system further comprising instructions for:
prior to comparing each URL and collapsing all identical resultant URLs into one URL, sorting the plurality of URLs into one or more bins, wherein each URL comprises at least one field and each bin comprises at least one URL, each URL in a bin having common contents for at least one field.
12. The system of claim 10 , wherein one or more of the URLs are associated with media and one or more of the plurality of masks indicates a bit rate of the media.
13. The system of claim 10 , wherein one or more of the URLs are associated with media and one or more of the plurality of masks indicates a format of the media.
14. The system of claim 10 , wherein one or more of the URLs include content indicating a linking URL associated with media.
15. The system of claim 10 , wherein one or more of the URLs are associated with media and include content indicating a copyright of the media.
16. The system of claim 10 , wherein one or more of the URLs are associated with media and include content indicating at least one of an artist of the media, a title of the media, a host of the media, a bit rate of the media, a sampling rate of the media, and a duration of the media.
17. A tangible computer-readable medium storing computer instructions, wherein the computer instructions, when executed by a computer system, cause the computer system to perform a method comprising:
receiving a plurality of masks, each mask comprising a string of one or more characters;
accessing a list of URLs;
for each URL in the list of URLs:
identifying any portions of the URL that match the one or more characters in the plurality of masks, and
removing from the URL the identified portions to create a resultant URL; and
collapsing all identical resultant URLs into one URL.
18. The computer-readable medium of claim 17 , wherein the computer-readable medium further stores instruction for:
prior to comparing each URL and collapsing all identical resultant URLs into one URL, sorting the plurality of URLs into one or more bins, wherein each URL comprises at least one field and each bin comprises at least one URL, each URL in a bin having common contents for at least one field.
19. The computer-readable medium of claim 17 , wherein one or more of the URLs are associated with media and one or more of the plurality of masks indicates at least one of a bit rate of the media and a format of the media.
20. The computer-readable medium of claim 17 , wherein one or more of the URLs are associated with media and include content indicating at least one of an artist of the media, a title of the media, a host of the media, a bit rate of the media, a sampling rate of the media, a linking URL associated with the media, a copyright of the media, and a duration of the media.