Automated identification of record header tags
Methods, devices and apparatuses pertaining to identifying record header tags are described. A method may involve parsing a URL document to identify multiple candidate record header tags and determining scores of an individual candidate record header tag of the multiple candidate record header tags based on record header tag criteria. The method may also involve cumulating the scores to obtain a total score for the individual candidate record header tag. The method may further involve selecting a candidate record header tag of the multiple candidate record header tags as a record header tag for the URL document based on the total score of the individual candidate record header tag.
1. A method comprising:
receiving, by one or more processors of a computing system, a list of Uniform Resource Locators (URLs) with each individual URL in the list corresponding to a respective URL document of a plurality of URL documents;
parsing, by the one or more processors, a first URL document to identify a plurality of candidate record header tags;
determining, by the one or more processors, one or more scores for each individual candidate record header tag of the plurality of candidate record header tags based on one or more record header tag criteria;
cumulating, by the one or more processors, the one or more scores associated with each individual candidate record header tag to obtain a total score for each individual candidate record header tag; and
selecting, by the one or more processors, a candidate record header tag of the plurality of candidate record header tags as a record header tag for the first URL document based on the total scores of the candidate record header tags
wherein the selecting of the candidate record header tag of the plurality of candidate record header tags as the record header tag for the first URL document based on the total scores of the candidate record header tags comprises:
selecting a candidate record header tag of which the total score is higher than the total scores of other candidate record header tags of the plurality of candidate record header tags;
determining whether the selected candidate record header tag delineates the first URL document.
2. One or more computer-readable media storing computer-executable instructions that, when executed on one or more processors, causes the one or more processors to perform operations comprising:
parsing a Uniform Resource Locators (URL) document to identify a plurality of candidate record header tags;
determining one or more scores for each individual candidate record header tag of the plurality of candidate record header tags based on one or more record header tag criteria;
cumulating the one or more scores associated with each individual candidate record header tag to obtain a total score for each individual candidate record header tag; and
selecting a candidate record header tag of the plurality of candidate record header tags as a record header tag for the URL document based on the total scores of the candidate record header tags
wherein the selecting of the candidate record header tag of the plurality of candidate record header tags as the record header tag for the URL document based on the total scores of the candidate record header tags comprises:
selecting a candidate record header tag of which the total score is higher than the total scores of other candidate record header tags of the plurality of candidate record header tags;
determining whether the selected candidate record header tag delineates the URL document;
in response to a determination that the selected candidate record header tag delineates the URL document, designating the selected candidate record header tag as the record header tag for the URL document; and
in response to a determination that the selected candidate record header tag does not delineate the URL document, selecting another candidate record header tag as the record header tag for the URL document based on the total score of the another candidate record header tag.