Method and device for creating an index
Embodiments of the present disclosure generally relate to a method and device for creating an index. For example, the embodiments of the present disclosure propose a method for creating an index, comprising: dividing a document into a plurality of regions; determining the number of times that a token appears in the plurality of regions, the token including at least one character in the document; assigning respective weights to the plurality of regions; and creating an inverted document linked list directed to the token based on the number of times that the token appears in the plurality of regions and respective weights of the plurality of regions. In addition, the embodiments of the present disclosure propose a corresponding device and computer program product for creating an index.
1. A method for creating an index, comprising:
dividing a document into a plurality of regions, wherein the plurality of regions includes a title region and a text region;
determining the number of times that a token appears in the plurality of regions, the token including at least one character in the document;
assigning respective weights to the plurality of regions based on relevance of the plurality of regions to the document, wherein assigning the respective weights to the plurality of regions based on relevance of the plurality of regions includes assigning a higher weight to the title region than to the text region; and
creating an inverted document linked list directed to the token based on the number of times that the token appears in the plurality of regions and the respective weights of the plurality of regions.
2. The method according to claim 1 , wherein dividing a document into a plurality of regions comprises:
dividing, based on a structure of the document, the document into a plurality of regions selected from a group consisting of a title, an abstract, one or more keywords, a text, and/or one or more references.
3. The method according to claim 1 , wherein creating an inverted document linked list directed to the token comprises:
creating a token position list for the token, the token position list including at least one position where the token appears in the document and at least one of the weights corresponding thereto; and
creating the inverted document linked list directed to the token by accumulating the at least one weight.
4. The method according to claim 3 , wherein the at least one weight is stored into a payload field of the token position list.
5. The method according to claim 1 , wherein creating an inverted document linked list directed to the token comprises:
creating a token position list for the plurality of regions, the token position list including at least one position where the token appears in the plurality of regions; and
creating the inverted document linked list directed to the token by accumulating respective products of the number of times that the token appears in the plurality of regions and the respective weights of the plurality of regions.
6. The method according to claim 1 , further comprising:
modifying at least one of the respective weights assigned to the plurality of regions.
7. A device for creating an index, comprising:
at least one processing unit; and
at least one memory, being coupled to the at least one processing unit and storing machine-executable instructions which, when being executed by the at least processing unit, cause the device to perform acts of:
dividing a document into a plurality of regions, wherein the plurality of regions includes a title region and a text region;
determining the number of times that a token appears in the plurality of regions, the token including at least one character in the document;
assigning respective weights to the plurality of regions based on relevance of the plurality of regions to the document, wherein assigning the respective weights to the plurality of regions based on relevance of the plurality of regions includes assigning a higher weight to the title region than to the text region; and
creating an inverted document linked list directed to the token based on the number of times that the token appears in the plurality of regions and the respective weights of the plurality of regions.
8. The device according to claim 7 , wherein dividing a document into a plurality of regions comprises:
dividing, based on a structure of the document, the document into a plurality of regions selected from a group consisting of a title, an abstract, one or more keywords, a text, and/or one or more references.
9. The device according to claim 7 , wherein creating an inverted document linked list directed to the token comprises:
creating a token position list for the token, the token position list including at least one position where the token appears in the document and at least one of the weights corresponding thereto; and
creating the inverted document linked list directed to the token by accumulating the at least one weight.
10. The device according to claim 9 , wherein the at least one weight is stored into a payload field of the token position list.
11. The device according to claim 7 , wherein creating an inverted document linked list directed to the token comprises:
creating a token position list for the plurality of regions, the token position list including at least one position where the token appears in the plurality of regions; and
creating the inverted document linked list directed to the token by accumulating respective products of the number of times that the token appears in the plurality of regions and the respective weights of the plurality of regions.
12. The device according to claim 7 , wherein the instructions, when being executed by the at least one processing unit, causes the device to:
modifying at least one of the respective weights assigned to the plurality of regions.
13. A computer program product for creating an index, the computer program product comprising:
a non-transitory computer readable medium encoded with computer-executable code, the code configured to enable the execution of:
dividing a document into a plurality of regions, wherein the plurality of regions includes a title region and a text region;
determining the number of times that a token appears in the plurality of regions, the token including at least one character in the document;
assigning respective weights to the plurality of regions based on relevance of the plurality of regions to the document, wherein assigning the respective weights to the plurality of regions based on relevance of the plurality of regions includes assigning a higher weight to the title region than to the text region; and
creating an inverted document linked list directed to the token based on the number of times that the token appears in the plurality of regions and the respective weights of the plurality of regions.
14. The computer program product of claim 13 , wherein dividing a document into a plurality of regions comprises:
dividing, based on a structure of the document, the document into a plurality of regions selected from a group consisting of a title, an abstract, one or more keywords, a text, and/or one or more references.
15. The computer program product of claim 13 , wherein creating an inverted document linked list directed to the token comprises:
creating a token position list for the token, the token position list including at least one position where the token appears in the document and at least one of the weights corresponding thereto; and
creating the inverted document linked list directed to the token by accumulating the at least one weight.
16. The computer program product of claim 15 , wherein the at least one weight is stored into a payload field of the token position list.
17. The computer program product of claim 13 , wherein creating an inverted document linked list directed to the token comprises:
creating a token position list for the plurality of regions, the token position list including at least one position where the token appears in the plurality of regions; and
creating the inverted document linked list directed to the token by accumulating respective products of the number of times that the token appears in the plurality of regions and the respective weights of the plurality of regions.