Analysis method, analyzer, and computer-readable recording medium
A non-transitory computer-readable recording medium stores therein an analysis program that causes a computer to execute a process including: generating an index based on a dictionary for use in morphological analysis, the index relating to morphemes registered in the dictionary, the index including flags by which a beginning and an end of each morpheme registered in the dictionary are determinable; and extracting a plurality of dividable words from input character data by using the index.
1. A non-transitory computer-readable recording medium storing therein an analysis program that causes a computer to execute a process comprising:
generating an index based on a dictionary for use in morphological analysis, the index relating to morphemes registered in the dictionary, the index including flags by which a beginning and an end of each morpheme registered in the dictionary are determinable; and
extracting a plurality of dividable words from input character data by using the index, wherein
generating the index includes comparing the character data with the morphemes registered in the dictionary and generating array data in which morphemes included in the character data are arrayed with unit separators, each of the unit separators indicating a boundary between the morphemes.
2. The non-transitory computer-readable recording medium according to claim 1 , wherein generating the index includes generating a bitmap including a flag indicating an offset of a character in the array data, so as to generate the index for each character.
3. The non-transitory computer-readable recording medium according to claim 2 , further including setting, in the index, a bitmap corresponding to the beginning, the bitmap including a flag indicating an offset of a beginning character of the characters in the array data and a bitmap corresponding to the end, the bitmap including a flag indicating an offset of an end character of the characters in the array data.
4. The non-transitory computer-readable recording medium according to claim 3 , wherein the extracting includes: performing a logical AND operation between a bitmap corresponding to a combination of characters included in the character data and the bitmaps corresponding to the beginning and the end to determine a beginning position and an end position of a dividable word; and extracting a plurality of dividable words based on a result of the determination.
5. An analysis method comprising:
generating an index based on a dictionary for use in morphological analysis, the index relating to morphemes registered in the dictionary, the index including flags by which a beginning and an end of each morpheme registered in the dictionary are determinable, by a processor; and
extracting a plurality of dividable words from input character data by using the index, wherein
generating the index includes comparing the character data with the morphemes registered in the dictionary and generating array data in which morphemes included in the character data are arrayed with unit separators, each of the unit separators indicating a boundary between the morphemes.
6. The analysis method according to claim 5 , wherein the generating the index includes generating a bitmap including a flag indicating an offset of a character in the array data, so as to generate the bitmap for each character.
7. The analysis method according to claim 6 , further including setting, in the index, a bitmap corresponding to the beginning, the bitmap including a flag indicating an offset of a beginning character in the characters in the array data and a bitmap corresponding to the end, the bitmap including a flag indicating an offset of an end character in the characters in the array data.
8. The analysis method according to claim 7 , wherein the extracting includes: performing a logical AND operation between a bitmap corresponding to a combination of characters included in the character data and the bitmaps corresponding to the beginning and the end to determine a beginning position and an end position of a dividable word; and extracting a plurality of dividable words based on a result of the determination.
9. An analyzer comprising:
a memory; and
a processor coupled to the memory and configured to:
generate an index based on a dictionary for use in morphological analysis, the index relating to morphemes registered in the dictionary, the index including flags by which a beginning and an end of each morpheme registered in the dictionary are determinable, and
extract a plurality of dividable words from input character data by using the index, wherein
the processor is further configured to generate the index by comparing the character data with the morphemes registered in the dictionary and by generating array data in which morphemes included in the character data are arrayed with unit separators, each of the unit separators indicating a boundary between the morphemes.
10. The analyzer according to claim 9 , wherein the processor is further configured to generate a bitmap including a flag indicating an offset of a character in the array data, so as to generate the bitmap for each character.
11. The analyzer according to claim 10 , wherein the processor is further configured to set, in the index, a bitmap corresponding to the beginning, the bitmap including a flag indicating an offset of a beginning character of the characters in the array data and a bitmap corresponding to the end, the bitmap including a flag indicating an offset of an end character of the characters in the array data.
12. The analyzer according to claim 11 , wherein the processor is further configured to:
perform a logical AND operation between a bitmap corresponding to a combination of characters included in the character data and the bitmaps corresponding to the beginning and the end to determine a beginning position and an end position of a dividable word, and
extract a plurality of dividable words based on a result of the determination.