Apparatus and method for estimating utterance style of each sentence in documents, and non-transitory computer readable medium thereof
View Patent ↗According to one embodiment, an apparatus for supporting reading of a document includes a model storage unit, a document acquisition unit, a feature information extraction, and an utterance style estimation unit. The model storage unit is configured to store a model which has trained a correspondence relationship between first feature information and an utterance style. The first feature information is extracted from a plurality of sentences in a training document. The document acquisition unit is configured to acquire a document to be read. The feature information extraction unit is configured to extract second feature information from each sentence in the document to be read. The utterance style estimation unit is configured to compare the second feature information of a plurality of sentences in the document to be read with the model, and to estimate an utterance style of the each sentence of the document to be read.
1. An apparatus for supporting reading of a document, comprising:
a memory that stores computer executable units;
processing circuitry that executes the computer executable units stored in the memory;
a model storage unit, executed by the processing circuitry, that stores a model which has been trained with a correspondence relationship between a first feature vector and an utterance style, the first feature vector being extracted from a plurality of sentences adjacent in a training document;
a document acquisition unit, executed by the processing circuitry, that acquires a document to be read;
a feature information extraction unit, executed by the processing circuitry, that extracts a feature information including a part of speech, a sentence type and a grammatical information from each sentence in the document to be read, and to convert the feature information to a second feature vector of each sentence; and
an utterance style estimation unit, executed by the processing circuitry, that generates a connected feature vector of an estimation target sentence in the document to be read by connecting the second feature vector of the estimation target sentence with (i) a respective second feature of one sentence adjacent to and before the estimation target sentence and (ii) a respective second feature of one sentence adjacent to and after the estimation target sentence in the document to be read, to compare the connected feature vector with the first feature vector of the model, and to estimate an utterance style of the estimation target sentence based on the comparison.
2. The apparatus according to claim 1 , wherein
the utterance style estimation unit generates the connected feature vector of the estimation target sentence by connecting the second feature vector of the estimation target sentence with respective second feature vectors of (i) at least two sentences adjacent to and before the estimation target sentence and (ii) at least two sentences adjacent to and after the estimation target sentence in the document to be read.
3. The apparatus according to claim 1 , wherein
the utterance style estimation unit generates the connected feature vector of the estimation target sentence by connecting the second feature vector of the estimation target sentence with respective second feature vectors of (iii) other sentences appeared in a paragraph including the estimation target sentence in the document to be read or respective second feature vectors of other sentences appeared in a chapter including the estimation target sentence in the document to be read.
4. The apparatus according to claim 1 , wherein
the second feature vector includes a format information extracted from the document to be read.
5. The apparatus according to claim 1 , wherein
the utterance style is at least one of a sex distinction, an age, a spoken language and a feeling, or a combination thereof.
6. The apparatus according to claim 1 , further comprising:
a synthesis parameter selection unit configured to select a speech synthesis parameter matched with the utterance style of the each sentence.
7. The apparatus according to claim 6 , wherein
the speech synthesis parameter is at least one of a speech character, a volume, a speed and a pitch, or a combination thereof.
8. A method for supporting reading of a document, comprising:
storing a model, in a memory, which has been trained with a correspondence relationship between a first feature vector and an utterance style, the first feature vector being extracted from a plurality of sentences adjacent in a training document;
acquiring a document to be read;
extracting a feature information including a part of speech, a sentence type and a grammatical information from each sentence in the document to be read;
converting the feature information to a second feature vector of each sentence;
generating a connected feature vector of an estimation target sentence in the document to be read by connecting the second feature vector of the estimation target sentence with respective second feature vectors of (i) one sentence adjacent to and before the estimation target sentence and (ii) one sentence adjacent to and after the estimation target sentence in the document to be read;
comparing the connected feature vector with the first feature vector of the model using processing circuitry; and
estimating an utterance style of the estimation target sentence based on the comparison.
9. A non-transitory computer readable medium for causing a computer to perform a method for supporting reading of a document, the method comprising:
storing a model, in a memory, which has been trained with a correspondence relationship between a first feature vector and an utterance style, the first feature vector being extracted from a plurality of sentences adjacent in a training document;
acquiring a document to be read;
extracting a feature information including a part of speech, a sentence type and a grammatical information from each sentence in the document to be read;
converting the feature information to a second feature vector of each sentence;
generating a connected feature vector of an estimation target sentence in the document to be read by connecting the second feature vector of the estimation target sentence with respective second feature vectors of (i) one sentence adjacent to and before the estimation target sentence and (ii) one sentence adjacent to and after the estimation target sentence in the document to be read;
comparing the connected feature vector with the first feature vector of the model using processing circuitry; and
estimating an utterance style of the estimation target sentence based on the comparison.
10. The apparatus according to claim 1 , wherein
the utterance style is manually assigned to the estimation target sentence,
a pair of the connected feature vector and the utterance style is training data, and
the model is generated by training the correspondence relationship between the connected feature vector and the utterance style in the training data.