Adaptive text-to-speech outputs based on language proficiency
In some implementations, a language proficiency of a user of a client device is determined by one or more computers. The one or more computers then determines a text segment for output by a text-to-speech module based on the determined language proficiency of the user. After determining the text segment for output, the one or more computers generates audio data including a synthesized utterance of the text segment. The audio data including the synthesized utterance of the text segment is then provided to the client device for output.
1. A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:
obtaining previous text queries submitted by a user of a client device;
determining a language proficiency for the user based on the previous text queries;
receiving a query input to the client device by the user;
generating a particular text segment responsive to the query and based on the language proficiency determined for the user, the particular text segment comprising one of:
a first text segment when the language proficiency determined for the user comprises a first level of language proficiency, the first text segment comprising a respective independent clause conveying primary information responsive to the query; or
a second text segment when the language proficiency determined for the user comprises a second level of language proficiency, the second text segment comprising a respective independent clause and one or more subordinate clauses, the one or more subordinate clauses of the second text segment conveying additional information responsive to the query that is not included in the first text segment;
generating audio data comprising a synthesized utterance of the particular text segment responsive to the query; and
providing the audio data for audible output from the client device.
2. The computer-implemented method of claim 1 , wherein the respective independent clause of the second text segment conveys the same primary information responsive to the query as the first text segment.
3. The computer-implemented method of claim 1 , wherein the respective independent clause of the second text segment includes at least one different term than the respective independent clause of the first text segment.
4. The computer-implemented method of claim 1 , wherein the operations further comprise, prior to generating the particular text segment:
identifying multiple candidate text segments that are responsive to the query, each candidate text segment associated with a different level of language complexity; and
selecting, from among the multiple candidate text segments, the particular text segment responsive to the query based on the language proficiency determined for the user.
5. The computer-implemented method of claim 4 , wherein selecting from among the multiple candidate text segments comprises:
determining a language complexity score for each of the multiple candidate text segments; and
selecting the text segment associated with the language complexity score that best matches a reference score that describes the language proficiency determined for the user as the particular text segment.
6. The computer-implemented method of claim 1 , wherein the operations further comprise, prior to generating the particular text segment:
obtaining a baseline text segment responsive to the query; and
generating the particular text segment by increasing a complexity level of the baseline text segment based on the language proficiency designated to the user.
7. The computer-implemented method of claim 1 , wherein the operations further comprise, prior to generating the particular text segment:
obtaining a baseline text segment responsive to the query; and
generating the particular text segment by decreasing a complexity level of the baseline text segment based on the language proficiency designated to the user.
8. The computer-implemented method of claim 1 , wherein:
the second level of language proficiency comprises a higher level of language proficiency than the first level of language proficiency; and
the second text segment is associated with a grammatical structure that is more complex than a grammatical structure associated with the first text segment.
9. A system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware and storing instructions, that when executed by the data processing hardware, cause the data processing hardware to perform operations comprising:
obtaining previous text queries submitted by a user of a client device;
determining a language proficiency for the user based on the previous text queries;
receiving a query input to the client device by the user;
generating a particular text segment responsive to the query and based on the language proficiency determined for the user, the particular text segment comprising one of:
a first text segment when the language proficiency determined for the user comprises a first level of language proficiency, the first text segment comprising a respective independent clause conveying primary information responsive to the query; or
a second text segment when the language proficiency determined for the user comprises a second level of language proficiency, the second text segment comprising a respective independent clause and one or more subordinate clauses, the one or more subordinate clauses of the second text segment conveying additional information responsive to the query that is not included in the first text segment;
generating audio data comprising a synthesized utterance of the particular text segment responsive to the query; and
providing the audio data for audible output from the client device.
10. The system of claim 9 , wherein the respective independent clause of the second text segment conveys the same primary information responsive to the query as the first text segment.
11. The system of claim 9 , wherein the respective independent clause of the second text segment includes at least one different term than the respective independent clause of the first text segment.
12. The system of claim 9 , wherein the operations further comprise, prior to generating the particular text segment:
identifying multiple candidate text segments that are responsive to the query, each candidate text segment associated with a different level of language complexity; and
selecting, from among the multiple candidate text segments, the particular text segment responsive to the query based on the language proficiency determined for the user.
13. The system of claim 12 , wherein selecting from among the multiple candidate text segments comprises:
determining a language complexity score for each of the multiple candidate text segments; and
selecting the text segment associated with the language complexity score that best matches a reference score that describes the language proficiency determined for the user as the particular text segment.
14. The system of claim 9 , wherein the operations further comprise, prior to generating the particular text segment:
obtaining a baseline text segment responsive to the query; and
generating the particular text segment by increasing a complexity level of the baseline text segment based on the language proficiency designated to the user.
15. The system of claim 9 , wherein the operations further comprise, prior to generating the particular text segment:
obtaining a baseline text segment responsive to the query; and
generating the particular text segment by decreasing a complexity level of the baseline text segment based on the language proficiency designated to the user.
16. The system of claim 9 , wherein:
the second level of language proficiency comprises a higher level of language proficiency than the first level of language proficiency; and
the second text segment is associated with a grammatical structure that is more complex than a grammatical structure associated with the first text segment.