Readout of Communication Content Comprising Non-Latin or Non-Parsable Content Items for Assistant Systems
In one embodiment, a method includes accessing a communication content including zero or more Latin script text strings and one or more non-Latin script content items, determining a readout of the communication content based on parsing rules, wherein the parsing rules specify formats for the readout based on attributes of the non-Latin script content items, and wherein the readout includes the zero or more Latin script text strings and a description of the non-Latin script content items, and sending instructions for presenting an audio rendering of the readout of the communication content to a client system.
1 . A method comprising, by one or more computing systems:
accessing a communication content comprising zero or more Latin script text strings and one or more non-Latin script content items;
determining a readout of the communication content based on one or more parsing rules, wherein the one or more parsing rules specify one or more formats for the readout based on one or more attributes of the non-Latin script content items, and wherein the readout comprises the zero or more Latin script text strings and a description of the one or more non-Latin script content items; and
sending, to a client system, instructions for presenting an audio rendering of the readout of the communication content.
2 . The method of claim 1 , further comprising:
receiving the communication content from a sender, wherein the communication content is directed to one or more recipients, and wherein the client system is associated with one of the one or more recipients.
3 . The method of claim 2 , wherein the sender is associated with a non-English-language Latin name, wherein the readout further comprises a pronunciation of the non-English-language Latin name associated with the sender, and wherein the pronunciation is based on one or more of English language or the non-English language associated with the non-English-language Latin name.
4 . The method of claim 2 , wherein the sender is associated with a non-Latin-script language name, and wherein the readout further comprises a summary of the non-Latin-script language name associated with the sender.
5 . The method of claim 1 , wherein the one or more non-Latin script content items comprise one or more of a non-Latin-script language text string, an emoji, a symbol, an image, a video, a graphics interchange format (GIF), a sticker, a voice clip, an audio clip, a link, a mention of a named entity, an environment-specific reaction, an electronic payment, a contact, a location, a document, a post, a hashtag, an acronym, an abbreviation, or a symbol-based emoji.
6 . The method of claim 1 , wherein the one or more formats comprise:
individually reading out one or more of the one or more non-Latin script content items;
summarizing one or more of the one or more non-Latin script content items;
individually reading out a first subset of the one or more non-Latin script content items when a total number of the one or more non-Latin script content items exceeds a threshold number; or
summarizing a second subset of the one or more non-Latin script content items when the total number of the one or more non-Latin script content items exceeds the threshold number.
7 . The method of claim 1 , wherein the client system comprises one or more rendering devices and one or more companion devices, and wherein the one or more formats comprise rendering the readout at one or more destination devices selected from the rendering devices and the companion devices.
8 . The method of claim 1 , wherein the description of the one or more non-Latin script content items comprises one or more of an individual readout for each of one or more of the non-Latin script content items or a summary for one or more of the non-Latin script content items.
9 . The method of claim 1 , wherein the one or more attributes comprise one or more of a threshold requirement for the one or more non-Latin script content items or a description difficulty associated with each of the one or more non-Latin script content items.
10 . The method of claim 1 , wherein the one or more attributes comprise a threshold requirement for the one or more non-Latin script content items, and wherein the one or more formats comprise one or more of:
individually reading out one or more first non-Latin script content items of the one or more non-Latin script content items, wherein each first non-Latin script content item is associate with a respective first index satisfying the threshold requirement; or
summarizing one or more second non-Latin script content items of the one or more non-Latin script content items, wherein each second non-Latin script content item is associate with a respective second index not satisfying the threshold requirement.
11 . The method of claim 1 , wherein the one or more attributes comprise a description difficulty associated with each of the one or more non-Latin script content items, and wherein the one or more formats comprise one or more of:
individually reading out one or more first non-Latin script content items of the one or more non-Latin script content items, wherein each first non-Latin script content item is associate with a respective description difficulty satisfying a difficulty requirement; or
summarizing one or more second non-Latin script content items of the one or more non-Latin script content items, wherein each second non-Latin script content item is associate with a respective description difficulty not satisfying the difficulty requirement.
12 . The method of claim 1 , wherein the one or more attributes comprise a threshold requirement for the one or more non-Latin script content items and a description difficulty associated with each of the one or more non-Latin script content items, and wherein the one or more formats comprise one or more of:
individually reading out one or more first non-Latin script content items of the one or more non-Latin script content items, wherein each first non-Latin script content item is associate with a respective first index satisfying the threshold requirement and a respective description difficulty satisfying a difficulty requirement; or
summarizing one or more second non-Latin script content items of the one or more non-Latin script content items, wherein each second non-Latin script content item is associate with a respective second index not satisfying the threshold requirement or a respective description difficulty not satisfying the difficulty requirement.
13 . The method of claim 1 , wherein the one or more non-Latin script content items comprise one or more non-English-language Latin script text strings, wherein the description of the one or more non-English-language Latin script text strings comprises an individual readout for each of one or more of the non-English-language Latin script content items, wherein the individual readout is based on one or more of English language or the non-English language associated with the non-English-language Latin script text strings.
14 . The method of claim 1 , wherein the one or more non-Latin script content items comprise one or more non-Latin script text strings, and wherein the one or more attributes comprise a percentage of the non-Latin script text strings over a total script text strings in the communication content.
15 . The method of claim 14 , wherein the percentage is smaller than a threshold percentage, and wherein the readout comprises the zero or more Latin script text strings and a summary of the one or more non-Latin script text strings.
16 . The method of claim 14 , wherein the percentage is not smaller than a threshold percentage, and wherein the readout comprises zero Latin script text strings and a summary of the communication content.
17 . The method of claim 1 , wherein the one or more non-Latin script content items comprise one or more of an emoji or a symbol, wherein the description of the one or more emojis or symbols comprise individual readouts for one or more of the emojis or symbols, wherein the individual readouts are based on Unicode descriptions associated with the corresponding emojis or symbols.
18 . The method of claim 1 , wherein the one or more non-Latin script content items comprise one or more contacts, and wherein the description of the one or more contacts comprise individual readouts of corresponding contact names for one or more of the contacts.
19 . One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
access a communication content comprising zero or more Latin script text strings and one or more non-Latin script content items;
determine a readout of the communication content based on one or more parsing rules, wherein the one or more parsing rules specify one or more formats for the readout based on one or more attributes of the non-Latin script content items, and wherein the readout comprises the zero or more Latin script text strings and a description of the one or more non-Latin script content items; and
send, to a client system, instructions for presenting an audio rendering of the readout of the communication content.
20 . A system comprising: one or more processors; and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
access a communication content comprising zero or more Latin script text strings and one or more non-Latin script content items;
determine a readout of the communication content based on one or more parsing rules, wherein the one or more parsing rules specify one or more formats for the readout based on one or more attributes of the non-Latin script content items, and wherein the readout comprises the zero or more Latin script text strings and a description of the one or more non-Latin script content items; and
send, to a client system, instructions for presenting an audio rendering of the readout of the communication content.