Visual display methods for in computer-animated speech production models
View Patent ↗A method of modeling speech distinctions within computer-animated talking heads that utilize the manipulation of speech production articulators for selected speech segments. Graphical representations of voice characteristics and speech production characteristics are generated in response to said speech segment. By way of example, breath images are generated such as particle-cloud images, and particle-stream images to represent the voiced characteristics such as the presence of stops and fricatives, respectively. The coloring on exterior portions of the talking head is displayed in response to selected voice characteristics such as nasality. The external physiology of the talking head is modulated, such as by changing the width and movement of the nose, the position of the eyebrows, and movement of the throat in response to the voiced speech characteristics such as pitch, nasality, and voicebox vibration, respectively. The invention also describes modeling a talking head on the facial image of a particular individual.
1. A method of modeling speech distinctions for a computer-animated talking head which models speech production articulators for a given segment of speech, said talking head having a face portion, comprising:
displaying a graphical representation of a selected voice characteristic of said speech segment at a position proximal to the face portion of said talking head; and
displaying a particle-cloud image proximal to the face portion of said talking head in response to a change in a selected voice characteristic within said speech segment.
2. A method as recited in claim 1 , wherein said particle-cloud image is displayed by distributing a plurality of displayed particles within a generally circular, oval, or lenticular region.
3. A method as recited in claim 2 , wherein said displayed particles comprise small regions which are displayed in a contrasting color or shade which allow them to be visually distinguished from background color.
4. A method as recited in claim 1 , wherein said selected voice characteristic comprises plosion, or the presence of stop consonants, within said speech.
5. A method of modeling speech distinctions for a computer-animated talking head which models speech production articulators for a given segment of speech, said talking head having a face portion, comprising:
displaying a graphical representation of a selected voice characteristic of said speech segment at a position proximal to the face portion of said talking head; and
displaying a particle-stream graphic image proximal to the face portion of said talking head in response to a change in a selected voice characteristic of said speech segment.
6. A method as recited in claim 5 , wherein said particle-stream graphic image is displayed as being angularly dispersed from the mouth portion of said talking head.
7. A method as recited in claim 6 , further comprising:
modulating, in response to changes in a selected voice characteristic of said speech segment, angular dispersion of said particle-stream graphic image;
wherein said particle-stream graphic image appears to emanate from the mouth of said talking head.
8. A method as recited in claim 5 , further comprising:
displaying said particle-stream graphic image as a plurality of small regions in a contrasting color or shade which allows them to be visually distinguished from the background surrounding said talking head.
9. A method as recited in claim 8 , further comprising:
varying the level of contrast between the particles within said particle-stream graphic image in response to a change in a selected voice characteristic of said speech segment.
10. A method as recited in claim 9 , wherein said selected voice characteristic comprises the intensity of fricative energy present in said speech segment.
11. A method as recited in claim 5 , further comprising:
displaying said particle-stream graphic image with the appearance of outward movement from the mouth portion of said talking head.
12. A method as recited in claim 5 , wherein said selected voice characteristic comprises the presence of fricatives in said speech segment.
13. A method as recited in claim 5 , further comprising:
displaying said particle-stream graphic image with vertical striations in response to a change in a selected voice characteristic of said speech segment.
14. A method as recited in claim 13 , wherein said selected voice characteristic of said speech segment comprises vocal cord vibration.
15. A method of modeling speech distinctions for a computer-animated talking head which models speech production articulators for a given segment of speech, said talking head having a face portion, comprising:
displaying a graphical representation of a selected voice characteristic of said speech segment at a position proximal to the face portion of said talking head;
wherein said talking head has a nose portion; and
displaying concentric outline images proximal to the nose of portion of said talking head in response to a change in a selected voice characteristic of said speech segment.
16. A method as recited in claim 15 , wherein said voice characteristic comprises nasality.
17. A method as recited in claim 15 , wherein said concentric outline images comprise concentric substantially triangular images.