IP Library › Granted Patent US 11,289,067
Granted Patent B2
US 11,289,067 · App. 16/452,502 · Granted Mar 29, 2022

Voice generation based on characteristics of an avatar

Inventors: Kristina Marie Brimijoin (Hastings on Hudson, NY); Gregory Boland (Katonah, NY); Joseph Schwarz (New York, NY)
Assignee: International Business Machines Corporation
G10L13/033
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,289,067
App. No.
16/452,502
Granted
Mar 29, 2022
Kind
B2
Abstract

Methods and systems for generating voices based on characteristics of an avatar. One or more characteristics of an avatar are obtained and one or more parameters of a voice synthesizer for generating a voice corresponding to the one or more avatar characteristics are determined. The voice synthesizer is configured based on the one or more parameters and a voice is generated using the parameterized voice synthesizer.

Claims (43)

1. A method comprising:

obtaining one or more characteristics of a given avatar;

determining one or more parameters of a voice synthesizer for generating a voice that conforms to the one or more avatar characteristics;

configuring the voice synthesizer based on the one or more parameters; and

generating a voice using the parameterized voice synthesizer;

wherein:

the obtaining of one or more characteristics of the given avatar comprises obtaining at least one of shoulder width of said given avatar and chest circumference of said given avatar; and

in the determining of the one or more parameters of the voice synthesizer for generating the voice that conforms to the one or more avatar characteristics, the parameters cause the voice to conform to the at least one of shoulder width of said given avatar and chest circumference of said given avatar.

2. The method of claim 1 , further comprising determining one or more vocal characteristics corresponding to the one or more avatar characteristics.

3. The method of claim 2 , wherein the determining the one or more parameters of the voice synthesizer is based on the one or more vocal characteristics.

4. The method of claim 1 , further comprising obtaining an avatar, modifying characteristics of the avatar, and repeating the determining, configuring, and generating operations using the modified characteristics and a corresponding modified avatar.

5. The method of claim 1 , wherein the one or more avatar characteristics comprise at least one dynamic characteristic, and wherein at least one of the dynamic characteristics is a mannerism of the given avatar.

6. The method of claim 1 , wherein the one or more avatar of comprise at least one dynamic characteristic, and wherein at least one of the dynamic characteristics is a rate of speech of the given avatar.

7. The method of claim 1 , wherein the one or more avatar characteristics comprise at least one dynamic characteristic, and wherein at least one of the dynamic characteristics is a facial expression of the given avatar while speaking.

8. A non-transitory computer readable medium comprising computer executable instructions which when executed by a computer cause the computer to perform a method comprising operations of:

obtaining one or more characteristics of a given avatar;

determining one or more parameters of a voice synthesizer for generating a voice that conforms to the one or more avatar characteristics;

configuring the voice synthesizer based on the one or more parameters; and

generating a voice using the parameterized voice synthesizer;

wherein:

the obtaining of one or more characteristics of the given avatar comprises obtaining at least one of shoulder width of said given avatar and chest circumference of said given avatar; and

in the determining of the one or more parameters of the voice synthesizer for generating the voice that conforms to the one or more avatar characteristics, the parameters cause the voice to conform to the at least one of shoulder width of said given avatar and chest circumference of said given avatar.

9. The non-transitory computer readable medium of claim 8 , the operations further comprising determining one or more vocal characteristics corresponding to the one or more avatar characteristics.

10. The non-transitory computer readable medium of claim 9 , wherein the determining the one or more parameters of the voice synthesizer is based on the one or more vocal characteristics.

11. The non-transitory computer readable medium of claim 8 , the operations further comprising obtaining an avatar, modifying characteristics of the avatar, and repeating the determining, configuring, and generating operations using the modified characteristics and a corresponding modified avatar.

12. An apparatus comprising:

a memory; and

at least one processor, coupled to said memory, and operative to perform operations comprising:

obtaining one or more characteristics of a given avatar;

determining one or more parameters of a voice synthesizer for generating a voice that conforms to the one or more avatar characteristics;

configuring the voice synthesizer based on the one or more parameters; and

generating a voice using the parameterized voice synthesizer;

wherein:

the obtaining of one or more characteristics of the given avatar comprises obtaining at least one of shoulder width of said given avatar and chest circumference of said given avatar; and

in the determining of the one or more parameters of the voice synthesizer for generating the voice that conforms to the one or more avatar characteristics, the parameters cause the voice to conform to the at least one of shoulder width of said given avatar and chest circumference of said given avatar.

13. The apparatus of claim 12 , the operations further comprising determining one or more vocal characteristics corresponding to the one or more avatar characteristics.

14. The apparatus of claim 13 , wherein the determining the one or more parameters of the voice synthesizer is based on the one or more vocal characteristics.

15. The apparatus of claim 12 , wherein the one or more parameters of the voice synthesizer are determined by performing a table lookup.

16. The apparatus of claim 12 , the operations further comprising obtaining an avatar, modifying characteristics of the avatar, and repeating the determining, configuring, and generating operations using the modified characteristics and a corresponding modified avatar.

17. The apparatus of claim 12 , the operations further comprising applying one or more additional effects for the generated voice.

18. The apparatus of claim 12 , wherein the one or more avatar characteristics comprise at least one dynamic characteristic, and wherein at least one of the dynamic characteristics is a mannerism of the given avatar.

19. The apparatus of claim 12 , wherein the one or more avatar characteristics comprise at least one dynamic characteristic, and wherein at least one of the dynamic characteristics is a rate of speech of the given avatar.

20. The apparatus of claim 12 , wherein the one or more avatar characteristics comprise at least one dynamic characteristic, and wherein at least one of the dynamic characteristics is a facial expression of the given avatar while speaking.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2019
From: BRIMIJOIN, KRISTINA MARIE; BOLAND, GREGORY; SCHWARZ, JOSEPH
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 049585/0157 →
Continuity (1)
Related Publication 20200410977A1 · Dec 31, 2020
Cited By (1)
US 12,536,739