IP Library Granted Patent US 9,613,616
Granted Patent B2
US 9,613,616 · App. 15/168,599 · Granted Apr 4, 2017

Synthesizing an aggregate voice

Inventors: Jose A. G. de Freitas (Eastleigh, GB); Guy P. Hindle (Romsey, GB); James S. Taylor (Southampton, GB)
Assignee: International Business Machines Corporation
G10L13/033G10L13/027G10L13/043G10L13/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,613,616
App. No.
15/168,599
Granted
Apr 4, 2017
Kind
B2
Abstract

A system and computer-implemented method for synthesizing multi-person speech into an aggregate voice is disclosed. The method may include crowd-sourcing a data message configured to include a textual passage. The method may include collecting, from a plurality of speakers, a set of vocal data for the textual passage. Additionally, the method may also include mapping a source voice profile to a subset of the set of vocal data to synthesize the aggregate voice.

Claims (52)

1. A computer implemented method for synthesizing multi-person speech into an aggregate voice, the method comprising:

crowd-sourcing a data message configured to include a textual passage;

collecting, from a plurality of speakers, a set of vocal data for the textual passage, wherein the set of vocal data includes a first set of enunciation data corresponding to a first portion of the textual passage, a second set of enunciation data corresponding to a second portion of the textual passage, and a third set of enunciation data corresponding to both the first and second portions of the textual passage;

mapping a source voice profile to a subset of the set of vocal data to synthesize the aggregate voice; wherein mapping the source voice profile includes:

extracting phonological data from the set of vocal data, wherein the phonological data includes pronunciation tags, intonation tags, and syllable rates;

converting, based on the phonological data including pronunciation tags, intonation tags and syllable rates, the set of vocal data into a set of phoneme strings; and

applying, to the set of phoneme strings, the source voice profile;

assigning, based on evaluating the phonological data from the set of vocal data, a first quality score to the first set of enunciation data; and

transmitting, in response to determining that the first quality score is greater than a first quality threshold, bonus credits to a first speaker of the first set of enunciation data.

2. The method of claim 1 , wherein the source voice profile includes a predetermined set of phonological and prosodic characteristics corresponding to a voice of a first individual.

3. The method of claim 2 , wherein the phonological and prosodic characteristics include rhythm, stress, tone, and intonation.

4. The method of claim 1 , further comprising:

detecting, by an incentive system, a transition phase of an entertainment content sequence;

presenting, during the transition phase of the entertainment content sequence, a speech sample collection module configured to record enunciation data for the textual passage; and

advancing, in response to recording enunciation data for the textual passage, the entertainment content sequence.

5. The method of claim 1 , wherein transmitting bonus credits is in further response to determining the first set of enunciation data has a usage above a usage threshold.

6. The method of claim 1 , wherein collecting a set of vocal data further comprises:

prompting a respective speaker of the plurality of speakers to read the first portion of the textual passage; and

recording the respective speaker reading the first portion of the textual passage.

7. The method of claim 6 , wherein collecting a set of vocal data further comprises:

determining, based on the first set of enunciation data, that the first portion of the textual passage needs to be recorded again; and

indicating to the respective user that the first portion of the textual passage needs to be recorded again.

8. A system for synthesizing multi-person speech into an aggregate voice, the system comprising:

a crowd-sourcing module configured to crowd-source a data message including a textual passage;

a collecting module configured to collect, from a plurality of speakers, a set of vocal data for the textual passage, wherein the set of vocal data includes a first set of enunciation data corresponding to a first portion of the textual passage, a second set of enunciation data corresponding to a second portion of the textual passage, and a third set of enunciation data corresponding to both the first and second portions of the textual passage;

a mapping module configured to map a source voice profile to a subset of the set of vocal data to synthesize the aggregate voice, wherein mapping the source voice profile to a subset of the set of vocal data to synthesize the aggregate voice includes:

an extracting module configured to extract phonological data from the set of vocal data, wherein the phonological data includes pronunciation tags, intonation tags, and syllable rates;

a converting module configured to convert, based on the phonological data including pronunciation tags, intonation tags and syllable rates, the set of vocal data into a set of phoneme strings; and

an applying module configured to apply, to the set of phoneme strings, the source voice profile;

an assigning module configured to assign, based on evaluating the phonological data from the set of vocal data, a first quality score to the first set of enunciation data; and

a transmitting module configured to transmit, in response to determining that the first quality score is greater than a first quality threshold, bonus credits to a first speaker of the first set of enunciation data.

9. The system of claim 8 , wherein the source voice profile includes a predetermined set of phonological and prosodic characteristics corresponding to a voice of a first individual.

10. The system of claim 9 , wherein the phonological and prosodic characteristics include rhythm, stress, tone, and intonation.

11. The system of claim 8 , further comprising:

a detecting module configured to detect, using an incentive system, a transition phase of an entertainment content sequence;

a presenting module configured to present, during the transition phase of the entertainment content sequence, a speech sample collection module configured to record enunciation data for the textual passage; and

an advancing module configured to advance, in response to recording enunciation data for the textual passage, the entertainment content sequence.

12. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable storage medium does not comprise a transitory signal per se, wherein the computer readable program, when executed on a first computing device, causes the first computing device to:

crowd-source a data message configured to include a textual passage;

collect, from a plurality of speakers, a set of vocal data for the textual passage, wherein the set of vocal data includes a first set of enunciation data corresponding to a first portion of the textual passage, a second set of enunciation data corresponding to a second portion of the textual passage, and a third set of enunciation data corresponding to both the first and second portions of the textual passage;

map a source voice profile to a subset of the set of vocal data to synthesize the aggregate voice;

extract phonological data from the set of vocal data, wherein the phonological data includes pronunciation tags, intonation tags, and syllable rates;

convert, based on the phonological data including pronunciation tags, intonation tags and syllable rates, the set of vocal data into a set of phoneme strings;

apply, to the set of phoneme strings, the source voice profile;

assign, based on evaluating the phonological data from the set of vocal data, a first quality score to the first set of enunciation data; and

transmit, in response to determining that the first quality score is greater than a first quality threshold, bonus credits to a first speaker of the first set of enunciation data.

13. The computer program product of claim 12 , wherein the source voice profile includes a predetermined set of phonological and prosodic characteristics corresponding to a voice of a first individual.

14. The computer program product of claim 13 , wherein the phonological and prosodic characteristics include rhythm, stress, tone, and intonation.

15. The computer program product of claim 12 , further comprising computer readable program code configured to:

detect, by an incentive system, a transition phase of an entertainment content sequence;

present, during the transition phase of the entertainment content sequence, a speech sample collection module configured to record enunciation data for the textual passage; and

advance, in response to recording enunciation data for the textual passage, the entertainment content sequence.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2016
From: DE FREITAS, JOSE A.G.; HINDLE, GUY P.; TAYLOR, JAMES S.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 038750/0068 →
Continuity (2)
Continuation 14501230 · Sep 30, 2014
Related Publication 20160275935A1 · Sep 22, 2016