IP Library Granted Patent US 10,607,595
Granted Patent B2
US 10,607,595 · App. 15/670,117 · Granted Mar 31, 2020

Generating audio rendering from textual content based on character models

Inventors: Timothy Robert Kingsbury (Cary, NC); Robert James Kapinos (Durham, NC); Scott Wentao Li (Cary, NC); Russell Speight VanBlon (Raleigh, NC)
Assignee: LENOVO (SINGAPORE) PTE. LTD.
G10L13/10G06F17/218G06F17/279G06N3/006G10L13/0335G10L13/047G06N3/08G06N5/003G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,595
App. No.
15/670,117
Granted
Mar 31, 2020
Kind
B2
Abstract

A computer implemented method, device and computer program product are provided. The method, device and computer program product utilize textual machine learning to analyze textual content to identify narratives for associated content segments of the textual content. The method, device and computer program further utilize textual machine learning to designate character models for the corresponding narratives and generate an audio rendering of the textual content utilizing the character models in connection with the corresponding narratives for the associated content segments.

Claims (30)

1. A computer implemented method, comprising:

under control of one or more processors configured with specific executable program instructions,

analyzing textual content to identify narratives for associated content segments of the textual content;

utilizing textual machine learning to designate character models for the corresponding narratives based on one or more of a trait of the narrative and/or a nature of the textual content, wherein the designating utilizes the textual machine learning to designate different intonations to be utilized by at least one of the character models in connection with sections of the corresponding narrative based on traits of the narrative; and

generating an audio rendering of the textual content utilizing the character models in connection with the corresponding narratives for the associated content segments.

2. The method of claim 1 , wherein the designating utilizes the textual machine learning to designate the character models to simulate different characters within a book based on traits of the narrative, the characters differing from one another by one or more of age, sex, race, nationality or personality traits.

3. The method of claim 1 , wherein the content segments represent sections of spoken dialogue by different individual speakers, and wherein the textual machine learning assigns different character models for the individual speakers based on traits of the narrative.

4. The method of claim 1 , further comprising identifying a dialogue tag associated with the content segment and assigning at least one of the intonations based on dialogue tag.

5. The method of claim 1 , wherein the textual content represents a story and the audio rendering includes a first character model representing a narrator and secondary character models representing characters within the story, the textual machine learning designating the first and second character models based on traits of the narrative.

6. The method of claim 1 , wherein the textual content includes dialogue tags, the method further comprising removing the dialogue tags from the audio rendering.

7. The method of claim 1 , further comprising receiving feedback regarding one or more character models in the audio rendering and adjusting the one or more character models based on the feedback.

8. A device, comprising:

a processor;

a memory storing program instructions accessible by the processor;

wherein, responsive to execution of the instructions, the processor performs the following:

analyzing textual content to identify narratives for associated content segments of the textual content;

utilizing textual machine learning to designate character models for the corresponding narratives based on traits of the narrative, wherein the designating utilizes the textual machine learning to designate different intonations to be utilized by at least one of the character models in connection with sections of the corresponding narrative based on traits of the narrative; and

generating an audio rendering of the textual content utilizing the character models in connection with the corresponding narratives for the associated content segments.

9. The device of claim 8 , wherein the processor designates the character models to simulate different characters within a book, the characters differing from one another by one or more of age, sex, race, nationality or personality traits, the textual machine learning designating the character models based on the traits of the narrative.

10. The device of claim 8 , wherein the processor steps through content segments and assigns the content segment to a new narrative or a pre-existing narrative.

11. The device of claim 8 , wherein the processor compares current and pre-existing narrative traits to determine whether to update or replace the corresponding character model.

12. The device of claim 8 , wherein the textual content represents a story and the audio rendering includes a first character model representing a narrator and secondary character models represent characters within the story, the textual machine learning designating the first and second character models based on traits of the narrative.

13. The device of claim 8 , wherein the textual content includes dialogue tags, the processor to remove the dialogue tags from the audio rendering.

14. The device of claim 8 , wherein the processor to receive feedback regarding one or more character models in the audio rendering and adjust the one or more character models based on the feedback.

15. A computer program product comprising a non-signal computer readable storage medium comprising computer executable code, which when executed by a processor performs:

analyzing textual content to identify narratives for associated content segments of the textual content;

utilizing textual machine learning to designate character models for the corresponding narratives based on one or more of a trait of the narrative and/or a nature of the textual content, wherein the designating utilizes the textual machine learning to designate different intonations to be utilized by at least one of the character models in connection with sections of the corresponding narrative based on traits of the narrative; and

generating an audio rendering of textual content utilizing character models in connection with corresponding narratives.

16. The computer program product of claim 15 , wherein the computer executable code comprises the character models to simulate different characters within a book based on the traits of the narrative, the characters differing from one another by one or more of age, sex, race, nationality or personality traits.

17. The computer program product of claim 15 , wherein the content segments represent sections of spoken dialogue by different individual speakers, and wherein the computer executable code to assign different character models for the individual speakers based on the traits of the narrative.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2021
From: LENOVO (SINGAPORE) PTE LTD
To: LENOVO PC INTERNATIONAL LTD
Reel/Frame 055939/0434 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2017
From: KINGSBURY, TIMOTHY WINTHROP; KAPINOS, ROBERT JAMES; LI, SCOTT WENTAO; VANBLON, RUSSELL SPEIGHT
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 043214/0133 →
Continuity (1)
Related Publication 20190043474A1 · Feb 7, 2019
Cited By (1)
US 12,333,261