IP Library Patent Application 17134639
Patent Application
App. No. 17/134,639

ARTIFICIALLY GENERATING AUDIO DATA FROM TEXTUAL INFORMATION AND RHYTHM INFORMATION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/134,639
Abstract

Methods and systems for artificially generating media streams are provided. Textual information, rhythm information and voice characteristics may be received. It may be determined that a first portion of the textual information corresponds to a first portion of the rhythm information and that a second portion of the textual information corresponds to a second portion of the rhythm information. Audio stream may be generated based on the textual information, the rhythm information and the voice characteristics. A first portion of the audio stream may include a vocal expression of the first portion of the textual information in a voice corresponding to the voice characteristics and according to the first portion of the rhythm information, and a second portion may include a vocal expression of the second portion of the textual information in the voice corresponding to the voice characteristics and according to the second portion of the rhythm information.

Claims (57)

1 . A computer program product for artificially generating media streams, the computer program product embodied in a non-transitory computer-readable medium and including instructions for causing at least one processor to execute a method comprising:

receiving textual information;

receiving rhythm information;

receiving voice characteristics;

determining that a first portion of the textual information corresponds to a first portion of the rhythm information and that a second portion of the textual information corresponds to a second portion of the rhythm information, the first portion of the textual information differs from the second portion of the textual information and the first portion of the rhythm information differs from the second portion of the rhythm information; and

generating an audio stream based on the textual information, the rhythm information and the voice characteristics, the generated audio stream includes at least a first portion and a second portion, the first portion of the generated audio stream includes a vocal expression of the first portion of the textual information in accordance with the first portion of the rhythm information and in a voice corresponding to the voice characteristics, the second portion of the generated audio stream includes a vocal expression of the second portion of the textual information in accordance with the second portion of the rhythm information and in the voice corresponding to the voice characteristics.

2 . The computer program product of claim 1 , wherein the method further comprises:

receiving a personalized profile associated with a user; and

using the personalized profile to select the voice characteristics.

3 . The computer program product of claim 1 , wherein the method further comprises:

receiving a source audio data; and

analyzing the source audio data to determine the voice characteristics based on voice characteristics of a speaker in the source audio data.

4 . The computer program product of claim 1 , wherein the method further comprises:

receiving a source audio data; and

analyzing the source audio data to generate the textual information based on speech in the source audio data.

5 . The computer program product of claim 4 , wherein the generated textual information is a transcription of at least part of the speech in the source audio data.

6 . The computer program product of claim 4 , wherein the speech in the source audio data is in a first language and the generated textual information includes a translation of at least part of the speech to a second language.

7 . The computer program product of claim 1 , wherein the method further comprises:

receiving melody information; and

generating the audio stream based on the textual information, the melody information and the voice characteristics.

8 . The computer program product of claim 7 , wherein the method further comprises:

receiving a source audio data;

analyzing the source audio data to identify a melody in the source audio data; and

determining the melody information based on the identified melody in the source audio data.

9 . The computer program product of claim 1 , wherein the method further comprises receiving musical information, and wherein the generated audio stream includes musical tones based on the musical information in conjunction with the vocal expressions.

10 . The computer program product of claim 9 , wherein the method further comprises:

receiving a source audio data; and

analyzing the source audio data to determine the musical tones based on music in the source audio data.

11 . The computer program product of claim 1 , wherein the method further comprises:

receiving a source textual information; and

translating the source textual information to generate the textual information.

12 . The computer program product of claim 1 , wherein the method further comprises:

receiving a source textual information; and

modifying at least one aspect of the source textual information to generate the textual information.

13 . The computer program product of claim 12 , wherein the at least one aspect is language register.

14 . The computer program product of claim 12 , wherein the at least one aspect is related to gender.

15 . The computer program product of claim 1 , wherein the method further comprises:

receiving source voice characteristics; and

modifying at least one aspect of the source voice characteristics to generate the voice characteristics.

16 . The computer program product of claim 15 , wherein the at least one aspect is related to gender.

17 . The computer program product of claim 1 , wherein the method further comprises:

receiving source rhythm information; and

modifying at least one aspect of the source rhythm information to generate the rhythm information.

18 . The computer program product of claim 17 , wherein the at least one aspect is related to musical genre.

19 . A system for artificially generating media streams, the system comprising:

at least one processor configured to:

receive textual information;

receive rhythm information;

receive voice characteristics;

determine that a first portion of the textual information corresponds to a first portion of the rhythm information and that a second portion of the textual information corresponds to a second portion of the rhythm information, the first portion of the textual information differs from the second portion of the textual information and the first portion of the rhythm information differs from the second portion of the rhythm information; and

generate an audio stream based on the textual information, the rhythm information and the voice characteristics, the generated audio stream includes at least a first portion and a second portion, the first portion of the generated audio stream includes a vocal expression of the first portion of the textual information in accordance with the first portion of the rhythm information and in a voice corresponding to the voice characteristics, the second portion of the generated audio stream includes a vocal expression of the second portion of the textual information in accordance with the second portion of the rhythm information and in the voice corresponding to the voice characteristics.

20 . A method for artificially generating media streams, the method comprising:

receiving textual information;

receiving rhythm information;

receiving voice characteristics;

determining that a first portion of the textual information corresponds to a first portion of the rhythm information and that a second portion of the textual information corresponds to a second portion of the rhythm information, the first portion of the textual information differs from the second portion of the textual information and the first portion of the rhythm information differs from the second portion of the rhythm information; and

generating an audio stream based on the textual information, the rhythm information and the voice characteristics, the generated audio stream includes at least a first portion and a second portion, the first portion of the generated audio stream includes a vocal expression of the first portion of the textual information in accordance with the first portion of the rhythm information and in a voice corresponding to the voice characteristics, the second portion of the generated audio stream includes a vocal expression of the second portion of the textual information in accordance with the second portion of the rhythm information and in the voice corresponding to the voice characteristics.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2021
From: INGEL, BEN AVI; ZASS, RON
To: VIDUBLY LTD
Reel/Frame 057247/0908 →