IP Library Granted Patent US 10,360,899
Granted Patent B2
US 10,360,899 · App. 15/714,820 · Granted Jul 23, 2019

Method and device for processing speech based on artificial intelligence

Inventors: Wei Zou (Beijing, CN); Xiangang Li (Beijing, CN); Weiwei Cui (Beijing, CN); Jingyuan Hu (Beijing, CN)
Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
G10L15/063G06N3/04G06N3/08G10L15/16G10L19/0204G10L21/038G10L25/30G10L2015/0635
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,360,899
App. No.
15/714,820
Granted
Jul 23, 2019
Kind
B2
Abstract

The present disclosure provides a method and a device for processing a speech based on artificial intelligence. The method includes: receiving a speech processing request, in which the speech processing request includes a first digital speech signal and a first sample frequency corresponding to the first digital speech signal; selecting a target speech processing model from a pre-trained speech processing model base according to the first sample frequency; performing up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency, in which the second sample frequency is larger than the first sample frequency.

Claims (74)

1. A method for processing a speech based on artificial intelligence, comprising:

receiving a speech processing request, wherein the speech processing request comprises a first digital speech signal and a first sample frequency corresponding to the first digital speech signal;

selecting a target speech processing model from a pre-trained speech processing model base according to the first sample frequency; and

performing up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency, wherein the second sample frequency is larger than the first sample frequency;

before selecting a target speech processing model, further comprising:

obtaining a training data sequence, wherein the training data sequence comprises a plurality of digital speech data sample pairs, each of the plurality of digital speech data sample pairs comprises a sample having the first sample frequency and a sample having the second sample frequency corresponding to a same speech; and

training a preset deep neural network model using the training data sequence to generate the target speech processing model.

2. The method according to claim 1 , wherein the speech processing request further comprises the second sample frequency, and selecting a target speech processing model comprises:

selecting the target speech processing model according to the first sample frequency and the second sample frequency.

3. The method according to claim 1 , wherein training a preset deep neural network model using the training data sequence to generate the target speech processing model comprises:

selecting a first digital speech data sample pair from the training data sequence according to a preset rule;

performing pre-processing on the first digital speech data sample pair, and obtaining information of sampling points having the first sample frequency and information of sampling points having the second sample frequency;

inputting the information of the sampling points having the first sample frequency to the preset deep neural network model to generate prediction information of the sampling points having the second sample frequency;

determining a correction coefficient according to a difference between the information of the sampling points having the second sample frequency and the prediction information of the sampling points having the second sample frequency;

performing a correction on the preset deep neural network model according to the correction coefficient to generate a first speech processing model; and

selecting a second digital speech data sample pair from the training data sequence according to the preset rule, performing a correction on the first speech processing model using the second digital speech data sample pair, and repeating above steps until the target speech processing model is determined.

4. The method according to claim 1 , before obtaining a training data sequence, further comprising:

performing sampling processing on a plurality of pieces of speech data in a speech data base respectively with the second sample frequency to obtain a sample sequence having the second sample frequency; and

extracting a sample sequence having the first sample frequency from the sample sequence having the second sample frequency.

5. The method according to claim 3 , before performing up-sampling processing on the first digital speech signal using the target speech processing model, further comprising:

pre-processing the first digital speech signal, to obtain the information of the sampling points having the first sample frequency.

6. A method for processing a speech based on artificial intelligence, comprising:

receiving a speech processing request, wherein the speech processing request comprises a first digital speech signal and a first sample frequency corresponding to the first digital speech signal;

selecting a target speech processing model from a pre-trained speech processing model base according to the first sample frequency; and

performing up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency, wherein the second sample frequency is larger than the first sample frequency;

wherein performing up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency comprises:

performing the up-sampling processing on the first digital speech signal to generate information of sampling points of the second digital speech signal having the second sample frequency; and

generating the second digital speech signal having the second sample frequency according to the information of sampling points of the second digital speech signal having the second sample frequency.

7. The method according to claim 5 , wherein performing up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency comprises:

processing the first digital speech signal by interpolating and training using the target speech processing model, to generate information of sampling points to be interpolated; and

forming the second digital speech signal having the second sample frequency according to the information of the sampling points having the first sample frequency and the information of sampling points to be interpolated.

8. The method according to claim 3 , wherein the information of a sampling point is a wave amplitude of a speech signal corresponding to the sampling point.

9. A device for processing a speech based on artificial intelligence, comprising:

a memory having computer programs executable by the processor; and

a processor;

wherein the processor is configured to:

receive a speech processing request, wherein the speech processing request comprises a first digital speech signal and a first sample frequency corresponding to the first digital speech signal;

obtain a training data sequence, wherein the training data sequence comprises a plurality of digital speech data sample pairs, each of the plurality of digital speech data sample pairs comprises a sample having the first sample frequency and a sample having the second sample frequency corresponding to a same speech;

train a preset deep neural network model using the training data sequence to generate the target speech processing model;

select a target speech processing model from a pre-trained speech processing model base according to the first sample frequency; and

perform up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency, wherein the second sample frequency is larger than the first sample frequency.

10. The device according to claim 9 , wherein the speech processing request further comprises the second sample frequency, and the processor is configured to select a target speech processing model by selecting the target speech processing model according to the first sample frequency and the second sample frequency.

11. The device according to claim 9 , wherein the processor is configured to train a preset deep neural network model using the training data sequence to generate the target speech processing model by:

selecting a first digital speech data sample pair from the training data sequence according to a preset rule;

performing pre-processing on the first digital speech data sample pair, and obtaining information of sampling points having the first sample frequency and information of sampling points having the second sample frequency;

inputting the information of the sampling points having the first sample frequency to the preset deep neural network model to generate prediction information of the sampling points having the second sample frequency;

determining a correction coefficient according to a difference between the information of the sampling points having the second sample frequency and the prediction information of the sampling points having the second sample frequency;

performing a correction on the preset deep neural network model according to the correction coefficient to generate a first speech processing model; and

selecting a second digital speech data sample pair from the training data sequence according to the preset rule, performing a correction on the first speech processing model using the second digital speech data sample pair, and repeating above steps until the target speech processing model is determined.

12. The device according to claim 9 , wherein the processor is further configured to:

perform sampling processing on a plurality of pieces of speech data in a speech data base respectively with the second sample frequency to obtain a sample sequence having the second sample frequency; and

extract a sample sequence having the first sample frequency from the sample sequence having the second sample frequency.

13. The device according to claim 11 , wherein the processor is further configured to:

pre-process the first digital speech signal to obtain the information of the sampling points having the first sample frequency.

14. A device for processing a speech based on artificial intelligence, comprising:

a memory having computer programs executable by the processor; and

a processor;

wherein the processor is configured to;

receive a speech processing request, wherein the speech processing request comprises a first digital speech signal and a first sample frequency corresponding to the first digital speech signal;

select a target speech processing model from a pre-trained speech processing model base according to the first sample frequency; and

perform up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency, wherein the second sample frequency is larger than the first sample frequency;

wherein the processor is configured to perform up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency by:

performing the up-sampling processing on the first digital speech signal to generate information of sampling points of the second digital speech signal having the second sample frequency; and

generating the second digital speech signal having the second sample frequency according to the information of sampling points of the second digital speech signal having the second sample frequency.

15. The method according to claim 13 , wherein the processor is configured to perform up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency by:

processing the first digital speech signal by interpolating and training using the target speech processing model, to generate information of sampling points to be interpolated; and

forming the second digital speech signal having the second sample frequency according to the information of the sampling points having the first sample frequency and the information of sampling points to be interpolated.

16. The method according to claim 11 , wherein the information of a sampling point is a wave amplitude of a speech signal corresponding to the sampling point.

17. A non-transitory computer readable storage medium, storing computer programs therein, wherein when the computer programs are executed by a processor, a method for processing a speech based on artificial intelligence is performed comprising:

receiving a speech processing request, wherein the speech processing request comprises a first digital speech signal and a first sample frequency corresponding to the first digital speech signal;

obtaining a training data sequence, wherein the training data sequence comprises a plurality of digital speech data sample pairs, each of the plurality of digital speech data sample pairs comprises a sample having the first sample frequency and a sample having the second sample frequency corresponding to a same speech;

training a preset deep neural network model using the training data sequence to generate the target speech processing model

selecting a target speech processing model from a pre-trained speech processing model base according to the first sample frequency; and

performing up-sampling processing on the first digital speech signal using the target speech processing model to generate a second digital speech signal having a second sample frequency, wherein the second sample frequency is larger than the first sample frequency.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2017
From: ZOU, WEI; LI, XIANGANG; CUI, WEIWEI; HU, JINGYUAN
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 044196/0988 →
Priority Claims (1)
CN 2017 1 0184721 · Mar 24, 2017 · national
Continuity (1)
Related Publication 20180277099A1 · Sep 27, 2018
Cited By (1)
US 12,217,739