IP Library › Granted Patent US 11,295,751
Granted Patent B2
US 11,295,751 · App. 16/576,943 · Granted Apr 5, 2022

Multi-band synchronized neural vocoder

Inventors: Chengzhu Yu (Bellevue, WA); Meng Yu (Bellevue, WA); Heng Lu (Sammamish, WA); Dong Yu (Bothell, WA)
Assignee: TENCENT AMERICA LLC
G10L19/16G06N3/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,295,751
App. No.
16/576,943
Granted
Apr 5, 2022
Kind
B2
Abstract

An apparatus and a method include receiving an input audio signal to be processed by a multi-band synchronized neural vocoder. The input audio signal is separated into a plurality of frequency bands. A plurality of audio signals corresponding to the plurality of frequency bands is obtained. Each of the audio signals is downsampled, and processed by the multi-band synchronized neural vocoder. An audio output signal is generated.

Claims (37)

1. A method performed by a multi-band synchronized neural vocoder, comprising:

receiving an input audio signal to be processed by the multi-band synchronized neural vocoder;

separating, by the multi-band synchronized neural vocoder, the input audio signal into a plurality of frequency bands;

obtaining, by the multi-band synchronized neural vocoder, a plurality of audio signals that corresponds to the plurality of frequency bands, based on separating the input audio signal into the plurality of frequency bands;

downsampling, by the multi-band synchronized neural vocoder, each of the plurality of audio signals, based on obtaining the plurality of audio signals;

processing, by the multi-band synchronized neural vocoder, the downsampled audio signals; and

generating, by the multi-band synchronized neural vocoder, an audio output signal based on processing the downsampled audio signals,

wherein the neural vocoder is an LPCNet vocoder.

2. The method of claim 1 , wherein the downsampled audio signals of each of the plurality of frequency bands are processed simultaneously.

3. The method of claim 1 , wherein the downsampled audio signals of each of the plurality of frequency bands are processed using a single processing unit.

4. The method of claim 1 , further comprising:

upsampling each of the processed audio signals; and

generating the audio output signal based on upsampling each of the processed audio signals.

5. A multi-band synchronized neural vocoder device, comprising:

at least one memory configured to store program code;

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

receiving code configured to cause that least one processor to receive an input audio signal to be processed by the multi-band synchronized neural vocoder device;

separating code configured to cause the at least one processor to separate the input audio signal into a plurality of frequency bands;

obtaining code configured to cause the at least one processor to obtain a plurality of audio signals that corresponds to the plurality of frequency bands, based on separating the input audio signal into the plurality of frequency bands;

downsampling code configured to cause the at least one processor to downsample each of the plurality of audio signals, based on obtaining the plurality of audio signals;

processing code configured to cause the at least one processor to process the downsampled audio signals; and

generating code configured to cause the at least one processor to generate an audio output signal based on processing the downsampled audio signals, wherein the neural vocoder device is an LPCNet vocoder.

6. The device of claim 5 , wherein the downsampled audio signals of each of the plurality of frequency bands are processed simultaneously.

7. The device of claim 5 , wherein the downsampled audio signals of each of the plurality of frequency bands are processed using a single processing unit.

8. The device of claim 5 , wherein the program code further comprises:

upsampling code configured to cause the at least one processor to upsample each of the processed audio signals; and

wherein the generating code is further configured to cause the at least one processor to generate the audio output signal based on upsampling each of the processed audio signals.

9. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a multi-band synchronized neural vocoder device, cause the one or more processors to:

receive an input audio signal to be processed by the multi-band synchronized neural vocoder device;

separate the input audio signal into a plurality of frequency bands;

obtain a plurality of audio signals that corresponds to the plurality of frequency bands, based on separating the input audio signal into the plurality of frequency bands;

downsample each of the plurality of audio signals, based on obtaining the plurality of audio signals;

process the downsampled audio signals; and

generate an audio output signal based on processing the downsampled audio signals,

wherein the neural vocoder device is an LPCNet vocoder.

10. The non-transitory computer-readable medium of claim 9 , wherein the downsampled audio signals of each of the plurality of frequency bands are processed simultaneously.

11. The non-transitory computer-readable medium of claim 9 , wherein the downsampled audio signals of each of the plurality of frequency bands are processed using a single processing unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2019
From: YU, CHENGZHU; YU, MENG; LU, HENG; YU, DONG
To: TENCENT AMERICA LLC
Reel/Frame 050444/0028 →
Continuity (1)
Related Publication 20210090584A1 · Mar 25, 2021
Cited By (1)
US 12,700,415