IP Library Granted Patent US 10,706,874
Granted Patent B2
US 10,706,874 · App. 16/380,609 · Granted Jul 7, 2020

Voice signal detection method and apparatus

Inventors: Lei Jiao (Hangzhou, CN); Yanchu Guan (Hangzhou, CN); Xiaodong Zeng (Hangzhou, CN); Feng Lin (Hangzhou, CN)
Assignee: Alibaba Group Holding Limited
G10L25/87G10L25/21G10L25/84G10L2025/783
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,706,874
App. No.
16/380,609
Granted
Jul 7, 2020
Kind
B2
Abstract

An audio signal is obtained by a user terminal. The audio signal is divided into a plurality of short-time energy frames based on a frequency of a predetermined voice signal. Energy of each short-time energy frame is determined. Based on the energy of each short-time energy frame, whether the audio signal includes a voice signal is determined.

Claims (70)

1. A computer-implemented method, comprising:

obtaining, by a user terminal, an audio signal;

determining a ratio of a sampling rate of a predetermined voice signal to a frequency of the predetermined voice signal;

dividing, by the user terminal, the audio signal into a maximum quantity of short-time energy frames containing a plurality of samples based on the ratio;

determining, by the user terminal, energy of each short-time energy frame; and

determining, by the user terminal, whether the audio signal includes a voice signal based on the energy of each short-time energy frame.

2. The computer-implemented method of claim 1 , wherein the audio signal is collected at the sampling rate and is in a pulse code modulation (PCM) format.

3. The computer-implemented method of claim 1 , wherein the obtained audio signal is in a non-PCM format, and further comprising:

prior to dividing the audio signal:

converting the audio signal into a pulse code modulation (PCM) format; and

identifying the sampling rate of the audio signal.

4. The computer-implemented method of claim 1 , wherein the energy of each short-time energy frame is a sum of energy associated with each sampling point in each short-time energy frame, and wherein the energy associated with each sampling point is determined based on an amplitude of the audio signal that corresponds to the sampling point in the short-time energy frame.

5. The computer-implemented method of claim 1 , wherein determining whether the audio signal includes a voice signal comprises:

determining a plurality of high-energy frames, wherein each high-energy frame of the plurality of high-energy frames is a short-time energy frame where energy is greater than a predetermined threshold;

determining a high-energy frame ratio that is represented by a ratio of a quantity of the plurality of high-energy frames to a quantity of the short-time energy frames included in the audio signal;

determining whether the high-energy frame ratio is greater than a predetermined value;

if it is determined that the high-energy frame ratio is greater than the predetermined value:

determining that the audio signal includes a voice signal; or

if it is determined that the high-energy frame ratio is not greater than the predetermined value:

determining that the audio signal does not include a voice signal.

6. The computer-implemented method of claim 5 , wherein it is determined that the high-energy frame ratio is greater than the predetermined value, further comprising:

determining, from the short-time energy frames included in the audio signal, whether there exist a predetermined number of consecutive short-time energy frames, wherein each of the predetermined number of consecutive short-time energy frame has energy that is greater than the predetermined threshold;

if YES, determining that the audio signal includes a voice signal; or

otherwise, determining that the audio signal does not include a voice signal.

7. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

obtaining, by a user terminal, an audio signal;

determining a ratio of a sampling rate of a predetermined voice signal to a frequency of the predetermined voice signal;

dividing, by the user terminal, the audio signal into a maximum quantity of short-time energy frames containing a plurality of samples based on the ratio;

determining, by the user terminal, energy of each short-time energy frame; and

determining, by the user terminal, whether the audio signal includes a voice signal based on the energy of each short-time energy frame.

8. The non-transitory, computer-readable medium of claim 7 , wherein the audio signal is collected at the sampling rate and is in a pulse code modulation (PCM) format.

9. The non-transitory, computer-readable medium of claim 7 , wherein the obtained audio signal is in a non-PCM format, and further comprising:

prior to dividing the audio signal:

converting the audio signal into a pulse code modulation (PCM) format; and

identifying the sampling rate of the audio signal.

10. The non-transitory, computer-readable medium of claim 7 , wherein the energy of each short-time energy frame is a sum of energy associated with each sampling point in each short-time energy frame, and wherein the energy associated with each sampling point is determined based on an amplitude of the audio signal that corresponds to the sampling point in the short-time energy frame.

11. The non-transitory, computer-readable medium of claim 7 , wherein determining whether the audio signal includes a voice signal comprises:

determining a plurality of high-energy frames, wherein each high-energy frame of the plurality of high-energy frames is a short-time energy frame where energy is greater than a predetermined threshold;

determining a high-energy frame ratio that is represented by a ratio of a quantity of the plurality of high-energy frames to a quantity of the short-time energy frames included in the audio signal;

determining whether the high-energy frame ratio is greater than a predetermined value;

if it is determined that the high-energy frame ratio is greater than the predetermined value:

determining that the audio signal includes a voice signal; or

if it is determined that the high-energy frame ratio is not greater than the predetermined value:

determining that the audio signal does not include a voice signal.

12. The non-transitory, computer-readable medium of claim 11 , wherein it is determined that the high-energy frame ratio is greater than the predetermined value, further comprising:

determining, from the short-time energy frames included in the audio signal, whether there exist a predetermined number of consecutive short-time energy frames, wherein each of the predetermined number of consecutive short-time energy frame has energy that is greater than the predetermined threshold;

if YES, determining that the audio signal includes a voice signal; or

otherwise, determining that the audio signal does not include a voice signal.

13. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations comprising:

obtaining, by a user terminal, an audio signal;

determining a ratio of a sampling rate of a predetermined voice signal to a frequency of the predetermined voice signal;

dividing, by the user terminal, the audio signal into a maximum quantity of short-time energy frames containing a plurality of samples based on the ratio;

determining, by the user terminal, energy of each short-time energy frame; and

determining, by the user terminal, whether the audio signal includes a voice signal based on the energy of each short-time energy frame.

14. The computer-implemented system of claim 13 , wherein the audio signal is collected at the sampling rate and is in a pulse code modulation (PCM) format.

15. The computer-implemented system of claim 13 , wherein the obtained audio signal is in a non-PCM format, and further comprising:

prior to dividing the audio signal:

converting the audio signal into a pulse code modulation (PCM) format; and

identifying the sampling rate of the audio signal.

16. The computer-implemented system of claim 13 , wherein the energy of each short-time energy frame is a sum of energy associated with each sampling point in each short-time energy frame, and wherein the energy associated with each sampling point is determined based on an amplitude of the audio signal that corresponds to the sampling point in the short-time energy frame.

17. The computer-implemented system of claim 13 , wherein determining whether the audio signal includes a voice signal comprises:

determining a plurality of high-energy frames, wherein each high-energy frame of the plurality of high-energy frames is a short-time energy frame where energy is greater than a predetermined threshold;

determining a high-energy frame ratio that is represented by a ratio of a quantity of the plurality of high-energy frames to a quantity of the short-time energy frames included in the audio signal;

determining whether the high-energy frame ratio is greater than a predetermined value;

if it is determined that the high-energy frame ratio is greater than the predetermined value:

determining that the audio signal includes a voice signal; or

if it is determined that the high-energy frame ratio is not greater than the predetermined value:

determining that the audio signal does not include a voice signal.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2020
From: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
To: ADVANCED NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053754/0625 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2020
From: ALIBABA GROUP HOLDING LIMITED
To: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD.
Reel/Frame 053743/0464 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2019
From: JIAO, LEI; GUAN, YANCHU; ZENG, XIAODONG; LIN, FENG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 050729/0556 →
Priority Claims (1)
CN 2016 1 0890946 · Oct 12, 2016 · national
Continuity (2)
Continuation PCTCN2017103489 · Sep 26, 2017
Related Publication 20190237097A1 · Aug 1, 2019