IP Library Granted Patent US 10,231,070
Granted Patent B2
US 10,231,070 · App. 15/574,405 · Granted Mar 12, 2019

Voice input exception determining method, apparatus, terminal, and storage medium

Inventors: Lin Yang (Beijing, CN); Zhaoyang Yin (Beijing, CN); Jingwen Yang (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04R29/005G10L25/21H04R1/406H04R3/005H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,231,070
App. No.
15/574,405
Granted
Mar 12, 2019
Kind
B2
Abstract

A voice input exception determining method, an apparatus, a terminal, and a storage medium are provided. The method is applied to an electronic device including an audio collection module, and includes determining whether an amplitude value of an audio signal collected by the audio collection module is less than a preset amplitude threshold and/or whether energy distribution of the audio signal meets a preset condition; and if the amplitude value of the audio signal is less than the preset amplitude threshold and/or the energy distribution of the audio signal does not meet the preset condition, determining that voice input of the electronic device is abnormal. A solution provided in the present disclosure resolves a problem that there is no effective method for determining a sound reception exception caused when a sound reception hole of the electronic device is blocked.

Claims (75)

1. A method comprising:

determining whether an energy distribution of an audio signal for a voice input at a microphone of an electronic device meets a preset condition, the preset condition being whether a ratio of a high-frequency energy value of the audio signal to a low-frequency energy value of the audio signal is less than a preset value threshold, the high-frequency energy value being a first sum of energy values of audio signals whose frequency is higher than a preset frequency, and the low-frequency energy value being a second sum of energy values of audio signals whose frequency is lower than the preset frequency; and

determining that the voice input at the microphone of the electronic device is abnormal when the energy distribution of the audio signal does not meet the preset condition.

2. The method of claim 1 , wherein before determining whether the energy distribution of the audio signal at the microphone meets the preset condition, the method further comprises:

detecting whether a voice channel is established; and

determining whether the energy distribution of the audio signal meets the preset condition when the voice channel is established.

3. The method of claim 1 , wherein determining whether energy distribution of the audio signal at the microphone meets the preset condition comprises:

performing Fourier frequency domain conversion on the audio signal to determine an energy value of the audio signal;

calculating a first sum of energy values of audio signals whose frequency is higher than a preset frequency and using the first sum of energy values as the high-frequency energy value;

calculating a second sum of energy values of audio signals whose frequency is lower than the preset frequency and using the second sum of energy values as the low-frequency energy value;

determining whether the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold; and

determining that the energy distribution of the audio signal does not meet the preset condition when the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold.

4. The method of claim 2 , wherein determining whether energy distribution of the audio signal at the microphone meets the preset condition comprises:

performing Fourier frequency domain conversion on the audio signal to determine an energy value of the audio signal;

calculating a first sum of energy values of audio signals whose frequency is higher than a preset frequency and using the first sum of energy values as the high-frequency energy value;

calculating a second sum of energy values of audio signals whose frequency is lower than the preset frequency and using the second sum of energy values as the low-frequency energy value;

determining whether the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold; and

determining that the energy distribution of the audio signal does not meet the preset condition when the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold.

5. The method of claim 1 , further comprising:

adjusting the microphone when the voice input at the microphone of the electronic device is abnormal; or

outputting prompt information comprising a notification that the voice input at the microphone of the electronic device is abnormal.

6. The method of claim 2 , further comprising:

adjusting the microphone; or

outputting prompt information comprising a notification that the voice input at the microphone of the electronic device is abnormal.

7. The method of claim 3 , further comprising:

adjusting the microphone; or

outputting prompt information comprising a notification that the voice input at the microphone of the electronic device is abnormal.

8. The method of claim 4 , further comprising:

adjusting the microphone; or

outputting prompt information comprising a notification that the voice input at the microphone of the electronic device is abnormal.

9. The method of claim 5 , further comprising providing a second microphone and adjusting the microphone comprises:

determining that the microphone is currently being used; and

enabling the second microphone of the plurality of microphones to collect the audio signal.

10. The method of claim 6 , further comprising providing a second microphone and adjusting the microphone comprises:

determining that the microphone is currently being used; and

enabling the second microphone to collect the audio signal.

11. An electronic device, comprising:

a microphone configured to collect an audio signal;

a memory configured to store instructions; and

a processor coupled to the memory and to the microphone and configured to execute the instructions to cause the processor to:

determine whether an energy distribution of the audio signal for a voice input at the microphone meets a preset condition, the preset condition being whether a ratio of a high-frequency energy value of the audio signal to a low-frequency energy value of the audio signal is less than a preset value threshold, the high-frequency energy value being a first sum of energy values of audio signals whose frequency is higher than a preset frequency, and the low-frequency energy value being a second sum of energy values of audio signals whose frequency is lower than the preset frequency; and

determine that the voice input at the microphone of the electronic device is abnormal when the energy distribution of the audio signal does not meet the preset condition.

12. The electronic device of claim 11 , wherein the instructions further cause the processor to:

detect whether a voice channel is established; and

determine whether the energy distribution of the audio signal meets the preset condition when the voice channel is established.

13. The electronic device according to claim 11 , wherein determining whether the energy distribution of the audio signal meets the preset condition comprises causing the processor to:

perform Fourier frequency domain conversion on the audio signal to determine an energy value of the audio signal;

calculate a first sum of energy values of audio signals whose frequency is higher than a preset frequency and use the first sum of energy values as the high-frequency energy value;

calculate a second sum of energy values of audio signals whose frequency is lower than the preset frequency and use the second sum of energy values as the low-frequency energy value;

determine whether the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold; and

determine that the energy distribution of the audio signal does not meet the preset condition when the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold.

14. The electronic device of claim 11 , wherein the instructions further cause the processor to:

adjust the microphone to collect the audio signal when the voice input at the microphone of the electronic device is abnormal; or

output prompt information, the prompt information comprising a notification that the voice input at the microphone of the electronic device is abnormal.

15. The electronic device of claim 14 , further comprising a second microphone, and the instructions to cause the processor to adjust the microphone comprises causing the processor to:

determine that the microphone is currently being used; and

enable the second microphone to collect the audio signal.

16. A non-transitory computer readable storage medium storing program code which when executed by an electronic device comprising a microphone causes the electronic device to:

determine whether an energy distribution of an audio signal for a voice input at the microphone meets a preset condition, the preset condition being whether a ratio of a high-frequency energy value of the audio signal to a low-frequency energy value of the audio signal is less than a preset value threshold, the high-frequency energy value being a first sum of energy values of audio signals whose frequency is higher than a preset frequency, and the low-frequency energy value being a second sum of energy values of audio signals whose frequency is lower than the preset frequency; and

determine that the voice input of the electronic device is abnormal when the energy distribution of the audio signal does not meet the preset condition.

17. The non-transitory computer readable storage medium of claim 16 , wherein prior to determining whether the energy distribution of the audio signal at the microphone meets the preset condition, the program code causes the electronic device to:

detect whether a voice channel is established; and

determine whether the energy distribution of the audio signal at the microphone meets the preset condition when the voice channel is established.

18. The non-transitory computer readable storage medium of claim 16 , wherein the program code to determine whether energy distribution of the audio signal at the microphone meets the preset condition causes the electronic device to:

perform Fourier frequency domain conversion on the audio signal to determine an energy value of the audio signal;

calculate a first sum of energy values of audio signals whose frequency is higher than a preset frequency and use the first sum of energy values as the high-frequency energy value;

calculate a second sum of energy values of audio signals whose frequency is lower than the preset frequency and use the second sum of energy values as the low-frequency energy value;

determine whether the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold; and

determine that the energy distribution of the audio signal does not meet the preset condition when the ratio of the high-frequency energy value to the low-frequency energy value is less than the preset value threshold.

19. The non-transitory computer readable storage medium of claim 16 , wherein the program code further causes the electronic device to:

adjust the microphone when the voice input at the microphone of the electronic device is abnormal; or

output prompt information, the prompt information comprising a notification that the voice input at the microphone of the electronic device is abnormal.

20. The non-transitory computer readable storage medium of claim 19 , wherein the electronic device comprises a second microphone, and the program code to adjust the microphone causes the electronic device to:

determine that the microphone is currently being used; and

enable the second microphone to collect the audio signal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: HUAWEI TECHNOLOGIES CO., LTD.
To: HONOR DEVICE CO., LTD.
Reel/Frame 055919/0344 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2017
From: YANG, LIN; YIN, ZHAOYANG; YANG, JINGWEN
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 044138/0215 →
Continuity (1)
Related Publication 20180139554A1 · May 17, 2018
Cited By (1)
US 12,192,395