IP Library Granted Patent US 10,136,235
Granted Patent B2
US 10,136,235 · App. 15/654,843 · Granted Nov 20, 2018

Method and system for audio quality enhancement

Inventor: In Gyu Kang (Seongnam-si, KR)
Assignee: Line Corporation
H04S3/002H04S7/30H04S7/308H04R5/033H04S2400/01H04S2400/05
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,136,235
App. No.
15/654,843
Granted
Nov 20, 2018
Kind
B2
Abstract

Provided is a method and system for audio quality enhancement. The audio quality enhancement method may include determining whether a software audio quality enhancement function is desired and/or required by analyzing a microphone input signal that is input to the electronic device and a speaker output signal that is output from the electronic device; and activating or inactivating the software audio quality enhancement function based on a result of determining whether the software audio quality enhancement function is desired and/or required.

Claims (72)

1. A non-transitory computer-readable recording medium storing computer readable instructions that, when executed by at least one processor, cause the at least one processor to perform an audio quality enhancement method included in an electronic device, the method comprising:

analyzing a microphone input signal that is input to the electronic device and a speaker output signal that is output from the electronic device;

determining whether a software audio quality enhancement function is desired based on results of the analyzing the microphone input signal and the speaker output signal, the determining including

determining an echo section based on the results of the analyzing the microphone input signal and the speaker output signal, and

determining a continuity of delay between the microphone input signal and the speaker output signal,

the continuity of delay indicating that a delay value for each frame unit is maintained to be the same when each of the microphone input signal and the speaker output signal is divided based on a frame unit with a desired size; and

activating the software audio quality enhancement function based on a result of the determining whether the software audio quality enhancement function is desired, the activating the software audio quality enhancement function including determining whether an acoustic echo cancellation (AEC) module is desired based on results of the determining the continuity of delay.

2. The non-transitory computer-readable recording medium of claim 1 , wherein

the software audio quality enhancement function comprises the acoustic echo cancellation (AEC) module, a noise suppression (NS) module, and an automatic gain control (AGC) module; and

the determining whether the software audio quality enhancement function is desired comprises determining whether at least one module of the AEC module, the NS module, and the AGC module is desired; and

the activating comprises activating the determined at least one module based on a result of determining whether the at least one module of the AEC module, the NS module, and the AGC module is desired.

3. The non-transitory computer-readable recording medium of claim 1 , wherein the determining whether the software audio quality enhancement function is desired comprises:

calculating an average energy of the determined echo section; and

determining whether the acoustic echo cancellation (AEC) module is desired as the software audio quality enhancement function based on the results of the determining the continuity of delay or the calculated average energy of the determined echo section and a desired first threshold value.

4. The non-transitory computer-readable recording medium of claim 3 , wherein the determining of the echo section comprises:

analyzing a correlation between the microphone input signal and the speaker output signal during an activation section of the speaker output signal; and

determining the echo section based on results of the analyzing the correlation.

5. The non-transitory computer-readable recording medium of claim 3 , wherein the determining whether the software audio quality enhancement function is desired comprises:

determining, as a user input section, a section in which energy of the microphone input signal is greater than a multiplication between an average energy of the microphone input signal and a desired first weight in a remaining section, the remaining section excluding the determined echo section from the entire section of the microphone input signal and the speaker output signal;

calculating an average energy of the determined user input section; and

determining whether an automatic gain control (AGC) module is desired as the software audio quality enhancement function based on whether the calculated average energy of the determined user input section belongs to a desired range.

6. The non-transitory computer-readable recording medium of claim 5 , wherein the determining whether the software audio quality enhancement function is desired comprises:

determining, as a noise section, a section in which the energy of the microphone input signal is less than a multiplication between an average energy of the microphone input signal and a desired second weight in the remaining section, the remaining section excluding the determined echo section and the determined user input section from the entire section;

calculating an average energy of the determined noise section; and

determining whether a noise suppression (NS) module is desired as the software audio quality enhancement function based on the calculated average energy of the determined noise section and a desired second threshold value.

7. A method for audio quality enhancement, the method comprising:

analyzing, using at least one processor, a microphone input signal that is input to an electronic device and a speaker output signal that is output from the electronic device;

determining, using the at least one processor, whether a software audio quality enhancement function is desired based on results of the analyzing the microphone input signal and the speaker output signal, the determining including

determining an echo section based on the results of the analyzing the microphone input signal and the speaker output signal, and

determining a continuity of delay between the microphone input signal and the speaker output signal,

the continuity of delay indicating that a delay value for each frame unit is maintained to be the same when each of the microphone input signal and the speaker output signal is divided based on a frame unit with a desired size; and

activating, using the at least one processor, the software audio quality enhancement function based on a result of determining whether the software audio quality enhancement function is desired, the activating the software audio quality enhancement function including determining whether an acoustic echo cancellation (AEC) module is desired based on results of the determining the continuity of delay.

8. The method of claim 7 , wherein

the software audio quality enhancement function comprises the acoustic echo cancellation (AEC) module, a noise suppression (NS) module, and an automatic gain control (AGC) module; and

the determining whether the software audio quality enhancement function is desired comprises determining whether at least one module of the AEC module, the NS module, and the AGC module is desired; and

the activating comprises activating the determined at least one module based on a result of determining whether the at least one module of the AEC module, the NS module, and the AGC module is desired.

9. The method of claim 7 , wherein the determining whether the software audio quality enhancement function is desired comprises:

calculating an average energy of the determined echo section; and

determining whether the acoustic echo cancellation (AEC) module is desired as the software audio quality enhancement function based on the results of the determining the continuity of delay or the calculated average energy of the determined echo section and a desired first threshold value.

10. The method of claim 9 , wherein the determining whether the software audio quality enhancement function is desired comprises:

determining, as a user input section, a section in which energy of the microphone input signal is greater than a multiplication between an average energy of the microphone input signal and a desired first weight in a remaining section, the remaining section excluding the determined echo section from the entire section of the microphone input signal and the speaker output signal;

calculating an average energy of the determined user input section; and

determining whether an automatic gain control (AGC) module is desired as the software audio quality enhancement function based on whether the calculated average energy of the determined user input section belongs to a desired range.

11. The method of claim 10 , wherein the determining whether the software audio quality enhancement function is desired comprises:

determining, as a noise section, a section in which the energy of the microphone input signal is less than a multiplication between an average energy of the microphone input signal and a desired second weight in a remaining section, the remaining section excluding the determined echo section and the determined user input section from the entire section;

calculating an average energy of the determined noise section; and

determining whether an noise suppression NS module is desired as the software audio quality enhancement function based on the calculated average energy of the determined noise section and a desired second threshold value.

12. An electronic device comprising:

a memory configured to store computer-readable instructions; and

at least one processor configured to execute the computer-readable instructions to,

analyze a microphone input signal that is input to the electronic device and a speaker output signal that is output from the electronic device,

determine whether a software audio quality enhancement function is desired based on results of the analyzing the microphone input signal and the speaker output signal, the determining including

determining an echo section based on the results of the analyzing the microphone input signal and the speaker output signal, and

determining a continuity of delay between the microphone input signal and the speaker output signal,

the continuity of delay indicating that a delay value for each frame unit is maintained to be the same when each of the microphone input signal and the speaker output signal is divided based on a frame unit with a desired size, and

activate the software audio quality enhancement function based on a result of the determining whether the software audio quality enhancement function is desired, the activating the software audio quality enhancement function including determining whether an acoustic echo cancellation (AEC) module is desired based on results of the determining the continuity of delay.

13. The electronic device of claim 12 , wherein

the software audio quality enhancement function comprises the acoustic echo cancellation (AEC) module, a noise suppression (NS) module, and an automatic gain control (AGC) module; and

the at least one processor is further configured to,

determine whether the software audio quality enhancement function is desired by determining whether at least one module of the AEC module, the NS module, and the AGC module is desired, and

activate the software audio quality enhancement function by activating the determined at least one module based on a result of the determining whether the at least one module of the AEC module, the NS module, and the AGC module is desired.

14. The electronic device of claim 12 , wherein, to determine whether the software audio quality enhancement function is desired, the at least one processor is configured to:

calculate an average energy of the determined echo section; and

determine whether an acoustic echo cancellation (AEC) module is desired as the software audio quality enhancement function based on the results of the determining the continuity of delay or the calculated average energy of the determined echo section and a desired first threshold value.

15. The electronic device of claim 14 , wherein, to determine whether the software audio quality enhancement function is desired, the at least one processor is configured to:

determine, as a user input section, a section in which energy of the microphone input signal is greater than a multiplication between an average energy of the microphone input signal and a desired first weight in a remaining section, the remaining section excluding the determined echo section from the entire section of the microphone input signal and the speaker output signal;

calculate an average energy of the determined user input section; and

determine whether an automatic gain control (AGC) module is desired as the software audio quality enhancement function based on whether the calculated average energy of the determined user input section belongs to a desired range.

16. The electronic device of claim 15 , wherein, to determine whether the software audio quality enhancement function is desired, the at least one processor is configured to:

determine, as a noise section, a section in which the energy of the microphone input signal is less than a multiplication between the average energy of the microphone input signal and a desired second weight in a remaining section, the remaining section excluding the determined echo section and the determined user input section from the entire section;

calculate an average energy of the determined noise section; and

determine whether a noise suppression (NS) module is desired as the software audio quality enhancement function based on the calculated average energy of the determined noise section and a desired second threshold value.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067096/0431 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CHANGE OF ADDRESS Recorded Dec 28, 2021
From: LINE CORPORATION
To: LINE CORPORATION
Reel/Frame 059511/0374 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2017
From: KANG, IN GYU
To: LINE CORPORATION
Reel/Frame 043060/0575 →
Priority Claims (1)
KR 10-2016-0095045 · Jul 26, 2016 · national
Continuity (1)
Related Publication 20180035231A1 · Feb 1, 2018