IP Library › Granted Patent US 11,238,880
Granted Patent B2
US 11,238,880 · App. 16/959,766 · Granted Feb 1, 2022

Method for acquiring noise-refined voice signal, and electronic device for performing same

Inventors: Kiho Cho (Gyeonggi-do, KR); Hangil Moon (Gyeonggi-do, KR); Soonho Baek (Gyeonggi-do, KR); Jaemo Yang (Gyeonggi-do, KR); Beakkwon Son (Gyeonggi-do, KR); Myoungho Lee (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd.
G10L21/0232G10L25/84H04R1/406H04R3/005G10L2021/02166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,238,880
App. No.
16/959,766
Granted
Feb 1, 2022
Kind
B2
Abstract

According to various embodiments, an electronic device includes a plurality of microphones, and a processor electrically connected to the plurality of microphones, wherein the processor may obtain audio signals through the plurality of microphones, estimate a probability of existence of a voice signal included in the obtained audio signals, obtain correlation information between the audio signals based on the probability of existence of the voice signal and/or the obtained audio signals, obtain voice blocking information based on the correlation information or a direction of arrival (DOA) estimation, obtain a first signal among the audio signals based on the audio signals, the correlation information, and the voice blocking information, obtain a second signal including the voice signal among the audio signals, and obtain a noise-removed voice signal by removing the first signal from the second signal. In addition, it is possible to implement various embodiments understood through the disclosure.

Claims (40)

1. An electronic device comprising:

a plurality of microphones; and

a processor electrically connected to the plurality of microphones,

wherein the processor is configured to:

obtain audio signals through the plurality of microphones,

estimate a probability of existence of a voice signal included in the obtained audio signals,

obtain estimated voice signals based on the audio signals and the probability of existence of the voice signal,

obtain correlation information between the audio signals based on the probability of existence of the voice signal and/or the obtained audio signals, wherein the correlation information includes a covariance matrix between the estimated voice signals that correspond to the plurality of microphones, respectively,

obtain voice blocking information based on the correlation information or a direction of arrival (DOA) estimation,

obtain a first signal among the audio signals based on the audio signals, the correlation information, and the voice blocking information,

obtain a second signal including the voice signal among the audio signals, and

obtain a noise-removed voice signal by removing the first signal from the second signal.

2. The electronic device of claim 1 , wherein the processor is configured to:

obtain a blocking matrix based on the correlation information and the voice blocking information, and

obtain the first signal based on the audio signals and the blocking matrix.

3. The electronic device of claim 1 , wherein the correlation information includes a covariance matrix between the audio signals that correspond to the plurality of microphones, respectively.

4. The electronic device of claim 1 , wherein the processor is configured to obtain the voice blocking information based on the covariance matrix between the estimated voice signals.

5. The electronic device of claim 4 , wherein the processor is configured to obtain the voice blocking information based on a column vector of the covariance matrix between the estimated voice signals.

6. The electronic device of claim 1 , wherein the processor is configured to:

obtain estimated noise signals based on the audio signals and the probability of existence of the voice signal, and

obtain the voice blocking information based on a covariance matrix between the estimated noise signals.

7. The electronic device of claim 6 , wherein the processor is configured to obtain the voice blocking information based on an eigen vector of the covariance matrix between the estimated noise signals.

8. The electronic device of claim 6 , wherein the processor is configured to obtain the voice blocking information based on a column vector of the covariance matrix between the estimated noise signals.

9. The electronic device of claim 1 , wherein the processor is configured to perform the direction of arrival estimation based on at least a difference between times taken for the voice signal to reach the plurality of microphones.

10. A method of obtaining a noise-removed voice signal among audio signals by an electronic device, the method comprising:

obtaining the audio signals;

estimating a probability of existence of a voice signal;

obtaining estimated voice signals based on the audio signals and the probability of existence of the voice signal;

obtaining correlation information based on the probability of existence of the voice signal and/or the obtained audio signals, wherein the correlation information includes a covariance matrix between the estimated voice signals that correspond to a plurality of microphones, respectively;

obtaining voice blocking information based on the correlation information or a direction of arrival (DOA) estimation;

obtaining a first signal among the audio signals based on the audio signals, the correlation information, and the voice blocking information;

obtaining a second signal including the voice signal among the audio signals; and

obtaining the noise-removed voice signal by removing the first signal from the second signal.

11. The method of claim 10 , wherein the obtaining of the first signal includes:

obtaining a blocking matrix based on the correlation information and the voice blocking information; and

obtaining the first signal based on the audio signals and the blocking matrix.

12. The method of claim 10 , wherein the obtaining of the correlation information includes:

obtaining a covariance matrix between the audio signals.

13. The method of claim 10 , wherein the obtaining of the voice blocking information includes:

obtaining the voice blocking information based on the covariance matrix between the estimated voice signals.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2020
From: CHO, KIHO; MOON, HANGIL; BAEK, SOONHO; YANG, JAEMO; SON, BEAKKWON; LEE, MYOUNGHO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 053107/0863 →
Priority Claims (1)
KR 10-2018-0016948 · Feb 12, 2018 · national
Continuity (1)
Related Publication 20200365168A1 · Nov 19, 2020