IP Library › Granted Patent US 12,277,923
Granted Patent B2
US 12,277,923 · App. 17/990,358 · Granted Apr 15, 2025

Electronic apparatus and control method thereof

Inventors: Seungdo Choi (Suwon-si, KR); Kyoungbo Min (Suwon-si, KR); Sooyeon Park (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10K11/17885H04R1/1083G10K2210/1081H04R2460/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,277,923
App. No.
17/990,358
Granted
Apr 15, 2025
Kind
B2
Abstract

An electronic apparatus includes an inner microphone provided on a first surface of the electronic apparatus; an outer microphone disposed on a second surface opposite the first surface; and a processor configured to: receive a voice signal of a counterpart and a voice signal of a wearer of the electronic apparatus that are input through the inner microphone and the outer microphone, based on a size of the voice signal of the wearer input through the inner microphone being greater than or equal to a predetermined threshold, remove the voice signal of the wearer input through the outer microphone based on the voice signal of the wearer input through the inner microphone, and amplify the voice signal of the counterpart input through the outer microphone and from which the voice signal of the wearer is removed and output the amplified voice signal, wherein the size of the voice signal of the wearer input through the inner microphone is greater than a size of the voice signal of the wearer input through the outer microphone.

Claims (31)

1. An electronic apparatus comprising:

an inner microphone provided on a first surface of the electronic apparatus;

an outer microphone disposed on a second surface opposite the first surface; and

a processor configured to:

receive a voice signal of a counterpart and a voice signal of a wearer of the electronic apparatus that are input through the inner microphone and the outer microphone, wherein a size of the voice signal of the wearer input through the inner microphone is greater than a size of the voice signal of the wearer input through the outer microphone,

based on the size of the voice signal of the wearer input through the inner microphone being greater than or equal to a predetermined threshold, remove the voice signal of the wearer input through the outer microphone, and

amplify the voice signal of the counterpart input through the outer microphone and from which the voice signal of the wearer is removed and output the amplified voice signal.

2. The electronic apparatus of claim 1 , wherein the processor is further configured to remove noise included in the voice signal of the counterpart and the voice signal of the wearer that are input through the outer microphone.

3. The electronic apparatus of claim 1 , wherein the processor is further configured to perform masking by:

setting a first frequency domain in which the size of the voice signal of the wearer input through the inner microphone is less than a predetermined threshold value to 0, and

setting a second frequency domain in which the size of the voice signal of the wearer input through the inner microphone is equal to or greater than the predetermined threshold value as a value determined based on the predetermined threshold value.

4. The electronic apparatus of claim 3 , wherein the processor is further configured to change the predetermined threshold value based on at least one of a predetermined time interval and a predetermined frequency domain.

5. The electronic apparatus of claim 3 , wherein the processor is further configured to remove the voice signal of the wearer input through the outer microphone based on the voice signal of the wearer input through the inner microphone on which the masking has been performed.

6. The electronic apparatus of claim 3 , wherein the processor is further configured to perform at least one of the masking and the removal of the voice signal of the wearer input through the outer microphone based on a learned voice signal processing artificial intelligence neural network model.

7. The electronic apparatus of claim 1 , wherein the processor is further configured to equalize the voice signal of the counterpart input through the outer microphone and the voice signal of the wearer input through the outer microphone.

8. A method of controlling an electronic apparatus, the method comprising:

receiving a voice signal of a counterpart and a voice signal of a wearer of the electronic apparatus that are input through an inner microphone and an outer microphone, the inner microphone being provided on a first surface of the electronic apparatus and the outer microphone being provided on a second surface opposite the first surface, wherein a size of the voice signal of the wearer input through the inner microphone is greater than a size of the voice signal of the wearer input through the outer microphone;

based on the size of the voice signal of the wearer input through the inner microphone being greater than or equal to a predetermined threshold, removing the voice signal of the wearer input through the outer microphone; and

amplifying the voice signal of the counterpart input through the outer microphone and from which the voice signal of the wearer is removed and outputting the amplified voice signal.

9. The method of claim 8 , further comprising removing noise included in the voice signal of the counterpart and the voice signal of the wearer that are input through the outer microphone.

10. The method of claim 8 , wherein the removing the voice signal of the wearer input through the outer microphone comprises performing masking by:

setting a first frequency domain in which the size of the voice signal of the wearer input through the inner microphone is less than a predetermined threshold value to 0, and

setting a second frequency domain in which the size of the voice signal of the wearer input through the inner microphone is equal to or greater than the predetermined threshold value as a value determined based on the predetermined threshold value.

11. The method of claim 10 , wherein the removing the voice signal of the wearer comprises changing the predetermined threshold value based on at least one of a predetermined time interval and a predetermined frequency domain.

12. The method of claim 10 , wherein the voice signal of the wearer input through the outer microphone is further removed based on the voice signal of the wearer input through the inner microphone on which the masking has been performed.

13. The method of claim 10 , wherein the removing the voice signal of the wearer comprises performing at least one of the masking and the removing of the voice signal of the wearer input through the outer microphone based on a learned voice signal processing artificial intelligence neural network model.

14. The method of claim 8 , further comprising equalizing the voice signal of the counterpart and the voice signal of the wearer input through the outer microphone.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to:

receive a voice signal of a counterpart and a voice signal of a wearer of an electronic apparatus that are input through an inner microphone and an outer microphone, the inner microphone being provided on a first surface of the electronic apparatus and the outer microphone being provided on a second surface opposite the first surface, wherein a size of the voice signal of the wearer input through the inner microphone is greater than a size of the voice signal of the wearer input through the outer microphone;

based on the size of the voice signal of the wearer input through the inner microphone being greater than or equal to a predetermined threshold, remove the voice signal of the wearer input through the outer microphone; and

amplify the voice signal of the counterpart input through the outer microphone and from which the voice signal of the wearer is removed and output the amplified voice signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2022
From: CHOI, SEUNGDO; MIN, KYOUNGBO; PARK, SOOYEON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 061968/0030 →
Priority Claims (1)
KR 10-2022-0008513 · Jan 20, 2022 · national
Continuity (2)
Continuation PCTKR2022015297 · Oct 11, 2022
Related Publication 20230230569A1 · Jul 20, 2023
References Cited (32)
US 10199029B2 · Hsu et al. · 2019 [cited by applicant]
US 10313789B2 · Ushakov · 2019 [cited by applicant]
US 10520562B2 · Popescu · 2019 [cited by applicant]
US 11019421B2 · Lee et al. · 2021 [cited by applicant]
US 11361785B2 · Shim · 2022 [cited by examiner]
US 11562763B2 · Lee et al. · 2023 [cited by applicant]
US 20070009122A1 · Hamacher · 2007 [cited by examiner]
US 20090147966A1 · McIntosh · 2009 [cited by examiner]
US 20120253798A1 · Walters et al. · 2012 [cited by applicant]
US 20160118062A1 · Usher · 2016 [cited by applicant]
US 20160192089A1 · Merks · 2016 [cited by examiner]
US 20170365247A1 · Ushakov · 2017 [cited by applicant]
US 20180113181A1 · Popescu · 2018 [cited by applicant]
US 20180167715A1 · Graylin et al. · 2018 [cited by applicant]
US 20190043518A1 · Li · 2019 [cited by applicant]
US 20200258539A1 · Shim et al. · 2020 [cited by applicant]
US 20200304936A1 · Chen et al. · 2020 [cited by applicant]
US 20200314526A1 · Lee et al. · 2020 [cited by applicant]
US 20210204053A1 · Kim et al. · 2021 [cited by applicant]
US 20210219051A1 · Goldstein et al. · 2021 [cited by applicant]
US 20210249030A1 · Lee et al. · 2021 [cited by applicant]
US 20230012052A1 · Monsarrat-Chanon · 2023 [cited by examiner]
KR 1020170052056A · 2017 [cited by applicant]
KR 1020170142001A · 2017 [cited by applicant]
KR 1020180045853A · 2018 [cited by applicant]
KR 1020180138017A · 2018 [cited by applicant]
KR 1020200098323A · 2020 [cited by applicant]
KR 1020200116323A · 2020 [cited by applicant]
KR 1020210101670A · 2021 [cited by applicant]
Written Opinion (PCT/ISA/237) issued Jan. 25, 2023 by the International Searching Authority for International Patent Application No. PCT/KR2022/015297. [cited by applicant]
Search Report (PCT/ISA/210) issued Jan. 25, 2023 by the International Searching Authority for International Patent Application No. PCT/KR2022/015297. [cited by applicant]
Park et al., “GSEP: a Robust Vocal and Accompaniment Separation System Using Gated CBHG Module and Loudness Normalization”, Gaudio Lab, Inc., Oct. 2020, (5 pages total). [cited by applicant]