IP Library › Granted Patent US 12,033,628
Granted Patent B2
US 12,033,628 · App. 17/545,257 · Granted Jul 9, 2024

Method for controlling ambient sound and electronic device therefor

Inventors: Hoseon Shin (Suwon-si, KR); Chulmin Lee (Suwon-si, KR); Youngwoo Lee (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G10L15/22G10L25/87H04R3/00H04R2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,033,628
App. No.
17/545,257
Granted
Jul 9, 2024
Kind
B2
Abstract

A wireless audio device is provided. The wireless audio device includes an audio receiving circuit, an audio output circuit, an acceleration sensor, a communication circuit, a processor, and a memory. The memory may store instructions that, when executed by the processor, cause the wireless audio device to detect an utterance of a user of the wireless audio device by using the acceleration sensor, enter a dialog mode in which at least some of ambient sounds received by the audio receiving circuit are output through the audio output circuit, in response to detecting the utterance of the user, and end the dialog mode if no voice is detected for a specified time or longer by using the audio receiving circuit in the dialog mode.

Claims (72)

1. A wireless audio device comprising:

an audio receiving circuit;

an audio output circuit;

an acceleration sensor;

a communication circuit;

one or more processors; and

memory storing one or more computer programs including computer-executable instructions that, when executed by the one or more processors, cause the wireless audio device to:

detect an utterance of a user of the wireless audio device by using the acceleration sensor and at least one internal microphone facing the user,

in response to detecting the utterance of the user, enter into a dialog mode in which at least some of ambient sounds received by the audio receiving circuit are output through the audio output circuit,

determine whether a voice is detected during a specified time by using at least one external microphone exposed to an outside, and

based on no voice being detected for the specified time or longer by using the audio receiving circuit in the dialog mode, end the dialog mode.

2. The wireless audio device of claim 1 , wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

detect a voice by using the audio receiving circuit;

detect an acceleration corresponding to an utterance of the voice by using the acceleration sensor; and

in response to detecting the voice and detecting the acceleration, detect the utterance of the user.

3. The wireless audio device of claim 2 , wherein the acceleration corresponding to the utterance of the voice is generated by the utterance of the user.

4. The wireless audio device of claim 1 , wherein, based on the user wearing the audio receiving circuit, the audio receiving circuit includes the at least one internal microphone facing the user and the at least one external microphone exposed to the outside.

5. The wireless audio device of claim 4 , wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

acquire an audio signal by using the at least one external microphone; and

control an output of ambient sounds based on a noise intensity of the audio signal.

6. The wireless audio device of claim 5 ,

wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

emphasize a frequency band corresponding to a voice among the ambient sounds for a section in which the voice is detected among the ambient sounds.

7. The wireless audio device of claim 4 ,

wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

acquire the ambient sounds by using the at least one external microphone; and

set a length of the specified time based on a noise of the ambient sounds.

8. The wireless audio device of claim 1 , wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

based on the utterance of the user not corresponding to a wake-up utterance for calling a voice agent, enter the dialog mode; and

based on the utterance of the user corresponding to the wake-up utterance, refrain from entering the dialog mode.

9. The wireless audio device of claim 1 , wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

based on entering the dialog mode, deactivate active noise cancelling (ANC).

10. The wireless audio device of claim 9 , wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

based on ending the dialog mode, return the ANC to a state before entering the dialog mode.

11. A method for controlling a dialog mode of a wireless audio device, the method comprising:

detecting, by the wireless audio device, an utterance of a user of the wireless audio device based on an acceleration of the wireless audio device and at least one internal microphone facing the user;

in response to detecting the utterance of the user, entering, by the wireless audio device, into a dialog mode for outputting at least some of ambient sounds;

determining, by the wireless audio device, whether a voice is detected during a specified time by using at least one external microphone exposed to an outside; and

based on no voice is-being detected for the specified time or longer in the dialog mode, ending, by the wireless audio device, the dialog mode.

12. The method of claim 11 , wherein the detecting of the utterance of the user of the wireless audio device includes:

detecting, by the wireless audio device, a voice by using an audio receiving circuit of the wireless audio device;

detecting, by the wireless audio device, an acceleration corresponding to an utterance of the voice by using an acceleration sensor of the wireless audio device; and

in response to detecting the voice and detecting the acceleration, detecting, by the wireless audio device, the utterance of the user.

13. The method of claim 12 , wherein the acceleration corresponding to the utterance of the voice is generated by the utterance of the user.

14. The method of claim 11 , further comprising:

acquiring, by the wireless audio device, the ambient sounds in the dialog mode; and

controlling, by the wireless audio device, an output of ambient sounds based on a noise intensity of the ambient sounds.

15. The method of claim 14 , wherein the controlling of the output of ambient sounds includes emphasizing, by the wireless audio device, a frequency band corresponding to a voice among the ambient sounds for a section in which the voice is detected among the ambient sounds.

16. The method of claim 14 , further comprising:

setting, by the wireless audio device, a length of the specified time based on the noise intensity of the ambient sounds.

17. The method of claim 11 , wherein the detecting of the utterance of the user of the wireless audio device comprises:

determining, by the wireless audio device, whether a voice signal from the user includes a wake-up utterance for calling a voice agent; and

based on the voice signal not corresponding to the wake-up utterance for calling the voice agent, detecting, by the wireless audio device, the voice signal as the utterance of the user based on the acceleration.

18. A wireless audio device comprising:

at least one internal microphone facing a user when the wireless audio device is worn;

at least one external microphone exposed to an outside when the wireless audio device is worn;

an audio output circuit;

an acceleration sensor;

a communication circuit;

one or more processors; and

memory storing one or more computer programs including computer-executable instructions that, when executed by the one or more processors, cause the wireless audio device to:

detect an utterance of a user of the wireless audio device by using the at least one internal microphone and the acceleration sensor,

determine whether the utterance of the user corresponds to an utterance for calling a voice agent,

based on the utterance of the user not corresponding to the utterance for calling the voice agent, enter into a dialog mode in which at least some of ambient sounds received by the at least one external microphone are output through the audio output circuit, and

based on no voice being detected for a specified time or longer through the at least one external microphone in the dialog mode, end the dialog mode.

19. The wireless audio device of claim 18 , wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

detect a voice by using the at least one internal microphone;

detect an acceleration by an utterance of the voice of the user by using the acceleration sensor; and

in response to detecting the voice and detecting the acceleration, detect the utterance of the user.

20. The wireless audio device of claim 19 , wherein the one or more computer programs further include instructions that, when executed by the one or more processors, cause the wireless audio device to:

acquire the ambient sounds by using the at least one external microphone; and

set a length of the specified time based on a noise of the ambient sounds.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2021
From: SHIN, HOSEON; LEE, CHULMIN; LEE, YOUNGWOO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 058334/0533 →
Priority Claims (1)
KR 10-2020-0174848 · Dec 14, 2020 · national
Continuity (2)
Continuation PCTKR2021015767 · Nov 3, 2021
Related Publication 20220189477A1 · Jun 16, 2022