Electronic device for controlling ambient sound based on audio scene and operating method thereof
An electronic device is provided. In order to process an ambient sound according to an audio scene, the electronic device receive an ambient sound, determine an audio scene based on the ambient sound, determine a target signal processing profile corresponding to the audio scene among one or more signal processing profile, and process the ambient sound according to the target signal processing profile.
1. An electronic device, comprising:
an input/output module configured to receive an ambient sound and output a sound in which the ambient sound is processed;
an audio module configured to process the ambient sound;
a memory configured to store computer-executable instructions and one or more signal processing profiles; and
a processor configured to execute the instructions,
wherein the instructions, when executed by the processor, cause the electronic device to:
determine an audio scene based on the ambient sound,
receive a user input for selecting a target signal processing profile,
determine the target signal processing profile corresponding to the audio scene, and
process the ambient sound according to the target signal processing profile.
2. The electronic device of claim 1 , wherein the instructions, when executed, further cause the device to determine the audio scene according to at least one of a location or a feature of the ambient sound, based on a pre-trained learning model.
3. The electronic device of claim 1 ,
wherein the target signal processing profile is determined based on the user input, and
wherein the instructions, when executed, further cause the device to store the target signal processing profile selected by a user for the audio scene in user selection history information in association with the audio scene.
4. The electronic device of claim 3 , wherein the instructions, when executed, further cause the device to determine a signal processing profile, in which a reliability of the user selection of the audio scene is greater than or equal to a threshold, as the target signal processing profile, referring to the user selection history information.
5. The electronic device of claim 1 , wherein the instructions, when executed, further cause the device to adjust at least one of a frequency band of the ambient sound or a gain, according to at least one of a sound source type of the ambient sound or a sound source direction of the ambient sound.
6. The electronic device of claim 1 , wherein the instructions, when executed, further cause the device to seamlessly switch the target signal processing profile referring to signal processing profile history information according to changes in the ambient sound.
7. The electronic device of claim 1 , wherein each of the one or more signal processing profiles is configured as a combination of an active noise cancellation (ANC) profile for attenuating at least part of the ambient sound, and an ambient sound enhancement (ASE) profile for amplifying at least part of the ambient sound.
8. The electronic device of claim 1 , wherein the electronic device comprises at least one of a true-wireless stereo (TWS), a headphone, or a headset.
9. An operating method of an electronic device, the method comprising:
receiving ambient sound;
determining an audio scene based on the ambient sound;
receiving a user input for selecting a target signal processing profile;
determining the target signal processing profile corresponding to the audio scene among one or more signal processing profiles; and
processing the ambient sound according to the target signal processing profile.
10. The method of claim 9 , wherein the determining of the audio scene comprises determining the audio scene according to at least one of a location or a feature of the ambient sound, based on a pre-trained learning model.
11. The method of claim 9 ,
wherein the target signal processing profile is determined based on a-the user input, and
wherein the method further comprises storing the target signal processing profile selected by a user for the audio scene in user selection history information in association with the audio scene.
12. The method of claim 11 , wherein the determining of the target signal processing profile corresponding to the audio scene comprises determining a signal processing profile, in which a reliability of the user selection of the audio scene is greater than or equal to a threshold, to be the target signal processing profile, referring to the user selection history information.
13. The method of claim 12 , wherein the target signal processing profile is determined based on the user input in response to determining that the signal processing profile, of which the reliability of the user selection is greater than or equal to the threshold, does not exist.
14. The method of claim 11 , further comprising:
determining a signal processing profile list related to the audio scene;
outputting the determined signal processing profile list; and
determining the target signal processing profile according to a user input based on the determined signal processing profile list.
15. The method of claim 9 , wherein the processing of the ambient sound according to the target signal processing profile comprises adjusting at least one of a frequency band of the ambient sound or a gain, according to at least one of a sound source type of the ambient sound or a sound source direction of the ambient sound.
16. The method of claim 9 , further comprising seamlessly switching the target signal processing profile referring to signal processing profile history information according to changes in the ambient sound.
17. The method of claim 9 , wherein each of the one or more signal processing profiles is configured as a combination of an active noise cancellation (ANC) profile for attenuating at least part of the ambient sound, and an ambient sound enhancement (ASE) profile for amplifying at least part of the ambient sound.
18. The method of claim 9 , wherein the audio scene is classified according to a hierarchy.
19. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 9 .
20. An operating method of an electronic device, the method comprising:
receiving ambient sound;
determining an audio scene based on the ambient sound;
determining a target signal processing profile corresponding to the audio scene referring to user selection history information among one or more signal processing profiles; and
processing the ambient sound according to the target signal processing profile.