Electronic device and method for adjusting volume using acoustic signal output from external object
According to an embodiment, a processor of a wearable device is configured to control a display to display a visual object in association with an external object viewable through a display. The processor is configured to identify whether an acoustic signal is output from an external object, in response to receiving the acoustic signal having a first volume while displaying the visual object, through a microphone of the wearable device, based at least on an image obtained by a camera. Based on identifying that the acoustic signal is output from the external object, the processor is configured to obtain a second volume corresponding to the visual object, by adjusting the first volume based on a position relationship between the external object and the visual object. The processor is configured to output an audio signal corresponding to the visual object through a speaker of the wearable device based on the obtained second volume.
1 . A head-wearable electronic device, comprising:
at least one speaker;
at least one microphone;
at least one display, when the head-wearable electronic device is worn by a user, positioned toward an eye of the user;
at least one camera; and
at least one processor comprising processing circuitry; and
memory, comprising one or more storage mediums, storing instructions,
wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device to:
control the at least one display to display a screen using images representing a field-of-view (FOV) of the at least one camera;
control the at least one display to display, within the screen, a virtual object to be seen as being positioned within the FOV of the at least one camera;
receive an acoustic signal through the at least one microphone;
based on receiving the acoustic signal with a first volume while the virtual object is displayed, identify whether the acoustic signal is generated by an external object based on recognizing at least one image received via the at least one camera;
based on identifying that the acoustic signal is generated by the external object, identify a second volume by adjusting the first volume using position relationship between the external object and the virtual object; and
based on identifying an audio signal associated with the virtual object, control the at least one speaker to output the audio signal with the second volume.
2 . The head-wearable electronic device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device to:
identify, in response to receiving the acoustic signal, a first direction of the acoustic signal regarding the head-wearable electronic device;
identify a second direction of the external object based on the image; and
identify, based on the first direction and the second direction, whether the acoustic signal is output from the external object.
3 . The head-wearable electronic device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device wearable device to:
identify, based on a category to which the external object is classified, whether the acoustic signal is output from the external object.
4 . The head-wearable electronic device of claim 3 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device wearable device to:
identify a first direction of the acoustic signal with respect to the head-wearable electronic device;
identify a second direction of the external object with respect to the head-wearable electronic device; and
determine whether the acoustic signal is output from the external object based on a difference between the first direction and the second direction.
5 . The head-wearable electronic device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device to:
obtain, in a state of identifying a first external object that is the external object, and a second external object different from the first external object using the at least one image received via the at least one camera, a first distance between the first external object and the virtual object, and a second distance between the second external object and the virtual object; and
obtain, based on the first distance being less than the second distance, the second volume based on the first volume of the acoustic signal output from the first external object.
6 . The head-wearable electronic device of claim 5 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device wearable device to:
obtain, based on identifying the second distance reduced to be less than the first distance based on movement of at least one of the first external object, the second external object or the virtual object, the second volume based on a third volume of another acoustic signal output from the second external object.
7 . The head-wearable electronic device of claim 1 , further comprises a communication circuitry configured to communicate with the external object outputting the acoustic signal, and
wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device to:
control the at least one display to display, in response to an input indicating insertion of the virtual object based on the external object, the virtual object within the screen.
8 . The head-wearable electronic device of claim 7 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device to:
request, to the external object through the communication circuitry, another audio signal associated with the acoustic signal output from the external object; and
output, based on receiving the another audio signal as a response to the request through the communication circuitry, the another audio signal through the speaker.
9 . The head-wearable electronic device of claim 7 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device to:
request, to the external object through the communication circuitry, the audio signal of a first channel identified based on the position relationship, among a plurality of channels included in the acoustic signal output from the external object.
10 . The head-wearable electronic device of claim 9 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the head-wearable electronic device to:
request, to the external object, at least temporary cessation of reproducing of the first channel among the plurality of channels.
11 . A method of operating a head-wearable electronic device including at least one speaker, at least one microphone, at least one display, and at least one camera, comprising:
controlling the at least one display to display a screen using images representing a field-of-view (FOV) of the at least one camera;
controlling the at least one display to display, within the screen, a virtual object to be seen as being positioned within the FOV of the at least one camera;
receiving an acoustic signal through the at least one microphone;
based on receiving the acoustic signal with a first volume while the virtual object is displayed, identifying whether the acoustic signal is generated by an external object based on recognizing at least one image received via the at least one camera;
based on identifying that the acoustic signal is generated by the external object, identifying a second volume by adjusting the first volume using position relationship between the external object and the virtual object; and
based on identifying an audio signal associated with the virtual object, controlling the at least one speaker to output the audio signal with the second volume.
12 . The method of claim 11 , wherein the identifying the external object comprises:
identifying, in response to receiving the acoustic signal, a first direction of the acoustic signal regarding the head-wearable electronic device;
identifying a second direction of the external object based on the image; and
identifying, based on the first direction and the second direction, whether the acoustic signal is output from the external object.
13 . The method of claim 11 , wherein the identifying the external object comprises:
identifying, based on a category to which the external object is classified, whether the acoustic signal is output from the external object.
14 . The method of claim 13 , wherein the identifying the external object comprises:
identifying a first direction of the acoustic signal with respect to the head-wearable electronic device;
identifying a second direction of the external object with respect to the head-wearable electronic device; and
determining whether the acoustic signal is output from the external object based on a difference between the first direction and the second direction.
15 . The method of claim 11 , wherein the identifying the second volume comprises:
obtaining, in a state of identifying a first external object that is the external object, and a second external object different from the first external object using the at least one image received via the at least one camera, a first distance between the first external object and the virtual object, and a second distance between the second external object and the virtual object; and
obtaining, based on the first distance less than the second distance, the second volume based on the first volume of the acoustic signal output from the first external object.
16 . A non-transitory computer readable storage medium storing instructions, wherein the instructions, when executed by a head-wearable electronic device including at least one speaker, at least one microphone, at least one display, and at least one camera, cause the head-wearable electronic device to:
control the at least one display to display a screen using images representing a field-of-view (FOV) of the at least one camera;
control the at least one display to display, within the screen, a virtual object to be seen as being positioned within the FOV of the at least one camera;
receive an acoustic signal through the at least one microphone;
based on receiving the acoustic signal with a first volume while the virtual object is displayed, identify whether the acoustic signal is generated by an external object based on recognizing at least one image received via the at least one camera;
based on identifying that the acoustic signal is generated by the external object, identify a second volume by adjusting the first volume using position relationship between the external object and the virtual object; and
based on identifying an audio signal associated with the virtual object, control the at least one speaker to output the audio signal with the second volume.
17 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions, when executed by the head-wearable electronic device, cause the head-wearable electronic device to:
identify, in response to receiving the acoustic signal, a first direction of the acoustic signal regarding the head-wearable electronic device;
identify a second direction of the external object based on the image; and
identify, based on the first direction and the second direction, whether the acoustic signal is output from the external object.
18 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions, when executed by the head-wearable electronic device, cause the head-wearable electronic device to:
identify, based on a category to which the external object is classified, whether the acoustic signal is output from the external object.
19 . The non-transitory computer readable storage medium of claim 18 , wherein the instructions, when executed by the head-wearable electronic device, cause the head-wearable electronic device to:
identify a first direction of the acoustic signal with respect to the head-wearable electronic device;
identify a second direction of the external object with respect to the head-wearable electronic device; and
determine whether the acoustic signal is output from the external object based on a difference between the first direction and the second direction.
20 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions, when executed by the head-wearable electronic device, cause the head-wearable electronic device to:
obtain, in a state of identifying a first external object that is the external object, and a second external object different from the first external object using the at least one image received via the at least one camera, a first distance between the first external object and the virtual object, and a second distance between the second external object and the virtual object; and
obtain, based on the first distance being less than the second distance, the second volume based on the first volume of the acoustic signal output from the first external object.