Electronic device for providing visualized artificial intelligence service on basis of information about external object, and operating method for electronic device
With respect to an electronic device and an operating method for the electronic device, according to various embodiments, the electronic device comprises: a rotatable vision sensor configured to detect an external object in a space in which the electronic device is arranged; a rotatable projector configured to output a picture in the space in which the electronic device is arranged; a memory storing spatial information about the space in which the electronic device is arranged; and a processor, wherein the processor can be configured to: control the vision sensor so that the vision sensor tracks the external object while rotating, determine the position of the picture to be output by the projector based on the spatial information and external object information generated based on the tracking of the external object, and control the projector to output the picture at the determined position.
1. An electronic device comprising:
a rotatable vision sensor configured to detect an external object in a space in which the electronic device is disposed;
a rotatable projector configured to output a screen into the space in which the electronic device is disposed;
memory storing spatial information of the space in which the electronic device is disposed; and
a processor,
wherein the processor is configured to:
control the vision sensor to track the external object while being rotated,
classify the external object using an image obtained by the vision sensor while generating movement information of the external object based on tracking of the external object, wherein the generating movement information is complete before the classification of the external object is complete,
determine, before the classification of the external object is complete, a position of the screen to be output by the projector based on the spatial information and the movement information of the external object generated based on the tracking of the external object while classifying the external object,
determine, after the position of the screen is determined and the classification of the external object is complete, whether to output the screen on the determined position based on a result of the classification of the external object, and
according to determination to output the screen on the determined position, control the projector to output the screen to the determined position;
wherein the external object is a user and the classification of the external object is identification of the user.
2. The electronic device of claim 1 , wherein the processor is configured to control the projector to change an output position of the screen based on a changed position of the external object in response to the vision sensor detecting movement of the external object.
3. The electronic device of claim 1 , wherein the processor is configured to:
perform advance scanning of the space in which the electronic device is disposed,
determine at least one area onto which the projector can output the screen based on the result of the scanning, and
store information about the determined area in the memory.
4. The electronic device of claim 3 , wherein the processor is configured to:
select one of the at least one area based on a position of the external object, and
control the projector to output the screen onto the selected area.
5. The electronic device of claim 1 , further comprising a microphone,
wherein the processor is configured to:
detect reception of sound through the microphone,
identify a direction of the sound based on information transmitted by the microphone, and
determine whether to process an operation corresponding to the sound based on a position of the external object and the direction of the sound.
6. The electronic device of claim 5 , wherein the processor is configured to determine to process the operation corresponding to the sound in response to identifying that the position of the external object and the direction of the sound coincide with each other.
7. The electronic device of claim 5 , wherein the processor is configured to disregard the received sound in response to identifying that the position of the external object and the direction of the sound do not coincide with each other.
8. The electronic device of claim 1 , wherein the processor is configured to perform pre-distortion for the screen based on information about an area onto which the screen is to be output.
9. The electronic device of claim 1 , wherein the processor is configured to:
measure illumination of the space in which the electronic device is disposed using an illuminance sensor, and
change a characteristic of the screen being output based on the measured illumination and a distance between the electronic device and the external object, the distance being measured by the vision sensor.
10. The electronic device of claim 9 , wherein the characteristic of the screen comprises brightness of the screen or a layout of the screen.
11. The electronic device of claim 1 , wherein the vision sensor comprises an event-based vision sensor configured to not transmit data based on the external object being in a standstill state and to transmit the data based on the external object being in a moving state, and
the processor is configured to control the vision sensor to track the external object based on an amount of change of light being generated in accordance with the movement of the external object.
12. A method for operating an electronic device comprising:
detecting an external object in a space in which the electronic device is disposed, and tracking, by a rotatable vision sensor, the external object while being rotated;
classifying the external object using image obtained by the vision sensor while generating movement information of the external object based on tracking of the external object, wherein the generating movement information is complete before the classification of the external object is complete,
determining, by a processor, before the classification of the external object is complete, a position of a screen to be output by a projector, based on the movement information of the external object generated based on the tracking of the external object, and spatial information of the space in which the electronic device is disposed while classifying the external object;
determining, after the position of the screen is determined and the classification of the external object is complete, whether to output the screen on the determined position based on a result of the classification of the external object; and
according to determination to output the screen on the determined position, controlling the projector to output the screen to the determined position;
wherein the external object is a user and the classification of the external object is identification of the user.
13. The method of claim 12 , further comprising controlling, by the processor, the projector to change an output position of the screen based on a changed position of the external object in response to the vision sensor detecting movement of the external object.
14. The method of claim 12 , further comprising:
performing advance scanning of the space in which the electronic device is disposed;
determining, by the projector, at least one area onto which the projector can output the screen based on the result of the scanning; and
storing information about the determined area in the memory.
15. The method of claim 14 , further comprising:
selecting one of the at least one area based on a position of the external object; and
controlling the projector to output the screen onto the selected area.