Robot and control method for identifying a sterilization area
Provided is a robot comprising a driving part, a camera, a plurality of microphones arranged in different directions. The robot further comprises a memory storing instructions, and a processor configured to execute the instructions to identify an originating direction of an audio signal input through the plurality of microphones based on the audio signal being identified as corresponding to a coughing sound, control the camera to capture an image in the originating direction, identify a sterilization area based on a position of a user who does not wear a mask identified in the image, and control the driving part to move the robot to the sterilization area.
1. A method of controlling a robot comprising:
identifying that an audio signal input through a plurality of microphones on the robot corresponds to a coughing sound,
based on the audio signal input through the plurality of microphones on the robot being identified as corresponding to the coughing sound, identifying an originating direction of the audio signal based on an arrangement direction of each microphone and a difference in intensity of audio signals that are respectively input to the plurality of microphones, wherein the plurality of microphones are arranged in different directions;
based on the audio signal input through the plurality of microphones being identified as corresponding to the coughing sound, capturing an image in the originating direction of the audio signal corresponding to the coughing sound using a camera on the robot;
identifying a sterilization area based on a position of a non-mask wearing user identified from the image; and
moving the robot to the sterilization area.
2. The method of claim 1 , wherein identifying the sterilization area comprises:
identifying the sterilization area based on the position of the non-mask wearing user and a threshold range corresponding to an intensity of the audio signal.
3. The method of claim 1 , wherein identifying the sterilization area comprises:
determining a scale of the sterilization area based on a number of non-mask wearing users identified from the image.
4. The method of claim 1 , wherein identifying the sterilization area comprises:
identifying the sterilization area based on a plurality of positions corresponding to a plurality of non-mask wearing users identified from the image.
5. The method of claim 1 , wherein identifying the sterilization area comprises:
determining at least one of a scale of the sterilization area and a sterilization intensity, based on whether the position of the non-mask wearing user is within a pre-set area.
6. A non-transitory computer readable medium for storing computer readable program code or instructions which are executable by a processor to perform a method of controlling a robot, the method comprising:
based on an audio signal input through a plurality of microphones on the robot being identified as corresponding to a coughing sound, identifying an originating direction of the audio signal based on an arrangement direction of each microphone and a difference in intensity of audio signals that are respectively input to the plurality of microphones, wherein the plurality of microphones are arranged in different directions;
based on the audio signal input through the plurality of microphones being identified as corresponding to the coughing sound, capturing an image in the originating direction of the audio signal corresponding to the coughing sound using a camera on the robot;
identifying a sterilization area based on a position of a non-mask wearing user identified from the image; and
moving the robot to the sterilization area.
7. The non-transitory computer readable medium of claim 6 , wherein identifying the sterilization area comprises:
identifying the sterilization area based on the position of the non-mask wearing user and a threshold range corresponding to an intensity of the audio signal.
8. The non-transitory computer readable medium of claim 6 , wherein identifying the sterilization area comprises:
determining a scale of the sterilization area based on a number of non-mask wearing users identified from the image.
9. The non-transitory computer readable medium of claim 6 , wherein identifying the sterilization area comprises:
identifying the sterilization area based on a plurality of positions corresponding to a plurality of non-mask wearing users identified from the image.
10. The non-transitory computer readable medium of claim 6 , wherein identifying the sterilization area comprises:
determining at least one of a scale of the sterilization area and a sterilization intensity, based on whether the position of the non-mask wearing user is within a pre-set area.
11. A robot, comprising:
a driving part;
a camera;
a plurality of microphones arranged in different directions;
a memory storing instructions; and
a processor configured to execute the instructions to:
based on an audio signal input through the plurality of microphones being identified as corresponding to a coughing sound, identify an originating direction of the audio signal based on a difference in intensity of audio signals that are respectively input to the plurality of microphones arranged in different directions,
based on the audio signal input through the plurality of microphones being identified as corresponding to the coughing sound, control the camera to capture an image in the originating direction of the audio signal corresponding to the coughing sound,
identify a sterilization area based on a position of a non-mask wearing user identified from the image, and
control the driving part to move to the sterilization area.
12. The robot of claim 11 , wherein the processor is further configured to execute the instructions to:
identify the sterilization area based on the position of the non-mask wearing user and a threshold range corresponding to an intensity of the audio signal.
13. The robot of claim 11 , wherein the processor is further configured to execute the instructions to:
determine a scale of the sterilization area based on a number of non-mask wearing users identified from the image.
14. The robot of claim 11 , wherein the processor is further configured to execute the instructions to:
identify the sterilization area based on a plurality of positions corresponding to a plurality of non-mask wearing users identified from the image.
15. The robot of claim 11 , wherein the processor is further configured to execute the instructions to:
determine at least one of a scale of the sterilization area, area and a sterilization intensity, based on whether the position of the non-mask wearing user is within a pre-set area.
16. The robot of claim 15 , wherein the pre-set area comprises at least one of an area including an object with high contact frequency by users, an area with high visiting frequency by users, and an area with low mask wearing frequency by users.
17. The robot of claim 11 , wherein the processor is further configured to execute the instructions to:
identify whether the audio signal corresponds to the coughing sound by using a first neural network model trained to identify whether the audio signal comprises a coughing sound.
18. The robot of claim 11 , wherein the processor is further configured to execute the instructions to:
identify whether the image comprises the non-mask wearing user by using a neural network model trained to identify whether the image comprises a non-mask wearing user.
19. The robot of claim 11 , further comprising:
a distance sensor,
wherein the processor is further configured to execute the instructions to:
based on a plurality of sterilization areas being identified, identify a direction and a distance with respect to each sterilization area using the distance sensor, and
set a traveling route for a sterilization operation based on the direction and distance to each sterilization area.
20. The robot of claim 11 , further comprising:
a sterilization device configured to perform a sterilization function,
wherein the processor is further configured to execute the instructions to:
control the sterilization device to perform the sterilization function, based on the robot having moved to the sterilization area.
21. The robot of claim 11 , wherein the processor is further configured to execute the instructions to:
control the camera to capture an image of a space in which the robot is positioned,
identify a ratio of users who are wearing a mask among users in the image,
identify the sterilization area as an area in which a ratio of non-mask wearing people exceeds a threshold ratio.