Electronic apparatus and controlling method thereof
Provided is an electronic apparatus, including: a sensor; a camera; a storage configured to store first and second artificial intelligence models; a first processor; and a second processor. The second processor is configured to: input an image obtained through the camera to the first artificial intelligence model and identify the object of the first type in the image, and input the image obtained through the camera to the second artificial intelligence model and identify the object of the second type, at least a part of which is not viewable in the image. The first processor is configured to: determine a distance between the object of the first type and the object of the second type based on sensing data received from the sensor; and control the electronic apparatus to travel based on the determined distance.
1 . An electronic apparatus, which travels based on map information and an object recognition result, the electronic apparatus comprising:
a camera;
a communication interface;
a driver;
at least one processor comprising processing circuitry; and
at least one memory storing instructions that, when executed by the at least one processor individually or collectively, cause the electronic apparatus to:
capture an image while the electronic apparatus travels based on the map information;
obtain an object recognition result for the image;
transmit, to an external device, information regarding the image according to the object recognition result;
receive, from the external device, information regarding a user feedback on the object recognition result to update an object recognition model, wherein the external device displays the obtained image while receiving the user feedback; and
control the electronic apparatus such that the electronic apparatus travels according to the received information regarding the user feedback.
2 . The electronic apparatus according to claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic apparatus to:
update the object recognition model based on the received information regarding the user feedback.
3 . The electronic apparatus according to claim 2 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic apparatus to:
obtain a second image after the object recognition model is updated;
obtain, through the updated object recognition model, a second object recognition result for the second image; and
control the electronic apparatus such that the electronic apparatus travels based on the second object recognition result.
4 . The electronic apparatus according to claim 1 , wherein the image comprises a first area corresponding to an object and a second area around the object.
5 . The electronic apparatus according to claim 4 ,
wherein the information regarding the image comprises information regarding a location of the first area, and
wherein the information regarding the location of the first area comprises information regarding a bounding box indicating the first area.
6 . The electronic apparatus according to claim 5 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic apparatus to:
based the object recognition result indicating that the object corresponds to a plurality of predefined object, control the electronic apparatus such that the electronic apparatus travels through the second area; and
based the object recognition result indicating that the object does not correspond to the plurality of predefined object, transmit the information regarding the image to the external device.
7 . The electronic apparatus according to claim 6 , wherein the information regarding the user feedback comprises information for changing the object recognition results obtained by the object recognition model or information for changing the information regarding the location of the first area.
8 . The electronic apparatus according to claim 7 ,
wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic apparatus to:
based on the information regarding the user feedback indicating that the object corresponds a first type, control the electronic apparatus such that the electronic apparatus travels through the second area; and
based on the information regarding the user feedback indicating that the object corresponds a second type different from the first type, control the electronic apparatus such that the electronic apparatus travels at a predetermined distance away from the second area.
9 . A method of controlling an electronic apparatus, which travels based on map information and an object recognition result, the method comprising:
capturing an image while the electronic apparatus travels based on the map information;
obtaining an object recognition result for the image;
transmitting, to an external device, information regarding the image according to the object recognition result;
receiving, from the external device, information regarding a user feedback on the object recognition result to update an object recognition model, wherein the external device displays the obtained image while receiving the user feedback; and
controlling the electronic apparatus such that the electronic apparatus travels according to the received information regarding the user feedback.
10 . The method according to claim 9 , wherein the method further comprises:
updating the object recognition model based on the received information regarding the user feedback.
11 . The method according to claim 10 , wherein the method further comprises:
obtaining a second image after the object recognition model is updated;
obtaining, through the updated object recognition model, a second object recognition result for the second image; and
controlling the electronic apparatus such that the electronic apparatus travels based on the second object recognition result.
12 . The method according to claim 9 , wherein the image comprises a first area corresponding to an object and a second area around the object.
13 . The method according to claim 12 ,
wherein the information regarding the image comprises information regarding a location of the first area; and
wherein the information regarding the location of the first area comprises information regarding a bounding box indicating the first area.
14 . The method according to claim 13 , wherein the method further comprises:
based the object recognition result indicating that the object corresponds to a plurality of predefined object, controlling the electronic apparatus such that the electronic apparatus travels through the second area; and
based the object recognition result indicating that the object does not correspond to the plurality of predefined object, transmitting the information regarding the image to the external device.
15 . The method according to claim 14 , wherein the information regarding the user feedback comprises information for changing the object recognition results obtained by the object recognition model or information for changing the information regarding the location of the first area.
16 . The method according to claim 15 , wherein the method further comprises:
based on the information regarding the user feedback indicating that the object corresponds a first type, controlling the electronic apparatus such that the electronic apparatus travels through the second area; and
based on the information regarding the user feedback indicating that the object corresponds a second type different from the first type, controlling the electronic apparatus such that the electronic apparatus travels at a predetermined distance away from the second area.