Cooking apparatus and control method thereof
A cooking apparatus includes a case, a cooking chamber formed inside the case, a camera configured to obtain an image inside of the cooking chamber, a transparent member, a camera cooling fan configured to blow air toward the camera, a motor configured to rotate the camera cooling fan, and a controller to be electrically connected to the camera and the motor. The controller is configured to operate the camera to obtain a first image inside of the cooking chamber, configured to identify foreign substance-related information of a lens of the camera or the transparent member based on the first image, and configured to control an operation of the motor to perform a cleaning mode, in which the camera cooling fan is rotated at a first rotation speed for a first rotation time, based on the determining that the foreign substance is present.
1 . A cooking apparatus comprising:
a case;
a cooking chamber formed inside the case;
a camera configured to obtain an image inside of the cooking chamber, the camera having a lens;
a transparent member disposed in front of the lens of the camera so that the camera obtains the image inside of the cooking chamber through the transparent member;
a camera cooling fan configured to blow air toward the camera;
a motor configured to rotate the camera cooling fan; and
a controller configured to control the camera and the motor,
wherein the controller is further configured to:
operate the camera to obtain a first image inside of the cooking chamber;
identify first foreign substance-related information of the lens of the camera or the transparent member based on the obtained first image, the first foreign substance-related information including a ratio of an area occupied by foreign substance to an entire area of the obtained first image;
determine whether the foreign substance at least partially blocks the lens or the transparent member based on the identified first foreign substance-related information;
control the motor to perform a first cleaning mode, in which the camera cooling fan is rotated at a first rotation speed for a first rotation time to remove the foreign substance that at least partially blocking the lens or the transparent member; and
in response to the determining that the foreign substance has not been removed after the first cleaning mode is performed, control the motor to perform a second cleaning mode, in which the camera cooling fan is rotated at a second rotation speed for a second rotation time.
2 . The cooking apparatus of claim 1 , wherein
the controller is further configured to:
operate the camera to obtain a second image inside of the cooking chamber after the first cleaning mode is performed;
identify second foreign substance-related information of the lens of the camera or the transparent member based on the obtained second image;
determine whether the foreign substance that at least partially blocking the lens or the transparent member has been removed by the performing the first cleaning mode, based on the identified second foreign substance-related information; and
control the motor to perform the second cleaning mode based on the determining that the foreign substance has not been removed after the first cleaning mode is performed.
3 . The cooking apparatus of claim 2 , wherein
the second rotation speed is greater than the first rotation speed.
4 . The cooking apparatus of claim 2 , wherein
the controller is further configured to:
generate identification error information based on the determining that the foreign substance has not been removed after the first cleaning mode is performed, the identification error information including information that the foreign substance is not a foreign substance attached to the lens of the camera nor the transparent member but a foreign substance inside the cooking chamber or a food to be cooked.
5 . The cooking apparatus of claim 4 , further comprising a memory configured to store a learning model which is used for identifying the first and second foreign substance-related information,
wherein the stored learning model respectively outputs the first and second foreign substance-related information based on the obtained first image and the obtained second image being input to the learning model by the controller.
6 . The cooking apparatus of claim 4 , further comprising:
a communication device configured to communicate with a server,
wherein the controller is further configured to:
obtain a learning model which is used for identifying the first and second foreign substance-related information from the server through the communication device; and
control the communication device to transmit the identification error information to the server.
7 . The cooking apparatus of claim 1 , wherein
the first foreign substance-related information further comprises at least one of presence or absence of foreign substance, and a number of foreign substances.
8 . The cooking apparatus of claim 1 , wherein
the controller is further configured to respectively identify the first foreign substance-related information based on focus information of the obtained first image.
9 . The cooking apparatus of claim 1 , wherein
the controller is configured to identify the first foreign substance-related information based on a result of comparing the first image with a clean cooking chamber image which is an image of the cooking chamber in a clean state without the foreign substance.
10 . The cooking apparatus of claim 1 , further comprising:
a display,
wherein the controller is configured to control the display to display the first foreign substance-related information.
11 . The cooking apparatus of claim 1 , further comprising:
an inputter configured to obtain a user input,
wherein the controller is configured to respectively control the motor to perform the first cleaning mode and the second cleaning mode based on the user input obtained through the inputter.
12 . The cooking apparatus of claim 1 , further comprising:
a communication device configured to communicate with a server,
wherein the controller is configured to control the communication device to transmit display information including the first foreign substance-related information on an external user device, to the server.
13 . The cooking apparatus of claim 1 , further comprising:
a display,
wherein the controller is configured to:
control the display to display visual information to recommend pyrolytic cleaning for the second cleaning mode, based on the determining that the foreign substance has not been removed after the first cleaning mode is performed is present.
14 . The cooking apparatus of claim 1 , further comprising:
a door configured to open or close the cooking chamber; and
a door sensor configured to detect an opening or a closing of the door,
wherein the controller is further configured to:
control the motor to rotate the camera cooling fan based on the detection of the opening of the door by the sensor.
15 . A control method of a cooking apparatus including a
cooking chamber, a door, a camera including a lens, a transparent member, a camera cooling fan, a motor, a memory and a controller, comprising:
operating the camera to obtain a first image inside of the cooking chamber;
identifying first foreign substance-related information of the lens of the camera or the transparent member of the cooking chamber based on the obtained first image by using a learning model obtained from the memory or a server, the first foreign substance-related information including a ratio of an area occupied by foreign substance to an entire area of the obtained first image;
determining whether the foreign substance at least partially blocks the lens or the transparent member based on the identified first foreign substance-related information;
controlling the motor to perform a first cleaning mode, in which the camera cooling fan is rotated at a first rotation speed for a first rotation time to remove the foreign substance that at least partially blocking the lens or the transparent member; and
in response to the determining that the foreign substance has not been removed after the first cleaning mode is performed, controlling the motor to perform a second cleaning mode, in which the camera cooling fan is rotated at a second rotation speed for a second rotation time.
16 . The control method of claim 15 , further comprising:
operating the camera to obtain a second image inside of the cooking chamber after the first cleaning mode is performed;
identifying second foreign substance-related information of the lens of the camera or the transparent member based on the obtained second image by using the learning model;
determining whether the foreign substance that at least partially blocking the lens or the transparent member has been removed by the performing the first cleaning mode, based on the identified second foreign substance-related information; and
controlling the motor to perform the second cleaning mode based on the determining that the foreign substance has not been removed after the performing of the first cleaning mode.
17 . The control method of claim 15 , further comprising:
generating identification error information based on the determining that the foreign substance has not been removed after the performing of the first cleaning mode, the identification error information including information that the foreign substance is not a foreign substance attached to the lens of the camera nor the transparent member but a foreign substance inside the cooking chamber or a food to be cooked; and
controlling a communication device to transmit the identification error information to a server.
18 . The control method of claim 17 , further comprising:
controlling the communication device to transmit display information, which is to display the first foreign substance-related information on an external user device, to the server.
19 . The control method of claim 15 , wherein
the operating of the camera to obtain the first image and the identifying of the first foreign substance-related information are performed based on an opening of the door.