Electronic device and method for controlling same
Disclosed is a cooking apparatus including an image capturer for obtaining an image of food located in the cooking apparatus, a memory, and a processor configured to execute the instructions to cause the cooking apparatus to: obtain an image through the image capturer; obtain contamination level information according to a plurality of contamination detection techniques for detecting contamination of the image capturer based on the obtained image; identify a weight of the contamination level information based on at least one of a type of food or a cooking phase; obtain final contamination level information based on the contamination level information and the weight; and identify a contamination level of the image capturer based on the final contamination level information.
1 . A cooking apparatus comprising:
an image capturer for obtaining an image of food located in the cooking apparatus;
a memory configured to store instructions; and
a processor configured to execute the instructions to cause the cooking apparatus to:
obtain an image through the image capturer;
obtain contamination level information according to a plurality of contamination detection techniques for detecting contamination of the image capturer based on the obtained image;
identify a first weight corresponding to a first contamination detection technique, among the plurality of contamination detection techniques, of first contamination level information obtained according to the first contamination detection technique based on at least one of a type of food or a cooking phase;
identify a second weight corresponding to a second contamination detection technique, among the plurality of contamination detection techniques, of second contamination level information obtained according to the second contamination detection technique based on at least one of the type of food or the cooking phase; and
obtain final contamination level information based on the first contamination level information, the second contamination level information, the first weight, and the second weight.
2 . The cooking apparatus of claim 1 , wherein the plurality of contamination detection techniques comprise at least one of:
the first contamination detection technique for detecting contamination of the image capturer based on a change in brightness gradient of adjacent pixels in the obtained image,
the second contamination detection technique for detecting contamination of the image capturer based on a change in food contour on the obtained image,
a third contamination detection technique for detecting contamination of the image capturer based on a change in pixel information of the obtained image, or
a fourth contamination detection technique for detecting contamination of the image capturer by detecting reflection light of a lighting included in the cooking apparatus.
3 . The cooking apparatus of claim 2 , wherein the image capturer comprises:
a camera for capturing the image of the food; and
a transparent protection window provided between the camera and the food and for protecting the camera from heat or a foreign substance generated by the cooking apparatus,
wherein the plurality of contamination detection techniques comprise the fourth contamination detection technique, and the fourth contamination detection technique comprises:
a technique of emitting light generated by a lighting included in the cooking apparatus in a direction of the transparent protection window, and
detecting contamination of the image capturer based on the reflection light reflected by the transparent protection window.
4 . The cooking apparatus of claim 1 , wherein
the plurality of contamination detection techniques further comprise a (i) contamination detection technique, a (ii) contamination detection technique, a (iii) contamination detection technique, and fourth (iv) contamination detection technique,
wherein the (i) contamination detection technique comprises:
identifying a contamination level of the image capturer to be low based on a reduction amount of a brightness gradient of an adjacent pixel in the obtained image being small,
wherein the (ii) contamination detection technique comprises:
a technique of identifying the contamination level of the image capturer to be high based on a sharpness of the food contour being degraded on the obtained image or the change in pixel information corresponding to the contour increasing, and
identifying the contamination level of the image capturer to be low based on the sharpness of the food contour being degraded on the obtained image or the pixel information change corresponding to the food contour being small,
wherein the (iii) contamination detection technique comprises:
a technique of identifying the contamination level of the image capturer to be high based on the change in the pixel information increasing in the obtained image, and
identifying the contamination level of the image capturer to be low based on the change in the pixel information in the obtained image being small, and
wherein the (iv) contamination detection technique comprises:
a technique of identifying the contamination level of the image capturer to be high based on a degree of scattering of a reflection light reflected by a transparent protection window being higher, and
identifying the contamination level of the image capturer to be low based on the degree of scattering of the reflection light reflected by the transparent protection window being low,
wherein the first contamination detection technique is one of (i), (ii), (iii), and (iv) contamination detection techniques, and the second contamination detection technique is another one of (i), (ii), (iii), and (iv) contamination detection techniques.
5 . The cooking apparatus of claim 4 , wherein the processor is further configured to execute the instructions to cause the cooking apparatus to:
identify the contamination level of the image capturer by areas based on the obtained image, and
obtain the final contamination level information by areas based on the identified contamination level by areas.
6 . The cooking apparatus of claim 4 , wherein the processor is further configured to execute the instructions to cause the cooking apparatus to, based on the type of the food being identified as a food including oil or seasoning, identify a weight in which a third weight corresponding to the (i) contamination detection technique and a fifth weight corresponding to the (iii) contamination detection technique have a value greater than a fourth weight corresponding to the (ii) contamination detection technique.
7 . The cooking apparatus of claim 4 , wherein the processor is further configured to execute the instructions to cause the cooking apparatus to, based on the type of the food being identified as a food where moisture is generated by a cooking operation of the cooking apparatus, identify a weight in which a fourth weight corresponding to the (ii) contamination detection technique has a value greater than a third weight corresponding to the (i) contamination detection technique and a fifth weight corresponding to the (iii) contamination detection technique.
8 . The cooking apparatus of claim 4 , wherein the processor is further configured to execute the instructions to cause the cooking apparatus to, based on the cooking phase being a cooking phase after continuously applying heat to the food for a threshold time or more, identify a weight where a fourth weight corresponding to the (ii) contamination detection technique and a fifth weight corresponding to the (iii) contamination detection technique have a value greater than a third weight corresponding to the (i) contamination detection technique.
9 . The cooking apparatus of claim 4 , wherein the processor is further configured to execute the instructions to cause the cooking apparatus to, based on the cooking phase being a phase before cooking or after cooking, identify a weight where a fourth weight corresponding to the fourth contamination detection technique has a value greater than a third weight corresponding to the (i) contamination detection technique, the fourth weight corresponding to the (ii) contamination detection technique, and a fifth weight corresponding to the (iii) contamination detection technique.
10 . The cooking apparatus of claim 1 , wherein the processor is further configured to execute the instructions to cause the cooking apparatus to, based on identifying that the identified contamination of the image capturer is greater than or equal to a threshold value, provide a user with information about the identified contamination of the image capturer.
11 . A method of controlling a cooking apparatus comprising an image capturer, the method comprising:
obtaining an image through the image capturer;
obtaining contamination level information according to a plurality of contamination detection techniques for detecting contamination of the image capturer based on the obtained image;
identifying a first weight corresponding to a first contamination detection technique, among the plurality of contamination detection techniques, of first contamination level information obtained according to the first contamination detection technique, based on at least one of the type of food and a cooking phase;
identifying a second weight corresponding to a second contamination detection technique, among the plurality of contamination detection techniques, of second contamination level information obtained according to the second contamination detection technique based on at least one of the type of food or the cooking phase; and
obtaining final contamination level information based on the first contamination level information, the second contamination level information, the first weight, and the second weight.
12 . The method of claim 11 , wherein the plurality of contamination detection techniques comprise at least one of:
the first contamination detection technique for detecting contamination of the image capturer based on a change in brightness gradient of adjacent pixels in the obtained image, the second contamination detection technique for detecting contamination of the image capturer based on a change in food contour on the obtained image, a third contamination detection technique for detecting contamination of the image capturer based on a change in pixel information of the obtained image, or a fourth contamination detection technique for detecting contamination of the image capturer by detecting reflection light of a lighting included in the cooking apparatus.
13 . The method of claim 12 , wherein the image capturer comprises:
a camera for capturing the food; and
a transparent protection window located between the camera and the food and for protecting the camera from heat and a foreign substance generated by the cooking apparatus,
wherein the plurality of contamination detection techniques comprise the fourth contamination detection technique, and the fourth contamination detection technique comprises:
a technique of emitting light generated by a lighting included in the cooking apparatus in a direction of the transparent protection window, and
detecting contamination of the image capturer based on reflection light reflected by the transparent protection window.
14 . The method of claim 11 , wherein the plurality of contamination detection techniques further comprise a (i) contamination detection technique, a (ii) contamination detection technique, a (iii) contamination detection technique, and a (iv) contamination detection technique,
wherein the (i) contamination detection technique comprises:
identifying a contamination level of the image capturer to be low based on a reduction amount of a brightness gradient of an adjacent pixel in the obtained image being small,
wherein the (ii) contamination detection technique comprises:
a technique of identifying the contamination level of the image capturer to be high based on a sharpness of the food contour being degraded on the obtained image or the change in pixel information corresponding to the food contour increasing, and
identifying the contamination level of the image capturer to be low based on the sharpness of the food contour being degraded on the obtained image or the pixel information change corresponding to the food contour being small,
wherein the (iii) contamination detection technique comprises:
a technique of identifying the contamination level of the image capturer to be high based on the change in the pixel information increasing in the obtained image, and identifying the contamination level of the image capturer to be low based on the change in the pixel information in the obtained image being small, and
wherein the (iv) contamination detection technique comprises:
a technique of identifying the contamination level of the image capturer to be high based on a degree of scattering of a reflection light reflected by a transparent protection window being higher, and
identifying the contamination level of the image capturer to be low based on the degree of scattering of the reflection light reflected by the transparent protection window being low,
wherein the first contamination detection technique is one of (i), (ii), (iii), and (iv) contamination detection techniques, and the second contamination detection technique is another one of (i), (ii), (iii), and (iv) contamination detection techniques.
15 . The method of claim 14 , wherein the obtaining the contamination level information comprises:
identifying the contamination level of the image capturer by areas based on the obtained image; and
obtaining the final contamination level information by areas based on the identified contamination level by areas.