Cooking apparatus and method of controlling the same

1 . A cooking apparatus comprising:

a chamber;

a camera configured to photograph a cooking object placed in the chamber; and

a controller to be electrically connected to the camera,

wherein the controller is configured to:

control the camera to acquire a plurality of image frames of the cooking object placed in the chamber while cooking of the cooking object is being performed,

identify a change in a state of the cooking object in the chamber from the acquired plurality of image frames,

extract a portion of image frames among the acquired plurality of image frames based on the change in the state of the cooking object, and add a sound corresponding to the change in the state of the cooking object to the extracted portion of image frames to generate a summary video of a cooking process, the summary video of the cooking process including the extracted portion of image frames with the sound corresponding to the change in the state of the cooking object.

2 . The cooking apparatus of claim 1 , wherein the controller is configured to:

generate a raw video based on the acquired plurality of image frames,

divide the generated raw video into a plurality of sections based on the change in the state of the cooking object; and

extract at least one image frame from each of the divided plurality of sections to acquire the extracted portion of image frames.

3 . The cooking apparatus of claim 2 , wherein the controller is configured to:

compare a reference image frame with each of the acquired plurality of image frames to determine an amount of the change in the state of the cooking object in each of the acquired plurality of image frames;

detect at least one of a phase-change section in which a slope of the amount of the change in the state of the cooking object is greater than or equal to a predetermined threshold value and a phase-holding section in which a slope of the amount of the change in the state of the cooking object is less than the threshold value; and

divide the raw video into the plurality of sections based on the at least one of the phase-change section and the phase-holding section.

4 . The cooking apparatus of claim 2 , wherein the controller is configured to, based on the change in the state of the cooking object being different in each of the divided plurality of sections, add a different sound to each of the divided plurality of sections.

5 . The cooking apparatus of claim 4 , further comprising a memory that stores a sound matching table including sound information that matches with a property of the cooking object and a change in a state of the cooking object,

wherein the controller is configured to use the sound matching table to determine the sound to be added to each of the divided plurality of sections.

6 . The cooking apparatus of claim 1 , further comprising a memory that stores a sound matching table including sound information that matches with at least one property of the cooking object and a change in a state of the cooking object,

wherein the controller is configured to:

based on a plurality of cooking objects being identified in the chamber, identify properties of the plurality of cooking objects and changes in states of the plurality of cooking objects;

synthesize a plurality of sounds respectively matching with the properties of the plurality of cooking objects and the changes in the states of the plurality of cooking objects to generate a harmonious sound; and

add the harmonious sound to the extracted portion of image frames.

7 . The cooking apparatus of claim 6 , wherein the controller is configured to determine a volume of each of the plurality of sounds to be different based on the property of each of the plurality of cooking objects.

8 . The cooking apparatus of claim 1 , wherein the controller is configured to insert metadata including time information, cooking object state information and sound information into each of the image frames in the extracted portion.

9 . The cooking apparatus of claim 1 , wherein the controller is configured to detect at least one of a change in a size of the cooking object, a change in a form of the cooking object, a change in a color of the cooking object, and a change in a texture of the cooking object to identify the change in the state of the cooking object.

10 . The cooking apparatus of claim 1 , further comprising a communication circuit configured to communicate with a server,

wherein the controller is configured to control the communication circuit to transmit, to the server, display information to display the summary video to a user device.

11 . A method of controlling a cooking apparatus, the method comprising:

controlling a camera to acquire a plurality of image frames of a cooking object placed in a chamber while cooking of the cooking object is being performed;

identifying a change in a state of a cooking object in the chamber from the acquired plurality of image frames;

extracting a portion of image frames among the acquired plurality of image frames based on the change in the state of the cooking object; and

generating a summary of video of a cooking process by adding a sound corresponding to the change in the state of the cooking object to the extracted portion of image frames, the summary video of the cooking process including the extracted portion of image frames with the sound corresponding to the change in the state of the cooking object.

12 . The method of claim 11 , wherein the extracting of the portion of image frames includes:

generating a raw video based on the acquired plurality of image frames;

dividing the generated raw video into a plurality of sections based on the change in the state of the cooking object; and

extracting at least one image frame from each of the divided plurality of sections to acquire the extracted portion of image frames.

13 . The method of claim 12 , wherein the dividing into the plurality of sections includes:

comparing a reference image frame with each of the acquired plurality of image frames to determine an amount of the change in the state of the cooking object in each of the acquired plurality of image frames;

detecting at least one of a phase-change section in which a slope of the amount of the change in the state of the cooking object is greater than or equal to a predetermined threshold value and a phase-holding section in which a slope of the amount of the change in the state of the cooking object remains less than the threshold value; and

dividing the raw video into the plurality of sections based on the at least one of the phase-change section and the phase-holding section.

14 . The method of claim 12 , wherein the generating of the summary video includes, based on the change in the state of the cooking object being different in each of the divided plurality of sections, adding a different sound to each of the divided plurality of sections.

15 . The method of claim 14 , wherein the generating of the summary video includes:

acquiring a sound matching table including sound information that matches with a property of the cooking object and a change in a state of the cooking object; and

using the sound matching table to determine the sound to be added to each of the divided plurality of sections.

16 . The method of claim 11 , wherein the identifying of the change in the state of the cooking object includes, based on a plurality of cooking objects being identified in the chamber, identifying properties of the plurality of cooking objects and changes in states of the plurality of cooking objects, and the generating of the summary video include:

acquiring a sound matching table including sound information that matches with a property of the cooking object and a change in a state of the cooking object;

generating a harmonious sound by synthesizing a plurality of sounds respectively matching with the properties of the plurality of cooking objects and the changes in the states of the plurality of cooking objects; and

adding the harmonious sound to the extracted portion of image frames.

17 . The method of claim 16 , wherein the generating of the harmonious sound includes determining a volume of each of the plurality of sounds to be different based on the property of each of the plurality of cooking objects.

18 . The method of claim 16 , wherein the generating of a harmonious sound includes inserting metadata including time information, cooking object state information and sound information into each of the image frames in the extracted portion.

19 . The method of claim 11 , wherein the identifying of the change in the state of the cooking object includes detecting at least one of a change in a size of the cooking object, a change in a form of the cooking object, a change in a color of the cooking object, and a change in a texture of the cooking object.

20 . The method of claim 11 , further comprising controlling a communication circuit to transmit, to a server, display information for displaying the summary video to a user device.