Artificially intelligent computing device and refrigerator control method using the same

1. A method for controlling a refrigerator, the method comprising:

capturing an image of food stored inside of the refrigerator;

comparing the captured image with a preconfigured image, wherein the captured image corresponds to a current frame and the preconfigured image corresponds to a previous frame with respect to the current frame;

transmitting storage information of the food to a cloud network according to a comparison result;

learning the transmitted storage information of the food;

determining a stock state of the food based on the storage information of the food; and

transmitting a stock information of a deficient food depending on the determined stock state; and

receiving a message including an advertisement corresponding to the deficient food,

wherein the stock information of the food is transmitted to at least one of the cloud network, a preconfigured smart device or a server depending on the determined stock state, and

wherein the refrigerator receives an estimated advertisement cost from the cloud network or the server according to a time when an advertisement message is displayed on the refrigerator.

2. The method of claim 1 , wherein information corresponding to a user of the refrigerator is stored or modified before capturing the image of the food.

3. The method of claim 1 , wherein capturing the image of the food includes:

partitioning an interior of the refrigerator into at least one area;

capturing images of each of the partitioned at least one area; and

synthesizing each of the captured images of the partitioned at least one area into a single image.

4. The method of claim 3 , wherein transmitting the storage information of the food includes obtaining the storage information of the food based on a determination that the preconfigured image is different from the captured image.

5. The method of claim 1 , wherein the cloud network is configured to:

analyze personal storage information for each user for displaying the transmitted storage information of the food, and transmit a value for the storage information of the food to the refrigerator based on a determination that the displayed storage information of the food is sold.

6. The method of claim 1 , wherein determining the stock state of the food includes:

extracting feature values from the learned transmitted storage information;

inputting the extracted feature values in an artificial neural network (ANN) to identify the stock state of the food; and

determining the stock state of the food based on an output of the ANN.

7. The method of claim 6 , wherein the feature values are values that distinguish the stock state of the food.

8. The method of claim 1 , wherein the storage information of the food includes at least one of a motion count of the food, a change of amount for the food, a storage period for the food, a category of the food, or a package of the food.

9. The method of claim 1 , further comprising receiving Downlink Control Information (DCI) used for scheduling a transmission of the storage information of the food obtained from a camera from a network, wherein the storage information of the food is transmitted to the network based on the DCI.

10. The method of claim 9 , further comprising performing an initial access process with the network based on a Synchronization signal block (SSB),

wherein the storage information of the food is transmitted to the network through a physical uplink shared channel (PUSCH), and

wherein the SSB and a demodulation reference signal (DM-RS) of the PUSCH are quasi co-located (QCL) with respect to QCL type D.

11. The method of claim 9 , further comprising:

controlling a transceiver to transmit the storage information of the food to an artificial intelligence (AI) processor included in the network; and

controlling the transceiver to receive AI processed information from the AI processor, wherein the received AI processed information corresponds to information for determining the stock state of the food.

12. An artificially intelligent computing device for controlling a refrigerator, comprising:

a camera provided in the refrigerator;

a processor; and

a memory for storing a command executable by the processor,

wherein the processor controls the refrigerator to:

capture an image of food stored inside of the refrigerator by controlling the camera;

compare the captured image with a preconfigured previous image, wherein the captured image corresponds to a current frame and the preconfigured image corresponds to a previous frame with respect to the current frame, and

transmit storage information of the food to a cloud network or a server according to a comparison result;

learn the transmitted storage information of the food;

determine a stock state of the food based on the storage information of the food;

transmit a stock information of a deficient food depending on the determined stock state; and

receive a message including an advertisement corresponding to the deficient food from the cloud network or the server,

wherein the stock information of the food is transmitted to at least one of the cloud network, a preconfigured smart device or a server depending on the determined stock state, and

wherein the refrigerator receives an estimated advertisement cost from the cloud network or the server according to a time when an advertisement message is displayed on the refrigerator.

13. The artificially intelligent computing device of claim 12 , wherein capturing the image of food includes:

partitioning an interior of the refrigerator into at least one area,

capturing images of each of the partitioned at least one area; and

synthesize each of the captured images of the partitioned at least one area into a single image.

14. The artificially intelligent computing device of claim 13 , wherein the processor is further configured to:

obtain the storage information of the food based on a determination that the preconfigured image is different from the captured image; and

transmit the obtained storage information of the food to the cloud network.

15. The artificially intelligent computing device of claim 12 , wherein the cloud network is further configured to:

display the transmitted storage information of the food by analyzing personal storage information for each user, and

receive a value for the storage information of the food to the refrigerator based on a determination that the displayed storage information of the food is sold.

16. The artificially intelligent computing device of claim 12 , wherein the processor is further configured to:

extract feature values from the learned transmitted storage information, wherein the feature values are values that distinguish the stock state of the food,

input the extracted feature values in an artificial neural network (ANN) to identify the stock state of the food, and

determine the stock state of the food based on an output of the ANN.

17. The artificially intelligent computing device of claim 12 , wherein the storage information of the food includes at least one of a motion count of the food, a change of amount for the food, a storage period for the food, a category of the food, or a package of the food.