IP Library › Granted Patent US 11,741,424
Granted Patent B2
US 11,741,424 · App. 16/485,761 · Granted Aug 29, 2023

Artificial intelligent refrigerator and method of storing food thereof

Inventor: Hyojoon Im (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06Q10/087F25D29/005H04N23/57F25D2500/06F25D2600/00F25D2700/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,741,424
App. No.
16/485,761
Granted
Aug 29, 2023
Kind
B2
Abstract

Disclosed is a method of storing food in an artificial intelligent refrigerator including obtaining an image of a storage chamber through a camera installed in the storage chamber of the refrigerator; transmitting the obtained image to a server; receiving a recognition result of food newly stored in the storage chamber through AI image processing in the server from the server; and displaying notifying information related to the food in a display unit of the refrigerator based on the received result.

Claims (53)

1. A method of storing food in an artificial intelligent refrigerator, the method comprising:

obtaining an image of a storage chamber through a camera installed in the storage chamber of the refrigerator;

transmitting the obtained image to a server;

receiving a recognition result of food newly stored in the storage chamber through AI image processing in the server from the server; and

displaying notifying information related to the food in a display unit of the refrigerator based on the received result,

wherein the displaying of notifying information comprises:

extracting search data comprising a name, a production date, and a manufacturer of the food from the image transmitted to the server and receiving a search result of an accident history related to food safety based on the extracted data from the server; and

generating, when the accident history exists, the notifying information comprising accident contents and an image related to the food based on the found accident history, wherein the notification information is a message guiding a storage method of the food, wherein the message comprises a first area and a second area,

wherein the first area includes a text that describes a method of storing new food, and the second area describes the storage method as an image, and

wherein at least one area of the first area and the second area further includes link information connected to video or a text that describes the storage method.

2. The method of claim 1 , wherein the image of the storage chamber comprises a first image obtained at an opening time of a door of the refrigerator and a second image obtained at a closing time of the door of the refrigerator after the first image is obtained.

3. The method of claim 1 , further comprising:

after displaying the notification information,

obtaining a new image of the storage chamber in which the food is stored;

transmitting the new image to the server;

comparing the new image with the previously obtained image and receiving a result determining whether the food is being stored at the storage chamber from the server; and

displaying again the notifying information in the display unit when the food is being stored at the storage chamber.

4. The method of claim 1 , wherein the refrigerator further comprises a plurality of shelves for partitioning the storage chamber into a plurality of storage compartments,

wherein the camera is provided in plurality, each of the plurality of cameras being separately installed in each of the plurality of storage compartments, and

wherein the storage image is an image obtained when the camera photographs each of the plurality of storage compartments.

5. The method of claim 1 , further comprising:

establishing a communication connection with a server of 5G communication networks through a communication unit of the artificial intelligent refrigerator;

performing an initial access procedure with the artificial intelligent refrigerator by periodically transmitting a synchronization signal block (SSB);

performing a random access procedure with the artificial intelligent refrigerator;

transmitting an uplink (UL) grant to the artificial intelligent refrigerator for scheduling message transmission; and

performing a downlink beam management (DL BM) procedure using the SSB,

wherein the performing the DL BM procedure further includes:

transmitting a CSI-ResourceConfig IE including a CSI-SSB-ResourceSetList to the artificial intelligent refrigerator;

transmitting a signal on SSB resources to the artificial intelligent refrigerator; and

receiving a best SSBRI and corresponding RSRP from the artificial intelligent refrigerator.

6. An artificial intelligent refrigerator for storing food, the artificial intelligent refrigerator comprising:

a memory for storing data; and

a processor for controlling an operation of the refrigerator,

wherein the processor is configured to:

obtain an image of a storage chamber through a camera installed in the storage chamber of the refrigerator;

transmit the obtained image to a server;

receive a recognition result of food newly stored in the storage chamber through AI image processing in the server from the server; and

display notifying information related to the food in a display unit of the refrigerator based on the received result,

wherein the processor is configured to:

extract search data comprising a name, a production date, and a manufacturer of the food from the image transmitted to the server to receive a search result of an accident history related to food safety from the server based on the extracted data; and

generate, when the accident history exists, the notifying information comprising accident contents and an image related to the food based on the found accident history, wherein the notification information is a message guiding a storage method of the food, wherein the message comprises a first area and a second area,

wherein the first area includes a text that describes a method of storing new food, and the second area describes a storage method as an image, and

wherein at least one area of the first area and the second area further includes link information connected to video or a text that describes the storage method.

7. The artificial intelligent refrigerator of claim 6 , wherein the image of the storage chamber comprises a first image obtained at an opening time of a door of the refrigerator and a second image obtained at a closing time of the door of the refrigerator after the first image is obtained.

8. The artificial intelligent refrigerator of claim 6 , wherein the processor is configured to:

after displaying the notification information,

obtain a new image of the storage chamber in which the food is stored;

transmit the new image to the server;

compare the new image with the previously obtained image to receive a result determining whether the food is being stored at the storage chamber from the server; and

display again the notifying information in the display unit when the food is being stored at the storage chamber.

9. The artificial intelligent refrigerator of claim 6 , further comprising a plurality of shelves for partitioning the storage chamber into a plurality of storage compartments,

wherein the camera is provided in plurality, each of the plurality of cameras being separately installed in each of the plurality of storage compartments, and

wherein the storage image is an image obtained when the camera photographs each of the plurality of storage compartments.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2019
From: IM, HYOJOON
To: LG ELECTRONICS INC.
Reel/Frame 050056/0184 →
Continuity (1)
Related Publication 20190354926A1 · Nov 21, 2019