IP Library Granted Patent US 50,269
Granted Patent E1
US 50,269 · App. 17/200,309 · Granted Jan 14, 2025

Refrigerator with camera and control method for the same

Inventors: Kwanhyung Kim (Seoul, KR); Samnyol Hong (Seoul, KR); Sungdu Kwon (Seoul, KR); Ikkyu Lee (Seoul, KR); Myoungju Lee (Seoul, KR); Jeonghwan Kim (Seoul, KR)
Assignee: LG Electronics Inc.
F25D29/00F25D11/00F25D23/00F25D23/02F25D23/028F25D23/04F25D23/062F25D23/067F25D23/12F25D25/025F25D27/00F25D29/005G02B27/0006G03B29/00G06F18/22G06T7/11G06T7/20G06T7/246G06T7/254G06T7/33G06T7/60G06T7/73G06T7/90G06V40/20H04N5/2621H04N5/2624H04N7/18H04N23/51H04N23/52H04N23/54H04N23/55H04N23/57H04N23/633F25D2201/10F25D2300/00F25D2323/021F25D2400/02F25D2400/361F25D2500/06F25D2600/00F25D2700/02F25D2700/06G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 50,269
App. No.
17/200,309
Granted
Jan 14, 2025
Kind
E1
Abstract

A refrigerator includes a storage compartment formed in a cabinet of the refrigerator by a fixed insulation wall, the storage compartment being provided with an access opening. The refrigerator also includes a door rotatably provided to the cabinet to open and close the access opening, a drawer provided in the storage compartment, a camera fixed to a ceiling of the storage compartment to photograph both a first region for storing of food arranged in an external space of the drawer and a second region for storing of food arranged in an internal space of the drawer, and a controller configured to separate, through a capturing time of a picture containing both the first region and the second region, a first region picture and a second region picture from the picture to individually divide and store the first region picture and the second region picture.

Claims (40)

1. A refrigerator comprising:

a cabinet in which a storage compartment is defined by a fixed insulation wall, the storage compartment configured to store food and having an access opening;

a door rotatably provided at the cabinet and configured to open and close the access opening of the storage compartment;

a drawer provided in the storage compartment;

a shelf provided in the storage compartment and arranged above the drawer;

a camera disposed in the storage compartment and configured to take a photo of an interior of the storage compartment; and

at least one processor configured to divide the photo taken by the camera into a plurality of images corresponding to a plurality of regions inside the refrigerator,

wherein the plurality of regions includes a region that is defined by at least one of the shelf or the drawer in the storage compartment, and

wherein the camera is configured to take a photo of the region inside the drawer based on the drawer being withdrawn.

2. The refrigerator according to claim 1 , wherein the plurality of regions comprises an internal space of the drawer and an external space of the drawer, and

wherein the external space of the drawer is inside of the cabinet and outside of the drawer.

3. The refrigerator according to claim 1 , wherein the plurality of regions comprises a first region for storing food defined in an external space of the drawer on the shelf in the storage compartment, and a second region for storing food defined in an internal space of the drawer, and

wherein the external space is inside of the cabinet and outside of the drawer.

4. The refrigerator according to claim 3 7 , wherein the plurality of regions further comprises a third region defined under the drawer, the third region vertically overlapping with the drawer in a state in which the drawer is withdrawn.

5. The refrigerator according to claim 4 , wherein at least two regions among the plurality of regions are arranged at different heights from each other in the storage compartment.

6. The refrigerator according to claim 4 , wherein the first region, the second region, and the third region are arranged sequentially along a vertical direction.

7. The refrigerator according to claim 4 3 , wherein the camera is configured to take the photo of the interior of the storage compartment by taking a photo that captures the plurality of regions inside the refrigerator together.

8. The refrigerator according to claim 7 4 , wherein the camera is configured to take the photo that captures the plurality of regions inside the refrigerator by taking a photo that captures the first region and the second region.

9. The refrigerator according to claim 8 , wherein the at least one processor is configured to divide the photo taken by the camera into the plurality of images corresponding to the plurality of regions inside the refrigerator by:

dividing the photo taken by the camera into a first image and a second image corresponding to the first region and the second region, respectively.

10. The refrigerator according to claim 7 4 , wherein the camera is configured to take the photo that captures the plurality of regions inside the refrigerator by taking a photo that captures the first region and the third region together.

11. The refrigerator according to claim 10 , wherein the at least one processor is configured to divide the photo taken by the camera into the plurality of images corresponding to the plurality of regions inside the refrigerator by:

dividing the photo taken by the camera into a first image and a third image corresponding to the first region and the third region, respectively.

12. The refrigerator according to claim 7 4 , further comprising a display,

wherein the at least one processor is further configured to control the display to display at least one of the first region, the second region, or the third region.

13. The refrigerator according to claim 12 , wherein the at least one processor is further configured to control the display to simultaneously display the first region, the second region, and the third region.

14. The refrigerator according to claim 12 , wherein the at least one processor is further configured to control the display to display one among the first region, the second region, or the third region.

15. The refrigerator according to claim 4 , wherein the third region is located at a bottom of the storage compartment and is exposed to the an external space of the drawer in a state in which the drawer is inserted, the external space of the drawer being located inside of the cabinet and outside of the drawer.

16. The refrigerator according to claim 4 , wherein the third region is configured to store food.

17. The refrigerator according to claim 4 , further comprising a barrier arranged below the drawer and extending horizontally in the storage compartment to partition the storage compartment, the barrier defining a recessed portion configured to store food,

wherein the third region includes the recessed portion.

18. The refrigerator according to claim 17 , wherein the barrier is arranged to partition the storage compartment into a freezer compartment and a fresh food compartment.

19. The refrigerator according to claim 12 , wherein the at least one processor is further configured to control the display to display the third region together with the second region regardless of the drawer being in the withdrawn state.

20. The refrigerator according to claim 1 , wherein the at least one processor is configured to replace the plurality of images with updated images individually.

21. The refrigerator according to claim 4 , wherein the third region vertically overlaps with the drawer in a state in which the drawer is withdrawn.

22. The refrigerator according to claim 1 , wherein the camera is disposed in the storage compartment outside of the drawer.

23. The refrigerator according to claim 22 , wherein the camera is disposed above the drawer.

24. The refrigerator according to claim 23 , wherein the camera is disposed at a ceiling of the storage compartment.

25. The refrigerator according to claim 7 , wherein the camera is a single camera.

26. The refrigerator according to claim 24 , wherein the camera is disposed between a front edge of the shelf and the access opening of the cabinet.

Priority Claims (5)
KR 10-2013-0044528 · Apr 23, 2013 · national
KR 10-2013-0124739 · Oct 18, 2013 · national
KR 10-2014-0045066 · Apr 15, 2014 · national
KR 10-2014-0045067 · Apr 15, 2014 · national
KR 10-2014-0045068 · Apr 15, 2014 · national
Continuity (3)
Continuation 14930012 · Nov 2, 2015
Continuation 14786719
Reissue 15721140 · Sep 29, 2017
References Cited (123)
US 4716404A · Tabata · 1987 [cited by examiner]
US 6178763B1 · Brancheau · 2001 [cited by applicant]
US 6303225B1 · Veerasamy · 2001 [cited by applicant]
US 8810397B2 · Wieser · 2014 [cited by applicant]
US 10951863B2 · Marutani · 2021 [cited by examiner]
US 20030046887A1 · Chubb · 2003 [cited by applicant]
US 20030131541A1 · Lee · 2003 [cited by applicant]
US 20040050076A1 · Palfy · 2004 [cited by applicant]
US 20060096303A1 · Kavounas · 2006 [cited by applicant]
US 20080103939A1 · Gibb · 2008 [cited by applicant]
US 20100170289A1 · Graziano · 2010 [cited by applicant]
US 20110005255A1 · Tanihata · 2011 [cited by applicant]
US 20110314859A1 · Higami et al. · 2011 [cited by applicant]
US 20120014487A1 · Dabiri et al. · 2012 [cited by applicant]
US 20120023971A1 · Min et al. · 2012 [cited by applicant]
US 20120144847A1 · Lee · 2012 [cited by applicant]
US 20120227423A1 · Johnson · 2012 [cited by applicant]
US 20130015753A1 · Son et al. · 2013 [cited by applicant]
US 20130129166A1 · Muller et al. · 2013 [cited by applicant]
US 20140137587A1 · Hitzelberger · 2014 [cited by applicant]
US 20140168396A1 · Kempiak · 2014 [cited by applicant]
US 20140293060A1 · Ryu · 2014 [cited by examiner]
US 20140300265A1 · Lee · 2014 [cited by applicant]
US 20140333598A1 · Shi · 2014 [cited by applicant]
US 20160057394A1 · Marutani et al. · 2016 [cited by applicant]
US 20160138859A1 · Stimpfig · 2016 [cited by examiner]
CN 1128972 · 2003 [cited by applicant]
CN 1519524 · 2004 [cited by applicant]
CN 1683860 · 2005 [cited by applicant]
CN 101068344 · 2007 [cited by applicant]
CN 101196980 · 2008 [cited by applicant]
CN 101202935 · 2008 [cited by applicant]
CN 201623800 · 2010 [cited by applicant]
CN 102032740 · 2011 [cited by applicant]
CN 102165469 · 2011 [cited by applicant]
CN 202281453 · 2012 [cited by applicant]
CN 102741633 · 2012 [cited by applicant]
CN 103017475 · 2013 [cited by applicant]
CN 202885429 · 2013 [cited by applicant]
CN 202993741 · 2013 [cited by applicant]
EP 2541174 · 2013 [cited by applicant]
JP 05045041 · 1993 [cited by applicant]
JP 08049958A · 1996 [cited by examiner]
JP 11083282 · 1999 [cited by applicant]
JP 2001294308 · 2001 [cited by applicant]
JP 2002243335 · 2002 [cited by applicant]
JP 2002267337 · 2002 [cited by applicant]
JP 2002295959 · 2002 [cited by applicant]
JP 2003042626 · 2003 [cited by applicant]
JP 2003090673 · 2003 [cited by applicant]
JP 2003207258 · 2003 [cited by applicant]
JP 03450907 · 2003 [cited by applicant]
JP 3450907B2 · 2003 [cited by examiner]
JP 2003321107 · 2003 [cited by applicant]
JP 2004183987 · 2004 [cited by applicant]
JP 2005030607 · 2005 [cited by applicant]
JP 2010121784 · 2010 [cited by applicant]
JP 2012168666 · 2012 [cited by applicant]
JP 2012193873 · 2012 [cited by applicant]
JP 2012251722 · 2012 [cited by applicant]
JP 2012251724 · 2012 [cited by applicant]
JP 2012251724A · 2012 [cited by examiner]
JP 2014070796 · 2014 [cited by applicant]
KR 1019970028356 · 1997 [cited by applicant]
KR 200374125 · 2005 [cited by applicant]
KR 1020060099985 · 2006 [cited by applicant]
KR 1020120003036 · 2012 [cited by applicant]
KR 20140040458A · 2014 [cited by examiner]
WO 2005015510 · 2005 [cited by applicant]
WO 2008029159 · 2008 [cited by applicant]
WO 2015029824 · 2015 [cited by applicant]
Extended European Search Report issued in European Application No. 14788514.9 on Nov. 2, 2015, 6 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15189491.2 on Mar. 9, 2016, 6 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15185839.6 on Mar. 10, 2016, 7 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15185971.7 on Mar. 18, 2016, 7 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15201309.0 on Apr. 7, 2016, 7 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15201331.4 on Apr. 20, 2016, 7 pages. [cited by applicant]
Notice of Allowance issued in Korean Application No. 10-2015-0150363 on Sep. 13, 2016, 3 pages (with English translation). [cited by applicant]
Notice of Allowance issued in U.S. Appl. No. 14/929,888 on Sep. 6, 2016, 10 pages. [cited by applicant]
Office Action issued in Chinese Application No. 201480011747.5 on Jul. 1, 2016, 10 pages (with English translation). [cited by applicant]
Office Action issued in U.S. Appl. No. 14/786,719 on May 10, 2016, 9 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/929,845 on Apr. 21, 2016, 17 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/929,888 on May 2, 2016, 11 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/929,978 on Apr. 20, 2016, 10 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/930,012 on May 10, 2016, 15 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/930,057 on Apr. 20, 2016, 10 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/930,444 on Apr. 20, 2016, 10 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/950,520 on May 20, 2016, 19 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/950,419 on Apr. 26, 2016, 17 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/950,466 on May 10, 2016, 18 pages. [cited by applicant]
Chinese Office Action in Chinese Application No. 201610127539.2, dated Oct. 24, 2017, 16 pages (with English translation). [cited by applicant]
International Search Report dated Aug. 4, 2014 for PCT/KR2014/003523, 4 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 14788514.9 dated Nov. 2, 2015, 6 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15189491.2 dated Mar. 9, 2016, 6 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15185839.6 dated Mar. 10, 2016, 7 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15185971.7 dated Mar. 18, 2016, 7 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15201309.0 dated Apr. 7, 2016, 7 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/929,845 dated Apr. 21, 2016, 17 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/950,419 dated Apr. 26, 2016, 17 pages. [cited by applicant]
Extended European Search Report issued in European Application No. 15201331.4 dated Apr. 20, 2016, 7 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/786,719 dated May 10, 2016, 9 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/950,520 dated May 20, 2016, 19 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/929,978 dated Apr. 20, 2016, 10 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/930,057 dated Apr. 20, 2016, 10 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/929,888 dated May 2, 2016, 11 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/930,012 dated May 10, 2016, 15 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/930,444 dated Apr. 20, 2016, 10 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 14/950,466 dated May 10, 2016, 18 pages. [cited by applicant]
Office Action issued in Chinese Application No. 201480011747.5 dated Jul. 1, 2016, 10 pages (with English translation). [cited by applicant]
Notice of Allowance issued in U.S. Appl. No. 14/929,888 dated Sep. 6, 2016, 10 pages. [cited by applicant]
Notice of Allowance issued in Korean Application No. 10-2015-0150363 dated Sep. 13, 2016, 3 pages (with English translation). [cited by applicant]
“WP-DC44 Waterproof Case for PowerShot G1.” N.p., Mar. 19, 2012. Web. Jan. 30, 2017. <https://www.bhphotovideo.com/c/product/839525-REG/Canon_5969B001_WP_DC44_WATERPROOF_CASE_FOR.html>. 4 pages. [cited by applicant]
United States Office Action in U.S. Appl. No. 14/930,012, dated Mar. 23, 2017, 10 pages. [cited by applicant]
United States Office Action in U.S. Appl. No. 14/929,845, dated Feb. 6, 2017, 14 pages. [cited by applicant]
Chinese Office Action in Chinese Application No. 201510795232.5, dated Apr. 5, 2017, 14 pages (with English translation). [cited by applicant]
Chinese Office Action in Chinese Application No. 201510796450.0, dated Apr. 5, 2017, 16 pages (with English translation). [cited by applicant]
Chinese Office Action in Chinese Application No. 201510796557.5, dated Apr. 17, 2017, 21 pages (with English translation). [cited by applicant]
Chinese Office Action in Chinese Application No. 201510796498.1, dated Apr. 19, 2017, 10 pages (with English translation). [cited by applicant]
Chinese Office Action in Chinese Application No. 2017052701460220, dated Jun. 2, 2017, 19 pages (with English translation). [cited by applicant]
Office Action issued in U.S. Appl. No. 14/930,012, dated Jul. 13, 2017, 12 pages. [cited by applicant]
Chinese Office Action in Chinese Application No. 201610127404.6, dated Aug. 25, 2017, 13 pages (with English translation). [cited by applicant]
United States Office Action in U.S. Appl. No. 15/720,989, dated Mar. 29, 2018, 13 pages. [cited by applicant]
Google.com [online], “Definition of Between,” retrieved on May 29, 2018, retrieved from: URL: <https://www.google.com/search?q=Dictionary>, 1 page. [cited by applicant]