IP Library Granted Patent US 12,561,981
Granted Patent B2
US 12,561,981 · App. 18/546,576 · Granted Feb 24, 2026

Storage-retrieval management device, storage-retrieval management system, and storage-retrieval management method

Inventors: Kazuhiro Mochinaga (Osaka, JP); Taku Kariyazaki (Osaka, JP); Wataru Suda (Osaka, JP); Shinichi Horii (Shiga, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06V20/52F25D23/028G06T7/246G06V20/68F25D2500/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,561,981
App. No.
18/546,576
Granted
Feb 24, 2026
Kind
B2
Abstract

A storage-retrieval management device includes: an image capturer that captures, from above a refrigerator that includes a main body and a door attached to the main body, images of the refrigerator with the door in an open state; a setter that sets a boundary along contours of the main body and the door in the images; and a determiner that determines whether an object is stored into the refrigerator or whether the object is retrieved from the refrigerator, based on whether the object is moved beyond the boundary that is set, the object being captured in one or more of the images.

Claims (45)

1 . A storage-retrieval management device comprising:

one or more first memories; and

at least one first processor coupled to at least one of the one or more first memories and configured to perform:

capturing from above a repository that includes a main body and a door attached to the main body, images of the repository with the door in an open state;

setting a boundary in the images; and

determining whether an object is stored into the repository or whether the object is retrieved from the repository, based on whether the object is moved beyond the boundary that is set, the object being captured in one or more of the images, wherein when setting the boundary, a line along contours of the main body and the door is set as the boundary, and the boundary includes a first portion along the door in the open state and a second portion along the main body, the second portion being different from the first portion.

2 . The storage-retrieval management device according to claim 1 ,

wherein the setting comprises performing, on the images, image processing for detecting the contours, and setting the boundary based on the contours detected.

3 . The storage-retrieval management device according to claim 2 ,

wherein the at least one first processor is further configured to perform extracting the contours by detecting a border between the repository and a floor with use of edge detection processing as the image processing.

4 . The storage-retrieval management device according to claim 1 ,

wherein the determining further comprises determining a type of the object, and

the at least one first processor is further configured to perform informing that gives notice when the type of the object is indeterminable.

5 . A storage-retrieval management system comprising:

the storage-retrieval management device according to claim 1 ; and

a notification device,

wherein the notification device includes:

one or more second memories; and

at least one second processor coupled to at least one of the one or more second memories and configured to perform:

receiving, from the storage-retrieval management device, information indicating that the object is stored into or retrieved from the repository; and

notifying an information terminal device possessed by a user of the repository when the information is received during a period in which the user is not adjacent to the repository.

6 . A storage-retrieval management system comprising:

the storage-retrieval management device according to claim 1 ; and

the repository.

7 . The storage-retrieval management device according to claim 1 ,

wherein

the line set as the boundary is a line that connects at least three points on the contours.

8 . The storage-retrieval management device according to claim 1 , wherein the boundary line is a polygonal line that includes the first portion and the second portion.

9 . The storage-retrieval management device according to claim 1 , wherein the first portion is a polygonal line.

10 . A storage-retrieval management device comprising:

one or more first memories; and

at least one first processor coupled to at least one of the one or more first memories and configured to perform:

capturing from above a repository that includes a main body and a door attached to the main body, images of the repository with the door in an open state;

setting, as a boundary in the images, a line along contours of the main body and the door selected from one of boundary candidates determined in advance, according to a degree to which the door is opened; and

determining whether an object is stored into the repository or whether the object is retrieved from the repository, based on whether the object is moved beyond the boundary that is set, the object being captured in one or more of the images.

11 . The storage-retrieval management device according to claim 10 ,

wherein the setting comprises performing, on the images, image processing for detecting the contours, and setting the boundary based on the contours detected.

12 . The storage-retrieval management device according to claim 10 ,

wherein the determining further comprises determining a type of the object, and

the at least one first processor is further configured to perform informing that gives notice when the type of the object is indeterminable.

13 . A storage-retrieval management method comprising:

capturing from above a repository that includes a main body and a door attached to the main body, images of the repository with the door in an open state;

setting a boundary in the images; and

determining whether an object is stored into the repository or whether the object is retrieved from the repository, based on whether the object is moved beyond the boundary that is set, the object being captured in one or more of the images, wherein when setting the boundary, a line along contours of the main body and the door is set as the boundary, and the boundary includes a first portion along the door in the open state and a second portion along the main body, the second portion being different from the first portion.

14 . A non-transitory computer-readable recording medium having recorded thereon a program for causing a computer to execute the storage-retrieval management method according to claim 13 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2023
From: MOCHINAGA, KAZUHIRO; KARIYAZAKI, TAKU; SUDA, WATARU; HORII, SHINICHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 065822/0535 →
Priority Claims (1)
JP 2021-028423 · Feb 25, 2021 · national
Continuity (2)
Related Publication 20240135715A1 · Apr 25, 2024
Related Publication 20240233384A9 · Jul 11, 2024
References Cited (10)
US 20150199810A1 · Lee · 2015 [cited by examiner]
US 20160021342A1 · Aso et al. · 2016 [cited by applicant]
US 20170323156A1 · Townsend · 2017 [cited by examiner]
US 20210254884A1 · Hong · 2021 [cited by examiner]
CN 110689560A · 2020 [cited by examiner]
JP 2015081762A · 2015 [cited by applicant]
JP 2016023854A · 2016 [cited by applicant]
JP 2020041761A · 2020 [cited by applicant]
WO WO2016036015A1 · 2016 [cited by examiner]
International Search Report issued on Apr. 5, 2022 in International Patent Application No. PCT/JP2022/007105, with English translation. [cited by applicant]