IP Library Granted Patent US 10,346,794
Granted Patent B2
US 10,346,794 · App. 15/061,443 · Granted Jul 9, 2019

Item monitoring system and method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,346,794
App. No.
15/061,443
Granted
Jul 9, 2019
Kind
B2
Abstract

Methods and apparatus are provided to monitor items on a storage unit. Some embodiments provide a system for monitoring items held on a storage unit, comprising: a scanner device configured to capture a 3D model of the storage unit; a memory configured to store a baseline 3D model of the storage unit in a predetermined stocked state and a plurality of 3D item models, each 3D item model corresponding to an item intended to be held on the storage unit; a difference extraction unit configured to compare the captured 3D model to the baseline 3D model and generate 3D difference data corresponding to a difference between the captured and baseline 3D models, and a product identification unit configured to identify items present in the 3D difference data based on the stored plurality of 3D item models.

Claims (28)

1. A system for monitoring items held on a storage unit, comprising:

a scanner device configured to capture a 3D model of the storage unit and the items on the storage unit, wherein the scanner device comprises a laser range finding device configured calculate a distance from the scanner device based on a reflected emitted pulse, wherein the scanner device is configured to: calculate distances between numerous points from the scanner device and at least the storage unit based on reflected emitted pulses thereby forming a point cloud representation of an area being scanned, and transform the point cloud into a polygonal mesh to capture the 3D model of the storage unit and the plurality of items stored on the storage unit;

a memory configured to store a baseline 3D model of the storage unit in a predetermined stocked state and a plurality of 3D item models, each 3D item model corresponding to an item intended to be held on the storage unit;

a difference extraction unit configured to compare the captured 3D model to the baseline 3D model and generate 3D difference data corresponding to a difference between the captured and baseline 3D models, and

a product identification unit configured to identify items present in the 3D difference data based on the stored plurality of 3D item models.

2. The system of claim 1 , wherein the product identification unit is further configured to determine a stock level based on the identified items.

3. The system of claim 2 , wherein the product identification unit is configured to identify items by determining whether a plurality of dimensions of the 3D difference data are within a tolerance of a plurality of dimensions of each 3D item model.

4. The system of claim 3 , wherein:

the memory is further configured to store a location database comprising an intended location on the storage unit of each of the plurality of 3D item models, and

the product identification unit is configured identify items by comparing the intended location and actual location.

5. The system of claim 4 , wherein the product identification unit is configured to identify an incorrectly placed item based on the comparison of intended and actual locations.

6. The system of claim 2 , wherein the system further comprises an alert generation unit configured to generate an alert if the determined stock level is less than a predetermined stock level, and transmit the alert to a user device coupled to the system by a communication network.

7. The system of claim 2 , wherein the scanner device is configured to periodically capture the 3D model at a predetermined time interval, and the memory is configured to store the determined stock level associated with each captured 3D model.

8. The system of claim 1 , wherein the scanner device comprises a portable laser scanner adapted to be operated by a user.

9. The system of claim 2 , wherein the system further comprises a baseline generation unit configured to generate the baseline 3D model by combining a plurality of smaller models.

10. The system of claim 8 , wherein the baseline 3D model of the storage unit is a part of a larger 3D model of a retail store.

11. The system of claim 1 , wherein the product identification unit is configured to identify items by determining whether a plurality of dimensions of the 3D difference data are within a tolerance of a plurality of dimensions of each 3D item model.

12. The system of claim 1 , wherein:

the memory is further configured to store a location database comprising an intended location on the storage unit of each of the plurality of 3D item models, and

the product identification unit is configured identify items by comparing the intended location and actual location.

13. The system of claim 1 , wherein the system further comprises a baseline generation unit configured to generate the baseline 3D model by combining a plurality of smaller models.

14. The system of claim 13 , wherein the baseline 3D model of the storage unit is a part of a larger 3D model of a retail store.

15. The system of claim 1 , wherein the baseline 3D model of the storage unit is a part of a larger 3D model of a retail store.

16. A method of monitoring items held on a storage unit, the method comprising:

capturing a 3D model of the storage unit and the items on the storage unit, wherein the capturing the 3D model comprises calculating distances between numerous points from a scanner device and at least the storage unit based on reflected emitted pulses, forming a point cloud representation of an area being scanned, and transforming the point cloud into a polygonal mesh to capture the 3D model of the storage unit and the plurality of items stored on the storage unit;

comparing the captured 3D model to a baseline 3D model of the storage unit in a predetermined stocked state and a plurality of 3D item models, each 3D item model corresponding to an item intended to be held on the storage unit;

generating 3D difference data corresponding to a difference between the captured and baseline 3D models, and

identifying items present in the 3D difference data based on a stored plurality of 3D item models, each 3D item model corresponding to an item intended to be held on the storage unit.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2018
From: WAL-MART STORES, INC.
To: WALMART APOLLO, LLC
Reel/Frame 045951/0585 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2018
From: MCHALE, BRIAN G.
To: WAL-MART STORES, INC.
Reel/Frame 045335/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2016
From: HIGH, DONALD R.
To: WAL-MART STORES, INC.
Reel/Frame 038294/0759 →
Cited By (1)
US 12,703,614