IP Library Granted Patent US 9,015,072
Granted Patent B2
US 9,015,072 · App. 13/970,371 · Granted Apr 21, 2015

Method and apparatus for automated inventory management using depth sensing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,015,072
App. No.
13/970,371
Granted
Apr 21, 2015
Kind
B2
Abstract

A method, non-transitory computer readable medium, and apparatus for managing inventory are disclosed. For example, the method monitors a region of interest to determine an inventory level based upon a depth image captured by a depth sensing device, calculates a change in a depth in the region of interest from the depth image that is captured and determines a change in the inventory level associated with the change in the depth of the region of interest.

Claims (40)

1. A method for managing inventory, comprising:

receiving, by a processor, a depth image video frame captured by a depth sensing device, wherein the depth sensing device comprises an image based depth sensing device comprising a red green blue depth (RGB-D) camera;

determining, by the processor, pixels that are in a region of interest of the depth image video frame;

determining, by the processor, that a number of pixels of the pixels that are in the region of interest containing motion is below a threshold;

monitoring, by a processor, the region of interest to determine an inventory level based upon the depth image video frame when the number of pixels containing motion in the region of interest is below the threshold;

calculating, by the processor, a change in a depth in the region of interest from the depth image video frame that is captured;

monitoring, by the processor, the region of interest to identify different items that are within the depth image video frame using a red green blue (RGB) image captured from the RGB-D camera based on a comparison to a corresponding signature image stored in a database;

identifying, by the processor, a particular item of the different items of the inventory that incurred the change in the depth of the region of interest; and

determining, by the processor, a change in the inventory level associated with the change in the depth of the region of interest.

2. The method of claim 1 , further comprising:

generating, by the processor, an alarm when the depth falls below the inventory level threshold to indicate that an additional inventory is required.

3. The method of claim 1 , further comprising:

identifying, by the processor, that the particular item of the inventory is misplaced based upon the RGB image and the depth image video frame.

4. The method of claim 1 , wherein the monitoring is performed with the depth sensing device monitoring the region of interest from a front side.

5. The method of claim 1 , wherein the determining comprises:

calculating a number of items of depletion in inventory based upon a width of each one of the items and the change of the depth in the region of interest.

6. A non-transitory computer-readable medium storing a plurality of instructions which, when executed by a processor, cause the processor to perform operations for managing inventory, the operations comprising:

receiving a depth image video frame captured by a depth sensing device, wherein the depth sensing device comprises an image based depth sensing device comprising a red green blue depth (RGB-D) camera;

determining pixels that are in a region of interest of the depth image video frame;

determining that a number of pixels of the pixels that are in the region of interest containing motion is below a threshold;

monitoring the region of interest to determine an inventory level based upon the depth image video frame when the number of pixels containing motion in the region of interest is below the threshold;

calculating a change in a depth in the region of interest from the depth image video frame that is captured;

monitoring the region of interest to identify different items that are within the depth image video frame using a red green blue (RGB) image captured from the RGB-D camera based on a comparison to a corresponding signature image stored in a database;

identifying a particular item of the different items of the inventory that incurred the change in the depth of the region of interest; and

determining a change in the inventory level associated with the change in the depth of the region of interest.

7. The non-transitory computer-readable medium of claim 6 , further comprising:

generating an alarm when the depth falls below the inventory level threshold to indicate that an additional inventory is required.

8. The non-transitory computer-readable medium of claim 6 , further comprising:

identifying that the particular item of the inventory is misplaced based upon the RGB image and the depth image video frame.

9. The non-transitory computer-readable medium of claim 6 , wherein the determining comprises:

calculating a number of items of depletion in inventory based upon a width of each one of the items and the change of the depth in the region of interest.

10. A method for managing inventory, comprising:

receiving, by a processor, a depth image video frame captured by a depth sensing device, wherein the depth sensing device comprises an image based depth sensing device comprising a red green blue depth (RGB-D) camera;

determining, by the processor, pixels that are in a region of interest of the depth image video frame;

determining, by the processor, that a number of pixels of the pixels that are in the region of interest containing motion is below a threshold;

monitoring, by the processor, the region of interest to determine an inventory level of a particular item of a plurality of different items within the depth image video frame based upon the depth image video frame and a red green blue (RGB) image captured by the RGB-D camera that captures both the depth image video frame and the RGB image when the number of pixels containing motion in the region of interest is below the threshold;

detecting, by the processor, a depletion in the inventory level of the particular item due to a change in a depth of the region of interest in the depth image video frame containing the particular item identified by the RGB image based on a comparison to a corresponding signature image stored in a database;

calculating, by the processor, the depth in the region of interest after the change is detected;

determining, by the processor, when the depth is below an inventory level threshold, wherein the depth corresponds to a number of the particular item based upon a width of the particular item; and

generating, by the processor, an alarm when the depth falls below the inventory level threshold to indicate that an additional inventory of the particular item is required.

Assignments (4)
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: U.S. BANK, NATIONAL ASSOCIATION
Reel/Frame 057969/0445 →
SECURITY INTEREST Recorded Oct 19, 2021
From: CONDUENT BUSINESS SERVICES, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 057970/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2017
From: XEROX CORPORATION
To: CONDUENT BUSINESS SERVICES, LLC
Reel/Frame 041542/0022 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2013
From: WU, WENCHENG; BERNAL, EDGAR A.
To: XEROX CORPORATION
Reel/Frame 031038/0804 →