IP Library Granted Patent US 10,540,761
Granted Patent B2
US 10,540,761 · App. 15/152,812 · Granted Jan 21, 2020

Distinguishing between stock keeping units using marker based methodology

Inventors: Bharathi Shekar (Bangalore, IN); Sri Kaushik Pavani (Chennai, IN); Anshul Garg (Haryana, IN)
Assignee: Ricoh Co., Ltd.
G06T7/001G06K9/2063G06K9/46G06K9/52G06K9/6201G06Q10/087G06T7/60G06K2009/4666G06K2009/6213G06T2207/30108G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,540,761
App. No.
15/152,812
Granted
Jan 21, 2020
Kind
B2
Abstract

The disclosure includes a system and method for distinguishing between stock keeping units of similar appearance that vary in size. An image recognition application receives an image depicting a plurality of items, the image including a reference marker with a known physical dimension. The image recognition application performs image recognition to identify an item in the image and a region of interest for the identified image. The image recognition application further determines a pixel-to-physical dimension ratio using the dimension of a region of interest of the reference marker and the known physical dimension of the reference marker. Finally, the image recognition application determines a stock keeping unit identifier of the identified item in the image based on the pixel-to-physical dimension ratio and a dimension of the region of interest of the identified item.

Claims (55)

1. A method comprising:

receiving a first image including a plurality of items of varying sizes, the plurality of items having a similar appearance and including a reference marker with a known physical dimension;

performing image recognition to identify an item in the first image and a region of interest of the identified item in the first image;

determining a pixel-to-physical dimension ratio using a first pixel dimension of a region of interest of the reference marker and the known physical dimension of the reference marker;

determining a physical dimension of the identified item using the pixel-to-physical dimension ratio and a second pixel dimension of the region of interest of the identified item; and

determining a stock keeping unit identifier distinguishing the identified item of a first size from the plurality of items of varying sizes by matching the physical dimension of the identified item with a reference physical dimension for the identified item stored in a stock keeping unit table.

2. The method of claim 1 , wherein determining the pixel-to-physical dimension ratio further comprises:

retrieving the known physical dimension of the reference marker; and

determining the pixel-to-physical dimension ratio by dividing the first pixel dimension of the region of interest of the reference marker by the known physical dimension of the reference marker.

3. The method of claim 1 , wherein determining the stock keeping unit identifier distinguishing the identified item of the first size from the plurality of items of varying sizes further comprises:

determining the physical dimension of the identified item by dividing the second pixel dimension of the region of interest of the identified item by the pixel-to-physical dimension ratio; and

determining the stock keeping unit identifier of the identified item by using the physical dimension of the identified item to look up the stock keeping unit identifier in the stock keeping unit table.

4. The method of claim 1 , further comprising:

receiving a second image of the reference marker;

cropping a background region in the second image of the reference marker;

receiving a physical dimension of the reference marker; and

storing the second image of the reference marker with the physical dimension as the known physical dimension.

5. The method of claim 1 , wherein the reference marker is one from a group of an employee identification card, a shelf label, and a Quick Response (QR) code label.

6. The method of claim 1 , wherein the physical dimension of the identified item is one from a group of: a height, a width, an area, and a diagonal length.

7. The method of claim 1 , wherein a portion of the plurality of items in the first image vary only in size.

8. The method of claim 1 , wherein the pixel-to-physical dimension ratio describes a relationship between the first pixel dimension of the reference marker in the first image and the known physical dimension of the reference marker.

9. A system comprising;

an image processor configured to:

receive a first image including a plurality of items of varying sizes, the plurality of items having a similar appearance and including a reference marker with a known physical dimension; and

perform image recognition to identify an item in the first image and a region of interest of the identified item in the first image;

a pixel-to-physical dimension ratio engine coupled to the image processor and configured to determine a pixel-to-physical dimension ratio using a first pixel dimension of a region of interest of the reference marker and the known physical dimension of the reference marker; and

a size engine coupled to the pixel-to-physical dimension ratio engine and configured to determine a physical dimension of the identified item using the pixel-to-physical dimension ratio and a second pixel dimension of the region of interest of the identified item and to determine a stock keeping unit identifier distinguishing the identified item of a first size from the plurality of items of varying sizes by matching the physical dimension of the identified item with a reference physical dimension for the identified item stored in a stock keeping unit table.

10. The system of claim 9 , wherein the pixel-to-physical dimension ratio engine, to determine the pixel-to-physical dimension ratio, is further configured to:

retrieve the known physical dimension of the reference marker; and

determine the pixel-to-physical dimension ratio by dividing the first pixel dimension of the region of interest of the reference marker by the known physical dimension of the reference marker.

11. The system of claim 9 , wherein the size engine, to determine the stock keeping unit identifier distinguishing the identified item of the first size from the plurality of items of varying sizes, is further configured to:

determine the physical dimension of the identified item by dividing the second pixel dimension of the region of interest of the identified item by the pixel-to-physical dimension ratio; and

determine the stock keeping unit identifier of the identified item by using the physical dimension of the identified item to look up the stock keeping unit identifier in the stock keeping unit table.

12. The system of claim 9 , wherein the size engine is further configured to:

receive a second image of the reference marker;

crop a background region in the second image of the reference marker;

receive a physical dimension of the reference marker; and

store the second image of the reference marker with the physical dimension as the known physical dimension.

13. The system of claim 9 , wherein the reference marker is one from a group of an employee identification card, a shelf label, and a Quick Response (QR) code label.

14. The system of claim 9 , wherein the physical dimension of the identified item is one from a group of: a height, a width, an area, and a diagonal length.

15. The system of claim 9 , wherein a portion of the plurality of items in the first image vary only in size.

16. The system of claim 9 , wherein the pixel-to-physical dimension ratio describes a relationship between the first pixel dimension of the reference marker in the first image and the known physical dimension of the reference marker.

17. A computer program product comprising a non-transitory computer readable medium storing a computer readable program, wherein the computer readable program, when executed, causes a computer to perform operations comprising:

receiving an image including a plurality of items of varying sizes, the plurality of items having a similar appearance and including a reference marker with a known physical dimension;

performing image recognition to identify an item in the image and a region of interest of the identified item in the image;

determining a pixel-to-physical dimension ratio using a first pixel dimension of a region of interest of the reference marker and the known physical dimension of the reference marker;

determining a physical dimension of the identified item using the pixel-to-physical dimension ratio and a second pixel dimension of the region of interest of the identified item; and

determining a stock keeping unit identifier distinguishing the identified item of a first size from the plurality of items of varying sizes by matching the physical dimension of the identified item with a reference physical dimension for the identified item stored in a stock keeping unit table.

18. The computer program product of claim 17 , wherein determining the pixel-to-physical dimension ratio further comprises:

retrieving the known physical dimension of the reference marker; and

determining the pixel-to-physical dimension ratio by dividing the first pixel dimension of the region of interest of the reference marker by the known physical dimension of the reference marker.

19. The computer program product of claim 17 , wherein determining the stock keeping unit identifier distinguishing the identified item of the first size from the plurality of items of varying sizes further comprises:

determining the physical dimension of the identified item by dividing the second pixel dimension of the region of interest of the identified item by the pixel-to-physical dimension ratio; and

determining the stock keeping unit identifier of the identified item by using the physical dimension of the identified item to look up the stock keeping unit identifier in the stock keeping unit table.

20. The computer program product of claim 17 , wherein the reference marker is one from a group of an employee identification card, a shelf label, and a Quick Response (QR) code label.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2016
From: SHEKAR, BHARATHI; PAVANI, SRI KAUSHIK; GARG, ANSHUL
To: RICOH COMPANY, LTD.
Reel/Frame 038559/0146 →
Continuity (2)
Continuation 14582036 · Dec 23, 2014
Related Publication 20160253794A1 · Sep 1, 2016