IP Library › Granted Patent US 9,697,429
Granted Patent B2
US 9,697,429 · App. 15/211,103 · Granted Jul 4, 2017

Method and apparatus for image processing to avoid counting shelf edge promotional labels when counting product labels

Inventors: Ankur R. Patel (Palatine, IL); Boaz J. Super (Oak Park, IL)
Assignee: Symbol Technologies, LLC
G06K9/00771G06F17/30247G06F17/30256G06K9/3241G06K9/4604G06K9/4671G06K9/6202G06K9/6218G06K9/6222G06K9/6226G06Q10/087
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,697,429
App. No.
15/211,103
Granted
Jul 4, 2017
Kind
B2
Abstract

An example disclosed method includes receiving an image containing shelf edge content displayed on a shelf edge; determining a location of the shelf edge content and an apparent orientation of the shelf edge content; determining, based on the location of the shelf edge content and the apparent orientation of the shelf edge content, a region in the image corresponding to the shelf edge; and providing an output based on the image that identifies the region in the image corresponding to the shelf edge.

Claims (38)

1. A method for processing images, comprising:

receiving, at a shelf edge detection component having a processor, an image containing shelf edge content;

determining, by the processor, locations of instances of the shelf edge content by identifying interest point matches between the image and a reference image;

determining, by the processor, regions in the image corresponding to shelf edges by:

identifying a geometric pattern in the image based on the interest point matches; and

forming clusters of instances of the geometric pattern; and

estimating, by the processor, a number of shelf edges in the image based on the clusters.

2. The method of claim 1 , wherein identifying the geometric pattern comprises applying a geometric model fitting and verification algorithm to the interest point matches.

3. The method of claim 1 , further comprising fitting an upper and a lower line for each of the clusters, wherein the upper and lower lines correspond to upper and lower boundaries of each of the shelf edges, and wherein a space between each upper and lower line pair is the region identified as a shelf edge.

4. The method of claim 3 , wherein fitting the upper and lower lines comprises splitting corners associated with a cluster into first and second sets, with the first set corresponding to the upper boundary and the second set corresponding to the lower boundary.

5. The method of claim 4 , wherein splitting the corners is based on point ordering of each geometric pattern, where first and second points of each geometric pattern are grouped in the first set and third and fourth points of each geometric pattern are grouped in the second set.

6. The method of claim 5 , where the point ordering comprises numbering first, second, third, and fourth corners of each geometric pattern in a clockwise order.

7. The method of claim 1 , wherein forming the clusters comprises selecting a first kernel bandwidth in a horizontal direction of the image that is larger than a second kernel bandwidth in a vertical direction of the image.

8. The method of claim 1 , wherein forming the clusters comprises associating corners of instances of the geometric pattern based on minimizing a distance measure between vertical co-ordinates of the corners and centers of the clusters.

9. The method of claim 1 , further comprising providing an output by at least one of obscuring the regions or providing metadata that identifies the regions.

10. The method of claim 1 , further comprising providing output by providing the output to a product label recognition engine that counts product labels of product items in the image.

11. The method of claim 1 , wherein reference image contains an image of a known shelf edge promotional item.

12. A non-transitory computer-readable storage device comprising machine-readable instructions that, when executed, cause a machine to at least:

receive an image containing shelf edge content;

determine locations of instances of the shelf edge content by identifying interest point matches between the image and a reference image;

determine regions in the image corresponding to shelf edges by:

identifying a geometric pattern in the image based on the interest point matches; and

forming clusters of instances of the geometric pattern; and

estimate a number of shelf edges in the image based on the clusters.

13. The non-transitory computer-readable storage device of claim 12 , wherein the instructions, when executed, cause the machine to identify the geometric pattern by applying a geometric model fitting and verification algorithm to the interest point matches.

14. The non-transitory computer-readable storage device of claim 12 , wherein the instructions, when executed, cause the machine to fit an upper and a lower line for each of the clusters, wherein the upper and lower lines correspond to upper and lower boundaries of each of the shelf edges, and wherein a space between each upper and lower line pair is the region identified as a shelf edge.

15. The non-transitory computer-readable storage device of claim 14 , wherein the instructions, when executed, cause the machine to fit the upper and lower lines by splitting corners associated with a cluster into first and second sets, with the first set corresponding to the upper boundary and the second set corresponding to the lower boundary.

16. The non-transitory computer-readable storage device of claim 12 , wherein forming the clusters comprises selecting a first kernel bandwidth in a horizontal direction of the image that is larger than a second kernel bandwidth in a vertical direction of the image.

17. The non-transitory computer-readable storage of claim 12 , wherein forming the clusters comprises associating corners of instances of the geometric patter based on minimizing a distance measure between vertical co-ordinates of the corners and centers of the clusters.

18. An apparatus, comprising:

memory including machine-readable instructions; and

a processor to execute the machine-readable instructions to perform operations including:

receiving an image containing shelf edge content;

determining locations of instances of the shelf edge content by identifying interest point matches between the image and a reference image;

determining regions in the image corresponding to shelf edges by:

identifying a geometric pattern in the image based on the interest point matches; and

forming clusters of instances of the geometric pattern; and

estimate a number of shelf edges in the image based on the clusters.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2017
From: MOTOROLA SOLUTIONS, INC.
To: SYMBOL TECHNOLOGIES, INC.
Reel/Frame 042799/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2017
From: PATEL, ANKUR R.; SUPER, BOAZ J.
To: MOTOROLA SOLUTIONS, INC.
Reel/Frame 042567/0188 →
CERTIFICATE OF CONVERSION Recorded Jul 15, 2016
From: SYMBOL TECHNOLOGIES, INC.
To: SYMBOL TECHNOLOGIES, LLC
Reel/Frame 039354/0316 →
Continuity (2)
Continuation 14068495 · Oct 31, 2013
Related Publication 20160328618A1 · Nov 10, 2016