IP Library Granted Patent US 9,129,277
Granted Patent B2
US 9,129,277 · App. 13/946,968 · Granted Sep 8, 2015

Methods and arrangements for identifying objects

Inventor: Brian T. MacIntosh (Lake Oswego, OR)
Assignee: Digimarc Corporation
G06Q20/208G06Q30/00G06T5/006G06T7/0004G06T7/0042G06T2207/10016G06T2207/10021G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,129,277
App. No.
13/946,968
Granted
Sep 8, 2015
Kind
B2
Abstract

In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views—further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modelled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. Logos may be identified and used—or ignored—in product identification. A great variety of other features and arrangements are also detailed.

Claims (29)

1. A method of identifying a retail product, based at least in part on assessing correspondence between image recognition features associated with the retail product and image recognition features associated with a collection of reference products, the method including the acts:

receiving plural recognition features derived from imagery associated with the retail product;

using a hardware processor configured with software, distinguishing a subset of the received features that are associated with a logo, said logo being present on plural of said reference products; and

taking an action in response to said distinguishing, wherein said action comprises at least one of:

(a) providing, via a user interface of a camera-equipped portable device that captured said imagery of the retail product, information indicating that the camera should be moved further away from the product, so as to capture a wider field of view;

(b) weighting said subset of received features less than other of the received features, in determining a match between the retail product and one of said reference products;

(c) disregarding said subset of received features in determining a match between the retail product and one of said reference products;

(d) disregarding features other than said subset of features, and identifying plural reference products having said logo; or

(e) treating said determined subset of received features differently than others of the received features, in identifying one or more reference products.

2. The method of claim 1 in which the action includes providing, via a user interface of a camera-equipped portable device that captured said imagery of the retail product, information indicating that the camera should be moved further away from the product, so as to capture a wider field of view.

3. The method of claim 1 in which the action includes weighting said subset of received features less than other of the received features, in determining a match between the retail product and one of said reference products.

4. The method of claim 1 in which the action includes disregarding said subset of received features in determining a match between the retail product and one of said reference products.

5. The method of claim 1 in which the action includes disregarding features other than said subset of features, and identifying plural reference products having said logo.

6. The method of claim 1 in which the action includes treating said determined subset of received features differently than others of the received features, in identifying one or more reference products.

7. A method of enrolling a retail product in a reference product database, the method including the acts:

receiving plural recognition features derived from imagery associated with the retail product;

using a hardware processor configured with software, distinguishing a subset of the received features that are associated with a logo, said logo being present on plural of said reference products; and

treating said determined subset of features differently in enrolling said received recognition features in the reference product database, wherein said treating includes flagging said determined subset of features in the database, so that other processes accessing information in the database can identify the flagged features as associated with a logo.

8. A method of enrolling a retail product in a reference product database, the method including the acts:

receiving plural recognition features derived from imagery associated with the retail product;

using a hardware processor configured with software, distinguishing a subset of the received features that are associated with a logo, said logo being present on plural of said reference products; and

treating said determined subset of features differently in enrolling said received recognition features in the reference product database, wherein said treating includes storing weighting values in the database, in association both with said determined subset of features, and others of said received recognition features, wherein the weighting values associated with the determined subset of features have a statistical distribution different than the weighting values association with said others of said received recognition features.

9. A method comprising:

receiving plural recognition features derived from imagery associated with a retail product;

identifying recognition features in a reference data structure that correspond to certain of the received features;

using a hardware processor configured with software, scoring a match between the retail product and a reference product based on said correspondence;

wherein said scoring includes weighting, based on auxiliary data stored in the data structure, correspondence between one recognition feature in the reference data structure and one recognition feature among the received recognition features.

10. The method of claim 9 in which the auxiliary data comprises data indicating that the reference recognition feature is due to a visible feature on a reference product that is also found on other reference products.

11. The method of claim 9 in which the auxiliary data comprises data indicating that the reference recognition feature is due to a logo on a reference product that is also found on other reference products.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2013
From: MACINTOSH, BRIAN T.; RODRIGUEZ, TONY F.; CONWELL, WILLIAM Y.
To: DIGIMARC CORPORATION
Reel/Frame 031419/0371 →
Continuity (16)
Continuation In Part 13750752 · Jan 25, 2013
Continuation In Part 13231893 · Sep 13, 2011
Continuation In Part 13946968
Continuation In Part PCTUS2012053201 · Aug 30, 2012
Continuation In Part 13231893 · Sep 13, 2011
Provisional Application 61693225 · Aug 24, 2012
Provisional Application 61716223 · Oct 19, 2012
Provisional Application 61716591 · Oct 21, 2012
Provisional Application 61724854 · Nov 9, 2012
Provisional Application 61529214 · Aug 30, 2011
Provisional Application 61531525 · Sep 6, 2011
Provisional Application 61533079 · Sep 9, 2011
Provisional Application 61537523 · Sep 21, 2011
Provisional Application 61540455 · Sep 28, 2011
Provisional Application 61544996 · Oct 7, 2011
Related Publication 20140052555A1 · Feb 20, 2014