IP Library Granted Patent US 8,194,985
Granted Patent B2
US 8,194,985 · App. 12/244,493 · Granted Jun 5, 2012

Product identification using image analysis and user interaction

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,194,985
App. No.
12/244,493
Granted
Jun 5, 2012
Kind
B2
Abstract

An apparatus, system, and method are disclosed for product identification using image analysis and user interaction. The method may include comparing a retail product image to a plurality of candidate retail product images. In addition, the method may include generating a candidate product set containing candidate retail product images satisfying image comparison criteria. The method may determine one or more product identity queries configured to solicit additional product identity information from a user. In addition, the product identity queries may eliminate one or more members of the candidate product set. The method may query the user with these inquiries and determine a product match based on the user's response. Therefore a user may obtain information about a product using only a picture and a user's knowledge of the product.

Claims (51)

1. A method for facilitating product identification using image analysis and user interaction, the method comprising:

comparing a retail product image to a plurality of candidate retail product images, the retail product image comprising a pictorial likeness of a manufactured retail product;

generating a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics; and

determining one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

2. The method of claim 1 , further comprising querying the user with the one or more product identity inquiries.

3. The method of claim 2 , further comprising determining a product match based on additional product identity information from the user in response to the one or more product identity inquiries.

4. The method of claim 3 , further comprising presenting the product match to the user.

5. The method of claim 4 , further comprising presenting the plurality of product characteristics associated with the product match to the user.

6. The method of claim 5 , further comprising saving the product match, the plurality of product characteristics associated with the product match, and user information in a product inventory, the product inventory stored in a repository.

7. The method of claim 6 , further comprising sending and receiving user product data through an interface to an independent web service.

8. The method of claim 2 , further comprising presenting a potential match list to the user for the user to select a product match, the potential match list comprising two or more members of the candidate product set not eliminated by the product identity queries.

9. The method of claim 2 , further comprising requesting one or more additional retail product images from the user, each retail product image comprising a pictorial likeness of the manufactured retail product from a certain perspective.

10. The method of claim 1 , wherein comparing a retail product image further comprises obtaining candidate retail product images for comparison from a repository.

11. The method of claim 1 , wherein comparing a retail product image further comprises obtaining candidate retail product images from a web crawler on the internet.

12. The method of claim 1 , further comprising determining a product compatibility between the product match and one or more additional retail products.

13. An apparatus for product identification using image analysis and user interaction, the apparatus comprising:

a processor to execute instructions;

a comparison module configured to compare a retail product image to a plurality of candidate retail product images, the retail product image comprising a pictorial likeness of a manufactured retail product;

a generation module configured to generate a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics;

a query determination module configured to determine one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

14. The apparatus of claim 13 , further comprising:

a query module configured to query the user with the one or more product identity inquiries; and

a product determination module configured to determine a product match based on additional product identity information from the user in response to the one or more product identity inquiries.

15. The apparatus of claim 14 , further comprising a presentation module configured to present the product match to the user.

16. The apparatus of claim 15 , wherein the presentation module is further configured to present the plurality of product characteristics associated with the product match to the user.

17. The apparatus of claim 14 , further comprising a storage module configured to store the product match, the plurality of product characteristics associated with the product match, and user information.

18. The apparatus of claim 17 , further comprising an interface module configured to send and receive user product data with an independent web service through an interface.

19. The apparatus of claim 13 , wherein the comparison module further comprises a web crawler module configured to obtain candidate retail product images from the internet.

20. The apparatus of claim 13 , wherein the product identity information is selected from the group consisting of a purchase location, a receipt scan, a product packaging photo, an instruction manual scan, a product category, an RFID scan, a product description, and a product serial number.

21. A system for product identification using image analysis and user interaction, the system comprising:

a server having a processor in communication with a network, the server comprising:

a comparison module configured to compare a retail product image to a plurality of candidate retail product images, the retail product image comprising a pictorial likeness of a manufactured retail product;

a generation module configured to generate a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics; and

a query determination module configured to determine one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

22. The system of claim 21 , wherein the comparison module is configured to obtain candidate retail product images for comparison from a repository.

23. The system of claim 21 , wherein the comparison module further comprises a web crawler module configured to obtain candidate retail product images from the internet.

24. The system of claim 21 , further comprising:

a query module configured to query the user with the one or more product identity inquiries;

an input module configured to receive product information from the user in response to the one or more product identity inquiries; and

a product determination module configured to determine a product match based on the product information from the user.

25. The system of claim 24 , further comprising a presentation module configured to present the plurality of product characteristics associated with the product match to the user.

26. A computer program product stored on a storage medium for a product identification service using image analysis and user interaction, the computer program product comprising:

a computer readable storage medium to electronically store instructions, wherein the instructions, when executed by a processor within a computer, cause the processor to perform operations for the product identification service, the operations comprising:

receiving a product identification request and a retail product image, the retail product image comprising a pictorial likeness of a manufactured retail product;

comparing the retail product image to a plurality of candidate retail product images;

generating a candidate product set comprising candidate retail product images satisfying image comparison criteria, each candidate retail product image representative of a retail product having a plurality of product characteristics; and

determining one or more product identity queries configured to solicit additional product identity information from a user, the product identity queries derived from the candidate retail product images in the candidate product set, the product identity queries configured to eliminate one or more members of the candidate product set.

27. The computer program product of claim 26 , further comprising:

querying the user with the one or more product identity inquiries; and

determining a product match based on additional product identity information from the user in response to the one or more product identity inquiries.

28. The computer program product of claim 27 , further comprising returning the plurality of product characteristics associated with the product match in response to the user verifying the product match.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Dec 13, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: DROPBOX, INC.
Reel/Frame 069635/0332 →
SECURITY INTEREST Recorded Dec 12, 2024
From: DROPBOX, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 069604/0611 →
RELEASE OF SECURITY INTEREST Recorded Dec 12, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: DROPBOX, INC.
Reel/Frame 069613/0744 →
PATENT SECURITY AGREEMENT Recorded Mar 10, 2021
From: DROPBOX, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 055670/0219 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2017
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: DROPBOX, INC.
Reel/Frame 043938/0489 →
SECURITY INTEREST Recorded Apr 14, 2017
From: DROPBOX, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042254/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2008
From: GRIGSBY, TRAVIS M.; MISHRA, SUNIL K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 021915/0177 →