IP Library Granted Patent US 10,558,843
Granted Patent B2
US 10,558,843 · App. 16/353,390 · Granted Feb 11, 2020

Using price in visual product recognition

Inventors: Yair Adato (Kfar Shmuel, IL); Aviv Eisenschtat (Ramat Hasharon, IL); Ziv Mhabary (Tel Aviv, IL); Daniel Shimon Cohen (Hoboken, NJ)
Assignee: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
G06K9/00201G06F16/23G06F16/235G06F16/288G06F16/55G06F16/5846G06F16/90335G06F17/18G06K9/00362G06K9/00624G06K9/00671G06K9/00771G06K9/325G06K9/6231G06Q10/06311G06Q10/06316G06Q10/063112G06Q10/087G06Q10/0875G06Q20/203G06Q30/0629G06Q30/0639G06Q30/0643G06Q50/28G06T7/0002G06T7/13G06T7/20G06T7/521G06T7/55G06T7/70G06T7/75G08B21/18G08B21/182H04N5/2252H04N5/2253H04N5/23203H04N5/23219H04N5/23229H04N5/247G06K2209/01G06K2209/17G06T2207/30196G06T2207/30232G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,558,843
App. No.
16/353,390
Granted
Feb 11, 2020
Kind
B2
Abstract

A system for processing images captured in a retail store and differentiating between products with similar visual appearances is provided. The system may comprise at least one processor configured to receive at least one image depicting a store shelf having a product displayed thereon, analyze the at least one image to detect the product, determine that the detected product is either a first type of product or a second type of product, analyze the at least one image to determine a price associated with the detected product, determine that the detected product is of the first type of product when the determined price falls within a first price range associated with the first type of product, and determine that the detected product is of the second type of product when the determined price falls within a second price range associated with the second type of product.

Claims (49)

1. A system for processing images captured in a retail store and differentiating between products with similar visual appearances, the system comprising:

at least one processor configured to:

receive at least one image depicting a store shelf having a product displayed thereon;

analyze the at least one image to detect the product;

determine that the detected product is either a first type of product or a second type of product, wherein each of the first type of product and the second type of product is associated with a different price range;

analyze the at least one image to determine a price associated with the detected product;

determine that the detected product is of the first type of product when the determined price falls within a first price range associated with the first type of product; and

determine that the detected product is of the second type of product when the determined price falls within a second price range associated with the second type of product.

2. The system of claim 1 , wherein a determination of the price associated with the detected product includes detecting a label attached to the product, and the at least one processor is further configured to analyze the at least one image to recognize a price indicator on the detected label.

3. The system of claim 1 , wherein a determination of the price associated with the detected product includes detecting a label attached to the store shelf, and the at least one processor is further configured to analyze the at least one image to recognize a price indicator on the detected label.

4. The system of claim 1 , wherein the first price range associated with the first type of product is higher than the second price range associated with the second type of product.

5. The system of claim 4 , wherein the at least one processor is further configured to:

analyze the at least one image to detect a promotion associated with the detected product; and

based on the detected promotion determine that the type of the detected product is the first type of product even when the identified price does not fall within the first price range.

6. The system of claim 4 , wherein the at least one processor is further configured to determine that the type of the detected product is the first type of product when the determined price is greater than the first price range.

7. The system of claim 4 , wherein the at least one processor is further configured to determine that the type of the detected product is the second type of product when the determined price is less than the second price range.

8. The system of claim 1 , wherein the at least one processor is further configured to access a database including a first catalog price for the first type of product and a second catalog price for second type of product, and wherein the determined price is different from the first catalog price and the second catalog price.

9. The system of claim 8 , wherein the at least one processor is further configured to determine that the type of the detected product is the first type of product when the determined price is closer to the first catalog price than to the second catalog price.

10. The system of claim 1 , wherein when the determined price does not fall within the prices ranges associated with the first type of product and the second type of product, the at least one processor is further configured to:

provide a visual representation of the detected product to a user;

receive input from the user indicative of a correct type of the detected product; and

initiate an action based on the received input and the identified price.

11. The system of claim 10 , wherein the action comprises updating at least one of the first or second prices ranges.

12. The system of claim 10 , wherein the action comprises informing the user about a mismatch between a price of the correct type of the detected product and the identified price.

13. The system of claim 1 , wherein the first type of product and the second type of product are associated with different sizes.

14. The system of claim 1 , wherein the first type of product and the second type of product are associated with different ingredients.

15. The system of claim 1 , wherein the at least one processor is further configured to determine that the type of the detected product is either the first type of product or the second type of product based on at least one of: a visual appearance of the detected product, a brand associated with the detected product, a logo associated with the detected product, text associated with the detected product, and a shape of the detected product.

16. A method for processing images captured in a retail store, the method comprising:

receiving at least one image depicting a store shelf having a product displayed thereon;

analyzing the at least one image to detect the product;

determining that the detected product is either a first type of product or a second type of product, wherein the first type of product and the second type of product have similar visual appearances and each is associated with a different prices range, a first price range associated with the first type of product is higher than a second price range associated with the second type of product;

analyzing the at least one image to determine a price associated with the detected product;

determining that the detected product is of the first type of product when the determined price falls within the first price range; and

determining that the detected product is of the second type of product when the determined price falls within the second price range.

17. The method of claim 16 , further comprising:

determining that the type of the detected product is of the first type of product when the determined price is higher than the first price range; and

determining that the type of the detected product is of the second type of product when the determined price is lower than the second price range.

18. The method of claim 16 , wherein when the determined price does not fall within the prices ranges of the first type of product and the second type of product, method further comprising:

providing a visual representation of the detected product to a user;

receiving input from the user indicative of a correct type of the detected product; and

initiating an action based on the received input and the identified price, wherein the action includes at least one of: updating at least one of the first and second prices ranges, or informing the user about a mismatch between a price of the correct type of the detected product and the identified price.

19. The method of claim 16 , wherein a determination of the price associated with the detected product includes detecting a label attached to the product, and the method further includes analyzing the at least one image to recognize a price indicator on the detected label.

20. A computer program product for processing images captured in a retail store embodied in a non-transitory computer-readable medium and executable by at least one processor, the computer program product including instructions for causing the at least one processor to execute a method comprising:

receiving at least one image depicting a store shelf having a product displayed thereon;

analyzing the at least one image to detect the product;

determining that the detected product is either a first type of product or a second type of product, wherein each of the first type of product and the second type of product is associated with a different price range;

analyzing the at least one image to determine a price associated with the detected product; and

determining that the detected product is of the first type of product when the determined price falls within a first price range associated with the first type of product; and

determining that the detected product is of the second type of product when the determined price falls within a second price range associated with the second type of product.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Feb 10, 2026
From: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
Reel/Frame 074717/0014 →
RELEASE OF SECURITY INTEREST Recorded Sep 26, 2023
From: ALTER DOMUS (US) LLC
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK INC.
Reel/Frame 065028/0871 →
SECURITY INTEREST Recorded Sep 22, 2023
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
To: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065016/0744 →
RELEASE OF SECURITY INTEREST AT REEL/FRAME NO. 054048/0646 Recorded Oct 27, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD; SHOPKICK, INC.; CVDM SOLUTIONS SAS; TRAX RETAIL, INC.
Reel/Frame 057944/0338 →
SECURITY INTEREST Recorded Oct 15, 2021
From: TRAX TECHNOLOGY PTE. LTD.; SHOPKICK, INC.
To: ALTER DOMUS (US) LLC
Reel/Frame 058184/0438 →
SECURITY INTEREST Recorded Oct 14, 2020
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.; CVDM SOLUTIONS SAS; TRAX RETAIL, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054048/0646 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2019
From: ADATO, YAIR; EISENSCHTAT, AVIS; MHABARY, ZIV; COHEN, DANIEL SHIMON
To: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
Reel/Frame 048600/0101 →
Continuity (5)
Continuation PCTUS2019013054 · Jan 10, 2019
Provisional Application 62615512 · Jan 10, 2018
Provisional Application 62681718 · Jun 7, 2018
Provisional Application 62695469 · Jul 9, 2018
Related Publication 20190213418A1 · Jul 11, 2019
Cited By (1)
US 12,646,347