IP Library Granted Patent US 11,475,742
Granted Patent B2
US 11,475,742 · App. 17/562,225 · Granted Oct 18, 2022

Visual indicator of frictionless status of shoppers

Inventor: Youval Bronicki (Los Altos, CA)
Assignee: Trax Technology Solutions Pte Ltd.
G07G1/0063G06Q20/145G06Q20/204G06Q20/208G06Q20/4016G06Q20/40145G06Q30/0281G06Q30/0609G06Q30/0613G06Q30/0617G06Q30/0623G06Q30/0633G06Q30/0635G06Q30/0639G06V10/764G06V10/765G06V20/44G06V20/52G06V40/103G06V40/172G06V40/20G01G19/4144G01G19/52G08B5/36
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,475,742
App. No.
17/562,225
Granted
Oct 18, 2022
Kind
B2
Abstract

A system for determining whether shoppers are eligible for frictionless checkout is disclosed. The system has a processor that obtains image data captured using image sensors positioned in a retail store. The processor analyzes the image data to identify at least one shopper at one or more locations of the retail store. The processor detects, based on the analysis of the image data, at least one product interaction event associated with an action of the at least one shopper at the one or more locations of the retail store. Further, based on the detected at least one product interaction event, the processor determines whether the at least one shopper is eligible for frictionless checkout. In response to a determination that the at least one shopper is ineligible for frictionless checkout, the processor causes delivery of an indicator that the at least one shopper is ineligible for frictionless checkout.

Claims (47)

1. A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for determining whether shoppers are eligible for frictionless checkout, the method comprising:

obtaining image data captured using a plurality of image sensors positioned in a retail store;

analyzing the image data to identify at least one shopper at one or more locations of the retail store;

detecting, based on the analysis of the image data, at least one product interaction event associated with an action of the at least one shopper at the one or more locations of the retail store;

determining whether the at least one shopper is eligible for frictionless checkout based on a determination that a number of ambiguous events among the detected at least one product interaction event exceeds a predetermined threshold number of ambiguous events; and

in response to a determination that the at least one shopper is ineligible for frictionless checkout, causing delivery of an indicator that the at least one shopper is ineligible for frictionless checkout.

2. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

obtaining sensor data from one or more sensors disposed on a retail shelf between the retail shelf and one or more products placed on the retail shelf; and

wherein the at least one product interaction event is detected based on analysis of the image data and the sensor data.

3. The non-transitory computer-readable medium of claim 1 , wherein the at least one shopper includes a plurality of shoppers, and wherein identifying the at least one shopper at the one or more locations of the retail store includes determining an individual path for each of the plurality of shoppers in the retail store.

4. The non-transitory computer-readable medium of claim 1 , wherein the at least one product interaction event is detected based on a plurality of products that the at least one shopper is expected to buy.

5. The non-transitory computer-readable medium of claim 1 , wherein the action of the at least one shopper includes removing a product from a shelf associated with the retail store.

6. The non-transitory computer-readable medium of claim 1 , wherein the action of the at least one shopper includes returning a product to a shelf associated with the retail store.

7. The non-transitory computer-readable medium of claim 1 , wherein determining whether the at least one shopper is eligible for frictionless checkout is based on at least one indicator of a degree of ambiguity associated with the detected at least one product interaction event.

8. The non-transitory computer-readable medium of claim 1 , wherein determining whether the at least one shopper is eligible for frictionless checkout is based on whether the at least one shopper is detected removing or selecting a product from a shelf that is designated as ineligible for frictionless checkout.

9. The non-transitory computer-readable medium of claim 1 , wherein determining whether the at least one shopper is eligible for frictionless checkout includes determining an indicator of a confidence level associated with each detected product interaction event.

10. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

obtaining cart data indicative of an actual plurality of products within a cart of a particular shopper;

determining, based on analysis of the detected at least one product interaction event, an expected plurality of products within the cart of the particular shopper;

determining whether a discrepancy exists between the actual plurality of products and the expected plurality of products; and

determining that the particular shopper is ineligible for frictionless checkout based on the determined discrepancy.

11. The non-transitory computer-readable medium of claim 1 , wherein the determination that the at least one shopper is ineligible for frictionless checkout is based on a determination of a product value associated with one or more ambiguous events among the detected at least one product interaction event.

12. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

accessing a customer profile associated a particular shopper; and

foregoing the delivery of the indicator that the particular shopper is ineligible for frictionless checkout based on information associated with the customer profile.

13. The non-transitory computer-readable medium of claim 1 , wherein causing the delivery of the indicator that the at least one shopper is ineligible for frictionless checkout includes sending a notification to a wearable device associated with the at least one shopper.

14. The non-transitory computer-readable medium of claim 1 , wherein causing the delivery of the indicator that the at least one shopper is ineligible for frictionless checkout includes sending a notification to a mobile device associated with the at least one shopper.

15. The non-transitory computer-readable medium of claim 1 , wherein causing the delivery of the indicator that the at least one shopper is ineligible for frictionless checkout includes causing a notification to be generated by a shopping cart associated with the at least one shopper.

16. The non-transitory computer-readable medium of claim 1 , wherein causing a delivery of the indicator that the at least one shopper is ineligible for frictionless checkout includes sending a notification to a computing device associated with a store associate of the retail store.

17. The non-transitory computer-readable medium of claim 1 , wherein the delivery of the indicator that the at least one shopper is ineligible for frictionless checkout occurs after the at least one shopper enters a checkout area of the retail store.

18. The non-transitory computer-readable medium of claim 1 , wherein the method further comprises:

causing an ambiguity resolution action in response to a detection of at least one ambiguous event among the detected at least one product interaction event; and

causing an eligibility status for frictionless checkout for the at least one shopper to be restored based on data associated with a completion of the ambiguity resolution action.

19. The non-transitory computer-readable medium of claim 1 , wherein the predetermined threshold number of ambiguous events is based on a total number of product interaction events included in the at least one product interaction event.

20. A method for determining whether shoppers are eligible for frictionless checkout, the method comprising:

obtaining image data captured using a plurality of image sensors positioned in a retail store;

analyzing the image data to identify at least one shopper at one or more locations of the retail store;

detecting, based on the analysis of the image data, at least one product interaction event associated with an action of the at least one shopper at the one or more locations of the retail store;

determining whether the at least one shopper is eligible for frictionless checkout based on a determination that a number of ambiguous events among the detected at least one product interaction event exceeds a predetermined threshold number of ambiguous events; and

in response to a determination that the at least one shopper is ineligible for frictionless checkout, causing delivery of an indicator that the at least one shopper is ineligible for frictionless checkout.

21. A system for determining whether shoppers are eligible for frictionless checkout, the system comprising:

at least one processor programmed to:

obtain image data captured using a plurality of image sensors positioned in a retail store;

analyze the image data to identify at least one shopper at one or more locations of the retail store;

detect, based on the analysis of the image data, at least one product interaction event associated with an action of the at least one shopper at the one or more locations of the retail store;

determine whether the at least one shopper is eligible for frictionless checkout based on a determination that a number of ambiguous events among the detected at least one product interaction event exceeds a predetermined threshold number of ambiguous events; and

in response to a determination that the at least one shopper is ineligible for frictionless checkout, cause delivery of an indicator that the at least one shopper is ineligible for frictionless checkout.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Feb 10, 2026
From: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
To: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
Reel/Frame 074717/0014 →
SECURITY INTEREST Recorded Sep 22, 2023
From: TRAX TECHNOLOGY SOLUTIONS PTE. LTD.; SHOPKICK, INC.
To: COMPUTERSHARE TRUST COMPANY, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065016/0744 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2021
From: BRONICKI, YOUVAL; BENDLER, DAN
To: TRAX TECHNOLOGY SOLUTIONS PTE LTD.
Reel/Frame 058480/0683 →
Continuity (4)
Continuation PCTUS2021054489 · Oct 12, 2021
Provisional Application 63113490 · Nov 13, 2020
Provisional Application 63091009 · Oct 13, 2020
Related Publication 20220122131A1 · Apr 21, 2022