IP Library Granted Patent US 11,599,932
Granted Patent B2
US 11,599,932 · App. 17/029,425 · Granted Mar 7, 2023

System and methods for shopping in a physical store

Inventors: William Chomley (Auckland, NZ); Peter Szoldan (Budapest, HU)
Assignee: IMAGR HOLDINGS LIMITED
G06Q30/0635B62B3/14G06K9/6271G06Q20/14G06Q20/4014G06Q30/02G06Q30/04G06V10/454G06V20/00G06V30/194
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,599,932
App. No.
17/029,425
Granted
Mar 7, 2023
Kind
B2
Abstract

A method and system for assisting in shopping at a physical store ( 104 ) is described. The method includes receiving image data of the inside of a shopping cart ( 108 ) and processing the image data to detect one or more events. An event is the addition of an item ( 114 ) to the shopping cart ( 108 ) or the removal of an item ( 114 ) from the shopping cart ( 108 ). Responsive to detecting an event, the method processes the image data to identify an item associated with the event, and generates cart information based on the identified item. The cart information includes a record of items currently in the shopping cart ( 108 ). The method also communicates the cart information with respect to the identified item to a customer device ( 118 ).

Claims (46)

1. A computer-implemented method for assisting in shopping at a physical store, the method comprising:

activating a shopping session for a customer, wherein activating the shopping session includes linking the customer to a cart system for a duration of the shopping session, the cart system mechanically coupled to a shopping cart;

during the shopping session:

capturing image data of the inside of a shopping cart;

processing the image data to detect one or more events and, for each event, determining an event type, the event type being an item addition event involving addition of an item to the shopping cart or an item removal event involving removal of the item from the shopping cart;

responsive to detecting an event:

processing the image data to identify an item associated with the event;

retrieving item information with respect to the identified item, the information including at least an item name;

updating cart information based on the identified item, the identified event type and the retrieved item information, the cart information including at least a record of items currently in the shopping cart; and

displaying the updated cart information on a display,

wherein in order to limit unnecessary battery drain, linking the customer to the cart system further includes determining a location of the cart system, and wherein establishing the shopping session is performed at least in part in response to determining that the location of the cart system is within a threshold distance of a location of the physical store.

2. The computer-implemented method of claim 1 wherein linking the customer to the cart system includes receiving information associated with the cart system in a shopping application, the shopping application installed and executing on an electronic device of the customer.

3. The computer-implemented method of claim 1 , wherein the information associated with the cart system includes a unique shopping cart identifier or code.

4. The computer-implemented method of claim 1 , wherein the information associated with the cart system is a QR code or barcode, and linking the customer to the cart system includes capturing the QR code or bar code with an image capture device of the electronic device.

5. The computer-implemented method of claim 1 , wherein the customer has a user account with the shopping application and the user account includes customer information.

6. The computer-implemented method of claim 5 , wherein linking the customer to the cart system further includes, the shopping application communicating the information associated with the cart system and the customer information to a backend system and the backend system linking the information associated with the cart system and the customer information for the duration of the shopping session.

7. The computer-implemented method of claim 6 , wherein establishing the shopping session further comprises setting a communication path between the cart system and the backend system and creating a temporary cache in a memory associated with the backend system for the established shopping session.

8. The computer-implemented method of claim 1 , wherein linking the customer to the cart system further includes determining whether the cart system is already linked to another customer.

9. The computer-implemented method of claim 1 further comprising:

receiving an instruction to generate an invoice; and

generating the invoice based on a state of the cart information at the time of receiving the instruction to generate the invoice.

10. The computer-implemented method of claim 9 further comprising:

processing a payment based on the invoice; and

responsive to completion of the payment, terminating the shopping session.

11. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processing units, cause a computer processing system to perform operations comprising:

activating a shopping session for a customer, wherein activating the shopping session includes linking the customer to a cart system for a duration of the shopping session, the cart system mechanically coupled to the shopping cart;

during the shopping session:

capturing image data of the inside of a shopping cart;

processing the image data to detect one or more events and, for each event, determining an event type, the event type being an item addition event involving addition of an item to the shopping cart or an item removal event involving removal of the item from the shopping cart;

responsive to detecting an event:

processing the image data to identify an item associated with the event;

retrieving item information with respect to the identified item, the information including at least an item name;

updating cart information based on the identified item, the identified event type and the retrieved item information, the cart information including at least a record of items currently in the shopping cart; and

displaying the updated cart information on a display,

wherein in order to limit unnecessary battery drain, linking the customer to the cart system further includes determining a location of the cart system, and wherein establishing the shopping session is performed at least in part in response to determining that the location of the cart system is within a threshold distance of a location of the physical store.

12. The non-transitory computer readable medium of claim 11 , wherein the operation of linking the customer to the cart system further includes receiving information associated with the cart system in a shopping application, the shopping application installed and executing on an electronic device of the customer.

13. The non-transitory computer-readable medium of claim 12 , wherein the information associated with the cart system includes a unique shopping cart identifier or code.

14. The non-transitory computer-readable medium of claim 12 , wherein the information associated with the cart system is a QR code or barcode, and linking the customer to the cart system includes capturing the QR code or bar code with an image capture device of the electronic device.

15. The non-transitory computer-readable medium of claim 12 , wherein the customer has a user account with the shopping application, the user account including customer information.

16. The non-transitory computer-readable medium of claim 15 , wherein the operation of linking the customer to the cart system further includes the shopping application communicating the information associated with the cart system and the customer information to a backend system and the backend system linking the information associated with the cart system and the customer information for the duration of the shopping session.

17. The non-transitory computer-readable medium of claim 16 , wherein the operation of establishing the shopping session further comprises setting a communication path between the cart system and the backend system and creating a temporary cache in a memory associated with the backend system for the established shopping session.

18. The non-transitory computer-readable medium of claim 11 , further comprising instructions that when executed by the one or more computer processing units further cause the computer processing system to perform operations comprising:

receiving an instruction to generate an invoice;

generating the invoice based on a state of the cart information at the time of receiving the instruction to generate the invoice;

processing a payment based on the invoice; and

responsive to completion of the payment, terminating the shopping session.

Assignments (3)
CHANGE OF NAME Recorded Mar 8, 2021
From: IMAGR LIMITED
To: IMAGR HOLDINGS LIMITED
Reel/Frame 055526/0716 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: CHOMLEY, WILLIAM; SZOLDAN, PETER
To: IMAGR LLC
Reel/Frame 053859/0345 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: IMAGR LLC
To: IMAGR LIMITED
Reel/Frame 053859/0792 →
Priority Claims (1)
NZ 2016900710 · Feb 26, 2016 · national
Continuity (2)
Continuation 16078978
Related Publication 20210042816A1 · Feb 11, 2021