IP Library Granted Patent US 12,039,487
Granted Patent B2
US 12,039,487 · App. 17/411,271 · Granted Jul 16, 2024

Computer-vision pickup system and methods

Inventors: Kip Oliver Morgan (Atlanta, GA); Caleb Wayne Martinez (Fayetteville, GA); Aleah Jean Kadry (Atlanta, GA)
Assignee: NCR Voyix Corporation
G06Q10/0836G06Q30/0641G06T7/0002G06V10/70G06V30/40H04N7/185G06Q10/087G06T2207/10016G06V30/19007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,039,487
App. No.
17/411,271
Granted
Jul 16, 2024
Kind
B2
Abstract

Real-time video is captured of a pickup area for orders at a store. The images are analyzed and tracked for unique orders being placed in the pickup area and orders being removed from the pickup area. A customer-operated device is operated by a customer to identify the store where the customer placed an order in a remote location from the pickup area. Images of the orders that are present within the pickup area and order identifying information for the orders are provided to the customer via the customer-operated device.

Claims (39)

1. A method, comprising:

receiving an identifier for a retail store from a mobile device operated by a customer who placed an order with the retail store;

obtaining a video stream for a camera associated with a pickup area of the retail store where completed orders are placed when completed by the retail store based on the identifier;

monitoring the completed orders when placed in the pickup area and when removed from the pickup area by analyzing the video stream and producing completed order information from the video stream; and

rendering the completed order information in real time to an interface of the mobile device for viewing by the customer in a remote location from the pickup area.

2. The method of claim 1 , wherein receiving further includes causing the mobile device to download or to instantiate the interface on the mobile device.

3. The method of claim 2 , wherein causing further includes identifying a unique code that is provided by the interface during download or instantiation on the mobile device and mapping the unique code to the identifier.

4. The method of claim 1 , wherein receiving further includes generating a list of available retail stores, rendering the list within the interface, and receiving the identifier as a selection made from the list by the customer.

5. The method of claim 1 , wherein receiving further includes receiving store identifying information as search criteria entered by the customer through the interface and obtaining the identifier as a result of searching available stores.

6. The method of claim 1 , wherein obtaining further includes mapping the identifier to a camera identifier for the camera and identifying the video stream from a plurality of video streams associated with other cameras of other retail stores based on the camera identifier.

7. The method of claim 1 , wherein obtaining further includes establishing a network connection to the camera to receive the video feed in real time from the camera.

8. The method of claim 1 , wherein obtaining further includes identifying a network storage location or a network file that the camera is streaming the video feed into based on the identifier and reading the network storage location or the network file to obtain the video feed in real time.

9. The method of claim 1 , wherein monitoring further includes passing image frames from the video feed to a trained machine-learning model and receiving pixel coordinates for each completed order present within the video feed as output from the trained machine-learning model.

10. The method of claim 9 , wherein passing further includes adjusting pixels associated with the pixel coordinates based on a known camera angle of the camera and a known resolution of the camera and producing adjusted pixels for each completed order present within the video feed.

11. The method of claim 10 , wherein adjusting further includes performing Optical Character Recognition (OCR) on the adjusted pixels producing a searchable document comprising identifying text information for each completed order.

12. The method of claim 11 , wherein rendering further includes rendering the completed order information with the corresponding identifying text information for each completed order in a list view within the interface for searching and scrolling by the customer using the interface to determine whether the order placed by the customer is present within the pickup area.

13. A method, comprising:

registering a retailer for remote pickup order customer monitoring;

providing a code to a store of the retailer and obtaining access to a video feed produced by a camera located in a pickup area of the store during the registering;

receiving the code from a mobile device operated by a customer who placed an order with the store;

analyzing the video feed in real time and tracking each completed order and tracking each order ticket associated with each completed order as each completed order is placed in the pickup area or removed from the pickup area; and

rendering at least each order ticket in an interface accessible to the customer through the mobile device in response to the receiving of the code to provide remote pickup monitoring of the order placed by the customer with the store through the interface.

14. The method of claim 13 , wherein providing further includes obtaining access to a digital sign located outside of and adjacent to the store during the registering of the code and sending the code as a unique Quick Response (QR) code that identifies the store for displaying the QR code on the digital sign and for capturing by the mobile device.

15. The method of claim 14 , wherein receiving further includes obtaining the code and a mobile device identifier for the mobile device when a mobile device camera of the mobile device captures an image of the QR code from the digital sign and link the code to the store and the camera located in the pickup area.

16. The method of claim 13 , wherein analyzing further includes identifying each order ticket from the video feed and processing Optical Character Recognition (OCR) on pixels associated with each order ticket producing text-based ticket information tracked for each order ticket.

17. The method of claim 16 , wherein obtaining further includes generating a searchable document for each text-based ticket information of each order ticket.

18. The method of claim 13 further comprising, automatically updating the interface with revised order tickets when the video feed changes indicating a new completed order was placed in the pickup or when an existing completed order was removed from the pickup area.

19. A system, comprising:

a cloud processing environment comprising at least one server;

the at least one server comprising a processor and a non-transitory computer-readable storage medium;

the non-transitory computer-readable storage medium comprises executable instructions; and

the executable instructions when executed on the processor from the non-transitory computer-readable storage medium cause the processor to perform operations comprising:

receiving a code from a mobile device operated by a customer who is located externally to a store where the customer placed on order;

obtaining a video feed from a camera situated in an order pickup area within the store;

analyzing the video feed and identifying order ticket information for each completed order placed within the order pickup area and updating a list of completed orders each time a particular completed order is placed in the order pickup area or removed from the order pickup area; and

rendering the list in real time and each time the list is updated within an interface on the mobile device of the customer.

20. The system of claim 19 , wherein the executable instructions when executed on the processor from the non-transitory computer-readable storage medium further cause the processor to perform additional operations comprising:

receiving, through the interface, at least a portion of specific order ticket information for the order placed by the customer; and

alerting, through the interface, the customer when the specific order ticket information is identified during an update to the list.

Assignments (3)
CHANGE OF NAME Recorded Nov 9, 2023
From: NCR CORPORATION
To: NCR VOYIX CORPORATION
Reel/Frame 065532/0893 →
SECURITY INTEREST Recorded Oct 25, 2023
From: NCR VOYIX CORPORATION
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 065346/0168 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2021
From: MORGAN, KIP OLIVER; MARTINEZ, CALEB WAYNE; KADRY, ALEAH JEAN
To: NCR CORPORATION
Reel/Frame 057282/0447 →