IP Library Granted Patent US 11,651,404
Granted Patent B2
US 11,651,404 · App. 17/462,129 · Granted May 16, 2023

Virtual shopping assistant

Inventors: Kenneth Gambon (Erie, CO); Hasibe Göçülü (Selcuklu, TR); Saravanan Shanmugam (Chennai, IN)
Assignee: KYNDRYL, INC.
G06Q30/0619G06Q20/12G06Q30/04G06Q30/0635G05B2219/50391G06F21/31G06K7/1413G06K7/1447
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,404
App. No.
17/462,129
Granted
May 16, 2023
Kind
B2
Abstract

In an approach to provide contact-less shopping assistance to a user, a computer implements a method for receiving customer authentication data from a user and associating the customer authentication data with a tagged wearable device and a tagged mobility device with the user. The method further includes receiving an indication the user is wearing the tagged mobility device, and that the user is entering a shopping facility using the tagged mobility device. The method further includes receiving a user instruction to capture an image causing the tagged wearable device to capture the image, identifying a bar code in the image, determining an item based on the bar code and transmitting an action instruction to the tagged mobility device to retrieve the item and secure the item. The method further includes receiving an indication that the user has completed the task and delivering the item to the user.

Claims (78)

1. A computer-implemented method comprising:

receiving, by one or more processors, customer authentication data from a user at a local device to perform a task;

determining, by one or more processors, the user is authorized to perform the task based on the customer authentication data;

responsive to determining the user is authorized, associating, by the one or more processors, the customer authentication data with a tagged wearable device and a tagged mobility device with the user;

transmitting, by one or more processors, release instructions to the local device to release the tagged wearable device and the tagged mobility device to the user;

receiving, by one or more processors, a first indication that the user is wearing the tagged wearable device;

receiving, by one or more processors, a second indication that the user is entering a shopping facility using the tagged mobility device;

receiving, by one or more processors, a user instruction to capture an image causing the tagged wearable device to capture the image;

identifying, by one or more processors, a bar code in the image;

determining, by one or more processors, an item based on the bar code;

generating, by one or more processors, a user prompt requesting an item quantity;

updating, by one or more processors, a database with the item quantity;

transmitting, by one or more processors, an action instruction to the tagged mobility device to retrieve the item and secure the item; and

receiving, by one or more processors, a third indication that the user has completed the task.

2. The computer-implemented method of claim 1 , further comprising:

receiving, by the one or more processors, a fourth indication that the tagged wearable device was deposited at the local device.

3. The computer-implemented method of claim 1 , further comprising:

generating, by one or more processors, an invoice based at least on the item, the item quantity, and the customer authentication data;

providing, by one or more processors, the invoice to the user; and

processing, by one or more processors, payment information received from the user.

4. The computer-implemented method of claim 1 , wherein the customer authentication data is received by scanning a customer card programmed with user data associated with the user.

5. The computer-implemented method of claim 1 , wherein the tagged wearable device is an augmented reality (AR) wearable smart glasses device.

6. The computer-implemented method of claim 1 , wherein the tagged mobility device is a robotic smart shopping cart comprising a robotic arm for selecting items from the shopping facility.

7. The computer-implemented method of claim 1 , further comprising:

responsive to receiving the third indication that the user has completed the task, delivering, by one or more processors, the item to the user.

8. A computer program product, the computer program product comprising:

one or more computer readable storage media and program instructions collectively stored on the one or more computer readable storage media, the stored program instructions comprising program instructions to perform a computer-implemented method comprising:

receiving customer authentication data from a user at a local device to perform a task;

determining the user is authorized to perform the task based on the customer authentication data;

responsive to determining the user is authorized, associating the customer authentication data with a tagged wearable device and a tagged mobility device with the user;

transmitting release instructions to the local device to release the tagged wearable device and the tagged mobility device to the user;

receiving a first indication that the user is wearing the tagged wearable device;

receiving a second indication that the user is entering a shopping facility using the tagged mobility device;

receiving a user instruction to capture an image causing the tagged wearable device to capture the image;

identifying a bar code in the image;

determining an item based on the bar code;

generating a user prompt requesting an item quantity;

updating a database with the item quantity;

transmitting an action instruction to the tagged mobility device to retrieve the item and secure the item; and

receiving a third indication that the user has completed the task.

9. The computer program product of claim 8 , further comprising:

receiving a fourth indication that the tagged wearable device was deposited at the local device.

10. The computer program product of claim 8 , further comprising:

generating an invoice based at least on the item, the item quantity, and the customer authentication data;

providing the invoice to the user; and

processing payment information received from the user.

11. The computer program product of claim 8 , wherein the customer authentication data is received by scanning a customer card programmed with user data associated with the user.

12. The computer program product of claim 8 , wherein the tagged wearable device is an augmented reality (AR) wearable smart glasses device.

13. The computer program product of claim 8 , wherein the tagged mobility device is a robotic smart shopping cart comprising a robotic arm for selecting items from the shopping facility.

14. The computer program product of claim 8 , further comprising:

responsive to receiving the third indication that the user has completed the task, delivering the item to the user.

15. A computer system, the computer system comprising:

one or more computer processors;

one or more computer readable storage media;

program instructions collectively stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the stored program instructions comprising program instructions to perform a computer-implemented method comprising:

receiving customer authentication data from a user at a local device to perform a task;

determining the user is authorized to perform the task based on the customer authentication data;

responsive to determining the user is authorized, associating the customer authentication data with a tagged wearable device and a tagged mobility device with the user;

transmitting release instructions to the local device to release the tagged wearable device and the tagged mobility device to the user;

receiving a first indication that the user is wearing the tagged wearable device;

receiving a second indication that the user is entering a shopping facility using the tagged mobility device;

receiving a user instruction to capture an image causing the tagged wearable device to capture the image;

identifying a bar code in the image;

determining an item based on the bar code;

generating a user prompt requesting an item quantity;

updating a database with the item quantity;

transmitting an action instruction to the tagged mobility device to retrieve the item and secure the item; and

receiving a third indication that the user has completed the task.

16. The computer system of claim 15 , further comprising:

receiving a fourth indication that the tagged wearable device was deposited at the local device.

17. The computer system of claim 15 , further comprising:

generating an invoice based at least on the item, the item quantity, and the customer authentication data;

providing the invoice to the user; and

processing payment information received from the user.

18. The computer system of claim 15 , wherein the customer authentication data is received by scanning a customer card programmed with user data associated with the user.

19. The computer system of claim 15 , wherein the tagged wearable device is an augmented reality (AR) wearable smart glasses device.

20. The computer system of claim 15 , further comprising:

responsive to receiving the third indication that the user has completed the task, delivering the item to the user, wherein the tagged mobility device is a robotic smart shopping cart comprising a robotic arm for selecting items from the shopping facility.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: KYNDRYL, INC.
Reel/Frame 058213/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2021
From: GAMBON, KENNETH; GÖÇÜLÜ, HASIBE; SHANMUGAM, SARAVANAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 057337/0583 →