IP Library Granted Patent US 11,682,065
Granted Patent B2
US 11,682,065 · App. 16/903,115 · Granted Jun 20, 2023

Systems and methods for reducing service errors for restaurants

Inventors: Hao Hu (Sunnyvale, CA); Yanxia Zhang (Cupertino, CA); Qiong Liu (Cupertino, CA); Lynn Donelle Wilcox (Redwood City, CA)
Assignee: FUJIFILM Business Innovation Corp.
G06Q30/0635G05B13/027G06F3/0482G06F16/24558G06F18/22G06N3/045G06N3/08G06Q10/083G06Q50/12G06V10/454G06V10/82G06V20/52G06V40/10G06V40/173
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,682,065
App. No.
16/903,115
Granted
Jun 20, 2023
Kind
B2
Abstract

A computer-implemented method, comprising receiving an order associated with a user, and capturing information associated with a physical attribute of the user; for the order being completed, performing a matching operation on the physical attribute of the user and information associated with a region of the user that includes the physical attribute of the user and respective physical attributes of other users, to determine a closest match; and generating an output that identifies the user associated with the closest match in the information associated with the region of the user, and providing the output to a server to deliver the order to the user.

Claims (42)

1. A computer-implemented method, comprising:

receiving an order associated with a user, and capturing information associated with a physical attribute of the user using a portable device;

for the order being completed, receiving an information capturing request of a region of the user, and capturing, using the portable device, information associated with the region of the user;

performing a matching operation on the captured information associated with the physical attribute of the user and the captured information associated with the region of the user to determine a closest match based on the physical attribute of the user, wherein the information associated with the region of the user includes the physical attribute of the user and respective physical attributes of other users; and

generating an output that identifies the user associated with the closest match in the information associated with the region of the user, and providing the output to a server to deliver the order to the user, wherein the output comprises at least an image that identifies the user amongst the other users.

2. The computer-implemented method of claim 1 , wherein the matching operation comprises:

defining the captured information associated with the physical attribute of the user as a first input, and the information associated with the region of the user as a second input;

applying the first input and the second input to a convolutional neural network, to generate a prediction of a closest match between the physical attribute of the user in the first input and the physical attribute of the user and the physical attributes of the other users in the second input;

associating the prediction with an indicator in the region of the user; and

generating an output as a visual and/or audio label, for use in an edge device associated with the server.

3. The computer-implemented method of claim 2 , wherein the convolutional neural network comprises a feature space integrated with spaces for which batch normalization, similarity loss and attentive fusion have been performed.

4. The computer-implemented method of claim 1 , wherein the receiving the order associated with the user comprises providing the user with a plurality of options in a user interface, such that the user selects an option that is transmitted by network communication to a processor that performs the matching, and the information associated with the physical attribute of the user comprises capturing an image of the user and locational information of the user.

5. The computer-implemented method of claim 1 , wherein the providing the output to the server to deliver the order comprises at least one of providing an image of the region in which the user is located, which identifies the user amongst the other users, or providing the server with one or more audio signals that allow the user to physically move the order from a current location to a position of the user.

6. The computer-implemented method of claim 1 , wherein the user comprises a customer in a restaurant, the order comprises a selection from a menu of the restaurant, and the server comprises a human or automated delivery machine that takes the order, after completion and the providing of the output, to the customer, amongst the other users that comprise other customers located in the restaurant.

7. The computer-implemented method of claim 1 , wherein the physical attribute of the user is captured by one or more cameras positioned in the region of the user, or on the server processing the order.

8. A non-transitory computer readable medium including instructions executable on a processor, the instructions comprising:

receiving an order associated with a user, and capturing information associated with a physical attribute of the user using a portable device;

for the order being completed, receiving an information capturing request of a region of the user, and capturing, using the portable device, information associated with the region of the user;

performing a matching operation on the captured information associated with the physical attribute of the user and the captured information associated with the region of the user to determine a closest match based on the physical attribute of the user, wherein the information associated with the region of the user includes the physical attribute of the user and respective physical attributes of other users; and

generating an output that identifies the user associated with the closest match in the information associated with the region of the user, wherein the output comprises at least an image that identifies the user amongst the other users, and providing the output to a server to deliver the order to the user.

9. The non-transitory computer readable medium of claim 8 , wherein the matching operation comprises:

defining the captured information associated with the physical attribute of the user as a first input, and the information associated with the region of the user as a second input;

applying the first input and the second input to a convolutional neural network, to generate a prediction of a closest match between the physical attribute of the user in the first input and the physical attribute of the user and the physical attributes of the other users in the second input;

associating the prediction with an indicator in the region of the user; and

generating an output as a visual and/or audio label, for use in an edge device associated with the server.

10. The non-transitory computer readable medium of claim 9 , wherein the convolutional neural network comprises a feature space integrated with spaces for which batch normalization, similarity loss and attentive fusion have been performed.

11. The non-transitory computer readable medium of claim 8 , wherein the receiving the order associated with the user comprises providing the user with a plurality of options in a user interface, such that the user selects an option that is transmitted by network communication to a processor that performs the matching, and the information associated with the physical attribute of the user comprises capturing an image of the user and locational information of the user.

12. The non-transitory computer readable medium of claim 8 , wherein the providing the output to the server to deliver the order comprises at least one of providing an image of the region in which the user is located, which identifies the user amongst the other users, or providing the server with one or more audio signals that allow the user to physically move the order from a current location to a position of the user.

13. The non-transitory computer readable medium of claim 8 , wherein the user comprises a customer in a restaurant, the order comprises a selection from a menu of the restaurant, and the server comprises a human or automated delivery machine that takes the order, after completion and the providing of the output, to the customer, amongst the other users that comprise other customers located in the restaurant.

14. The non-transitory computer readable medium of claim 8 , wherein the physical attribute of the user is captured by one or more cameras positioned in the region of the user, or on the server processing the order.

15. A system, comprising:

an input device that receives an order associated with a user;

a sensor that captures information associated with a physical attribute of the user, wherein the sensor is located on a portable device;

a processor, which, for the order being completed, configured to receive an information capturing request of a region of the user, and captures, using the sensor, information associated with the region of the user;

the processor is configured to perform matching on the captured information associated with the physical attribute of the user and the captured information associated with the region of the user to determine a closest match based on the physical attribute of the user, wherein the information associated with the region of the user includes the physical attribute of the user and respective physical attributes of other users, and

the processor is configured to generate an output that identifies the user associated with the closest match in the information associated with the region of the user, wherein the output comprises at least an image that identifies the user amongst the other users; and

a server device that receives the output and provides the output to the server to deliver the order to the user.

16. The system of claim 15 , wherein the matching comprises defining the captured information associated with the physical attribute of the user as a first input, and the information associated with the region of the user as a second input, applying the first input and the second input to a convolutional neural network, to generate a prediction of a closest match between the physical attribute of the user in the first input and the physical attribute of the user and the physical attributes of the other users in the second input, associating the prediction with an indicator in the region of the user, and generating an output as a visual and/or audio label, for use in an edge device associated with the server, wherein the convolutional neural network comprises a feature space integrated with spaces for which batch normalization, similarity loss and attentive fusion have been performed.

17. The system of claim 15 , wherein the input device provides the user with a plurality of options in a user interface, such that the user selects an option that is transmitted by network communication to a processor that performs the matching, and the sensor comprises a camera that captures an image of the user and locational information of the user.

18. The system of claim 15 , wherein the server device displays an image of the region in which the user is located, which identifies the user amongst the other users, or provides the server with one or more audio signals that allow the user to physically move the order from a current location to a position of the user.

19. The system of claim 15 , wherein the user comprises a customer in a restaurant, the order comprises a selection from a menu of the restaurant, and the server comprises a human or automated delivery machine that takes the order, after completion and the providing of the output, to the customer, amongst the other users that comprise other customers located in the restaurant.

20. The server of claim 15 , wherein the physical attribute of the user is captured by one or more cameras positioned in the region of the user, or on the server processing the order.

Assignments (2)
CHANGE OF NAME Recorded May 25, 2021
From: FUJI XEROX CO., LTD.
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 056392/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2020
From: HU, HAO; ZHANG, YANXIA; LIU, QIONG; WILCOX, LYNN DONELLE
To: FUJI XEROX CO., LTD.
Reel/Frame 052955/0480 →
Continuity (1)
Related Publication 20210390635A1 · Dec 16, 2021