IP Library › Granted Patent US 12,307,505
Granted Patent B2
US 12,307,505 · App. 18/226,367 · Granted May 20, 2025

System for eatery ordering with mobile interface and point-of-sale terminal

Inventors: Christopher Siefken (Charlotte, NC); Mahesh Kommareddi (Charlotte, NC); William Wine (Charlotte, NC); Arjun Wadwalkar (Charlotte, NC); Santiago Lopez (Medellin, CO); David Sanchez (Medellin, CO); Davison Anaya (Medellin, CO)
Assignee: Xenial, Inc.
G06Q30/0635G06F40/295G06N20/00G06Q20/20G06Q30/0641G06Q50/12G10L15/30G10L25/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,307,505
App. No.
18/226,367
Granted
May 20, 2025
Kind
B2
Abstract

A non-transitory computer-readable medium is configured to store instructions executable by one or more processors to perform operations including receiving, via an audio signal interface, audio data, processing the audio data to identify one or more speakers from which the audio data is produced, determining, from the processed audio data, an intention to place one or more orders, and communicating, in response to determining the intention, with at least one point-of-sale (POS) terminal to execute order processing.

Claims (26)

1. A system comprising:

at least one point-of-sale (POS) terminal comprising communication circuitry to permit wireless communication with a cloud-based computing system, the at least one POS terminal configured to perform order processing of one or more menu items of a menu of an eatery;

a processor configured to:

receive, via an audio signal interface, audio data comprising audio of at least an order corresponding the one or more menu items of the menu;

process the audio data to identify one or more speakers from which the audio data is produced, wherein the audio data is processed using machine learning to assign an individual identity to a speaker of the one or more speakers, wherein the processing comprises amplifying the audio data of the speaker of the one or more speakers, and wherein the machine learning comprises performing training using historical order transcripts corresponding to the one or more menu items in the menu;

link metadata of the audio data to the one or more speakers based on one or more segments of the audio data;

determine, from the processed audio data, at least one intention of the one or more menu items of the menu associated with at least one of a food item or a beverage item in the menu, wherein the at least one intention corresponds to a quantity of at least one of the food item or the beverage item; and

communicate, in response to determining the at least one intention and the corresponding quantity, with the at least one POS terminal to execute the order processing of the eatery.

2. The system of claim 1 , wherein the processor is configured to process the audio data in an online mode or an offline mode.

3. The system of claim 1 , wherein the audio data is received from a static file, the Internet, or via Bluetooth.

4. The system of claim 1 , wherein the processor is configured to generate the metadata comprising data relating to the at least one intention to place one or more orders, and to associate the metadata with the one or more speakers.

5. The system of claim 1 , wherein the at least one POS terminal is disposed in the eatery and the processor is part of the cloud-based computing system remote from the eatery.

6. The system of claim 1 , wherein the cloud-based computing system is configured to direct one or more orders to the at least one POS terminal.

7. The system of claim 1 , wherein processing the audio data further comprises identifying at least one match between a list of menu items and the audio data and at least one non-match between the list of menu items and the audio data, and wherein the list of menu items comprises menu items specific to the eatery.

8. The system of claim 1 , wherein the audio signal interface comprises a voice application programming interface (API) and a digital assistant configured to dialogue with the one or more speakers.

9. A method implementable via a cloud-based computing system, comprising:

receiving, by a processor, audio data via an audio signal interface comprising audio of at least an order corresponding one or more menu items of a menu of an eatery;

processing, by the processor, the audio data to identify one or more speakers from which the audio data is produced, wherein the audio data is processed using machine learning to assign an individual identity to a speaker of the one or more speakers, wherein the processing comprises amplifying the audio data of the speaker of the one or more speakers, and wherein the machine learning includes training using historical order transcripts corresponding to one or more menu items in the menu;

linking, by the processor, metadata of the audio data to the one or more speakers based on one or more segments of the audio data;

determining, by the processor, at least one intention of the one or more menu items of the menu based on the processed audio data associated with at least one of a food item or a beverage item in the menu, wherein the at least one intention corresponds to a quantity of at least one of the food item or the beverage item; and

communicating, by the processor in response to determining the at least one intention and the corresponding quantity, with at least one point-of-sale (POS) terminal to execute order processing of the one or more menu items of the menu of the eatery, the at least one POS terminal being configured to communicate wirelessly with the cloud-based computing system.

10. The method of claim 9 , further comprising processing, by the processor, the audio data in an online mode or an offline mode.

11. The method of claim 9 , wherein the audio data is received from a static file, the Internet, or via Bluetooth.

12. The method of claim 9 , further comprising generating, by the processor, the metadata comprising data relating to the at least one intention to place one or more orders, and to associate the metadata with the one or more speakers.

13. The method of claim 9 , wherein the at least one POS terminal is disposed in the eatery and the at least one POS terminal is part of a cloud-based computing system remote from the eatery.

14. The method of claim 13 , wherein the cloud-based computing system directs one or more orders to the at least one POS terminal.

Continuity (3)
Division 16800428 · Feb 25, 2020
Provisional Application 62810837 · Feb 26, 2019
Related Publication 20230368274A1 · Nov 16, 2023
References Cited (71)
US 7082314B2 · Farmer et al. · 2006 [cited by applicant]
US 7945479B2 · Asher et al. · 2011 [cited by applicant]
US 8112272B2 · Nagahama et al. · 2012 [cited by applicant]
US 8799083B1 · Silver · 2014 [cited by applicant]
US 9497528B2 · Song et al. · 2016 [cited by applicant]
US 9710800B2 · Yopp et al. · 2017 [cited by applicant]
US 9818405B2 · Arslan et al. · 2017 [cited by applicant]
US 9830906B2 · Inose et al. · 2017 [cited by applicant]
US 10043173B2 · Berlin · 2018 [cited by applicant]
US 10068007B1 · Wohlsen et al. · 2018 [cited by applicant]
US 10083688B2 · Piernot et al. · 2018 [cited by applicant]
US 10089983B1 · Gella et al. · 2018 [cited by applicant]
US 10360265B1 · Agarwal · 2019 [cited by applicant]
US 10490195B1 · Krishnamoorthy · 2019 [cited by examiner]
US 10592706B2 · Carpenter et al. · 2020 [cited by applicant]
US 10628635B1 · Carpenter et al. · 2020 [cited by applicant]
US 10706846B1 · Barton et al. · 2020 [cited by applicant]
US 10706848B1 · Greene · 2020 [cited by examiner]
US 10878824B2 · Carpenter et al. · 2020 [cited by applicant]
US 11023955B1 · Carpenter et al. · 2021 [cited by applicant]
US 11244681B1 · Siefken et al. · 2022 [cited by applicant]
US 11810550B2 · Shukla et al. · 2023 [cited by applicant]
US 11862157B2 · Aggarwal et al. · 2024 [cited by applicant]
US 20030018531A1 · Mahaffy et al. · 2003 [cited by applicant]
US 20040035644A1 · Ford et al. · 2004 [cited by applicant]
US 20040059571A1 · Ohtomo · 2004 [cited by applicant]
US 20050065789A1 · Yacoub et al. · 2005 [cited by applicant]
US 20050200455A1 · Veni, III et al. · 2005 [cited by applicant]
US 20050261901A1 · Davis et al. · 2005 [cited by applicant]
US 20060076397A1 · Langos · 2006 [cited by applicant]
US 20070230791A1 · Chellapilla et al. · 2007 [cited by applicant]
US 20080222004A1 · Pollock et al. · 2008 [cited by applicant]
US 20090055178A1 · Coon · 2009 [cited by applicant]
US 20120179538A1 · Hines · 2012 [cited by examiner]
US 20120201362A1 · Crossa et al. · 2012 [cited by applicant]
US 20140379338A1 · Fry · 2014 [cited by applicant]
US 20150121216A1 · Brown et al. · 2015 [cited by applicant]
US 20150193755A1 · Sibble · 2015 [cited by examiner]
US 20170278150A1 · Tucker · 2017 [cited by applicant]
US 20170293905A1 · Washington et al. · 2017 [cited by applicant]
US 20180308486A1 · Saddler et al. · 2018 [cited by applicant]
US 20180330731A1 · Zeitlin et al. · 2018 [cited by applicant]
US 20190080685A1 · Johnson, Jr. · 2019 [cited by applicant]
US 20190108566A1 · Coleman et al. · 2019 [cited by applicant]
US 20190259499A1 · Hong · 2019 [cited by examiner]
US 20200034848A1 · Seo et al. · 2020 [cited by applicant]
US 20200226667A1 · Kalaimani · 2020 [cited by applicant]
US 20200257299A1 · Wang · 2020 [cited by examiner]
US 20200311804A1 · Buckholdt et al. · 2020 [cited by applicant]
US 20200380040A1 · Yamamuro · 2020 [cited by examiner]
US 20220165262A1 · Sumpter et al. · 2022 [cited by applicant]
US 20220292834A1 · Desantola et al. · 2022 [cited by applicant]
US 20230316788A1 · Desantola et al. · 2023 [cited by applicant]
CN 107430858A · 2017 [cited by examiner]
EP 3040985A1 · 2016 [cited by applicant]
EP 3627498A1 · 2020 [cited by applicant]
JP 3629145B2 · 2005 [cited by examiner]
WO WO0221090A1 · 2002 [cited by applicant]
Article, “International Business Machines (IBM) issued new U.S. Pat. No. [9,666,225]; News Bites—Computing & Information [Melbourne] May 31, 2017.”, retrieved from Dialog on May 18, 2023 (Year: 2017). [cited by examiner]
Cour, Timothee ; “Weakly supervised learning from multiple modalities: Exploiting video, audio and text for video understanding”; ProQuest Dissertations and Theses ProQuest Dissertations & Theses. (2009 } retrieved from… [cited by examiner]
Communication pursuant to Article 94(3) EPC dated Nov. 16, 2022 issued in EP Application No. 20159571.7, 5 pages. [cited by applicant]
Communication pursuant to Article 94(3) EPC dated Sep. 13, 2022 issued in EP Application No. 20159571.7, 4 pages. [cited by applicant]
Extended European Search Report, Application No. 20159571.7, Jul. 10, 2020, 8 pages. [cited by applicant]
Final Office Action on U.S. Appl. No. 16/800,428 DTD Nov. 30, 2022. [cited by applicant]
Search Report on EP 20159571.7 DTD Jul. 10, 2020. [cited by applicant]
Garber, Amy, “Quick-service leaders eye life in the fast lane”, Nation's Restaurant News 39.50: 1,83-84, 86. Lebhar-Friedman, Inc. (Dec. 12, 2005). [cited by applicant]
Non-Final Office Action on U.S. Appl. No. 16/800,428 DTD Jun. 29, 2022. [cited by applicant]
Notice of Allowance on U.S. Appl. No. 16/800,428 DTD Apr. 12, 2023. [cited by applicant]
Tanabian et al. “Accent adaptation in speech user interface”; VECIMS 2005—IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement Systems 2005: 99-102. IEEE Computer Society. (D… [cited by applicant]
Tariqullah Jan et al., Cocktail Party Problem: Source Separation Issues and Computational Methods, IGI Global, 2011, 19 pages. [cited by applicant]
Tariqullah Jan et al., Cocktail Party Problem: Source Separation Issues and Computational Methods, IGI Global, 2011, 3 pages. [cited by applicant]