IP Library Granted Patent US 12,518,753
Granted Patent B2
US 12,518,753 · App. 17/667,535 · Granted Jan 6, 2026

Recommendation engine for upselling in restaurant orders

Inventors: Kamyar Mohajer (Mississauga, CA); Robert Macrae (Mountain View, CA)
Assignee: SOUNDHOUND AI IP, LLC
G10L15/22G06F16/22G06F16/243G06F16/2457G06F16/24575G10L15/1822G10L15/30G10L17/00G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,518,753
App. No.
17/667,535
Granted
Jan 6, 2026
Kind
B2
Abstract

A computer-implemented method is provided to support a food ordering system for food items from a menu of a restaurant using natural language. Expressions made for ordering are used to recommend a food item that a user has a high probability of wanting to include in an order. The recommendation engine is trained using machine learning. Expressions are collected and parsed to identify words that might indicate food items offered by the restaurant. The words are provided to a restaurant owner to identify food items on a menu, with which the words are associated.

Claims (24)

1 . A computer-implemented method comprising:

collecting spoken natural language expressions of a multiplicity of users of a food ordering system for a restaurant, the restaurant offering a menu of food items;

parsing the spoken natural language expressions to identify words being menu items to be included in the order and on the menu;

computing numbers of expressions using the identified words;

informing a system designer or restaurant owner of at least one identified word, which is unknown, from the identified words, wherein the at least one identified word appears with a predetermined ratio relative to identified words;

receiving, from the system designer or restaurant owner, an identification of an item on the menu that is to be associated with the at least one identified word; and

configuring the food ordering system to recognize the at least one identified word as a reference to the item so that the at least one identified word that is unknown is associated with the item and can be parsed and as a known identified word that is part of the items on the menu.

2 . The method of claim 1 , wherein identifying words being menu items includes recognizing at least one of acoustic and phonetic attributes of the natural language expressions to detect information about the natural language expressions in order to determine recommendations.

3 . The method of claim 1 , wherein identifying words being menu items includes searching for the words in a synonym database and searching for synonyms in descriptions of the food items.

4 . A food ordering system for a restaurant, the system comprising a processor and non-transitory memory, which stored code, wherein the processor executes the stored code and causes the food ordering system to:

parse, using a parser, spoken natural language expressions, which are collected from a multiplicity of users of the system to determine if the natural language expressions are items to be included in an order, to identify unknown words relative to menu items to produce identified words;

compute numbers of expressions of the identified words;

store in memory at least one of the identified words, wherein the at least one of the identified words appears with a predetermined ratio relative to other identified words;

identify a menu item on the menu associated with the at least one identified word; and

modify the system to recognize the at least one identified word as a reference to the menu item so that future unknown words are associated with menu items on the menu.

5 . A computer-implemented method comprising:

collecting spoken natural language expressions of a multiplicity of users of a food ordering system for a restaurant, the restaurant offering a menu of food items;

parsing the spoken natural language expressions using a language model to identify words being menu items to be included in the order and on the menu;

computing numbers of expressions using the identified words;

informing a system designer or restaurant owner of at least one identified word, which is unknown, from the identified words, wherein the at least one identified word appears with a predetermined ratio relative to identified words;

receiving, from the system designer or restaurant owner, an identification of an item on the menu that is to be associated with the at least one identified word; and

updating the language model to recognize the at least one identified word as a reference to the item so that the at least one identified word that is unknown is associated with the item and can be parsed by the language model as a known identified word that is part of the items on the menu.

6 . The method of claim 5 , wherein identifying words being menu items includes recognizing at least one of acoustic and phonetic attributes of the natural language expressions to detect information about the natural language expressions in order to determine recommendations.

7 . The method of claim 5 , wherein identifying words being menu items includes searching for the words in a synonym database and searching for synonyms in descriptions of the food items.

Assignments (7)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2022
From: MACRAE, ROBERT; MOHAJER, KAMYAR
To: SOUNDHOUND, INC.
Reel/Frame 059274/0559 →
Continuity (3)
Continuation In Part 16447958 · Jun 20, 2019
Continuation 15670975 · Aug 7, 2017
Related Publication 20220165272A1 · May 26, 2022
References Cited (70)
US 5010478A · Deran · 1991 [cited by applicant]
US 7328216B2 · Hofmann et al. · 2008 [cited by applicant]
US 7668821B1 · Donsbach et al. · 2010 [cited by applicant]
US 7970767B2 · Probst et al. · 2011 [cited by applicant]
US 8005842B1 · Pasca et al. · 2011 [cited by applicant]
US 8117199B2 · Ghani et al. · 2012 [cited by applicant]
US 9652799B2 · Boston et al. · 2017 [cited by applicant]
US 9892208B2 · Anastasakos · 2018 [cited by examiner]
US 9922352B2 · Tegegne et al. · 2018 [cited by applicant]
US 9978362B2 · Dolan et al. · 2018 [cited by applicant]
US 10073892B1 · Khare et al. · 2018 [cited by applicant]
US 10599390B1 · Brahmbhatt et al. · 2020 [cited by applicant]
US 10685181B2 · Birnbaum et al. · 2020 [cited by applicant]
US 11176626B1 · Ismael · 2021 [cited by examiner]
US 12131394B1 · Pokkunuri · 2024 [cited by examiner]
US 20050004880A1 · Musgrove et al. · 2005 [cited by applicant]
US 20070276651A1 · Bliss · 2007 [cited by examiner]
US 20070282892A1 · Probst et al. · 2007 [cited by applicant]
US 20090089273A1 · Hicks · 2009 [cited by applicant]
US 20100030764A1 · Koren · 2010 [cited by applicant]
US 20100262570A1 · Tateno et al. · 2010 [cited by applicant]
US 20110040790A1 · Tateno · 2011 [cited by applicant]
US 20110252031A1 · Blumenthal et al. · 2011 [cited by applicant]
US 20130080371A1 · Harber et al. · 2013 [cited by applicant]
US 20130204740A1 · Barbieri et al. · 2013 [cited by applicant]
US 20130339163A1 · Dumontet · 2013 [cited by examiner]
US 20140074828A1 · Mathur · 2014 [cited by applicant]
US 20140143720A1 · Dimarco et al. · 2014 [cited by applicant]
US 20140164172A1 · Du et al. · 2014 [cited by applicant]
US 20140257795A1 · Birnbaum et al. · 2014 [cited by applicant]
US 20140304106A1 · Dahan · 2014 [cited by applicant]
US 20150073932A1 · Nice et al. · 2015 [cited by applicant]
US 20150154685A1 · Pope et al. · 2015 [cited by applicant]
US 20150234820A1 · Aravamudan et al. · 2015 [cited by applicant]
US 20150278917A1 · Stoll et al. · 2015 [cited by applicant]
US 20160125048A1 · Hamada et al. · 2016 [cited by applicant]
US 20160163311A1 · Crook et al. · 2016 [cited by applicant]
US 20160180476A1 · Talwar · 2016 [cited by examiner]
US 20160259862A1 · Navanageri et al. · 2016 [cited by applicant]
US 20160275594A1 · Mullakkara et al. · 2016 [cited by applicant]
US 20160314200A1 · Markman et al. · 2016 [cited by applicant]
US 20160378757A1 · Bahl · 2016 [cited by applicant]
US 20170032477A1 · Kamen et al. · 2017 [cited by applicant]
US 20170200207A1 · Aswani et al. · 2017 [cited by applicant]
US 20180052842A1 · Hewavitharana et al. · 2018 [cited by applicant]
US 20180101888A1 · Akkiraju et al. · 2018 [cited by applicant]
US 20180157664A1 · Howell · 2018 [cited by examiner]
US 20180173698A1 · Dubey · 2018 [cited by examiner]
US 20180189857A1 · Wu et al. · 2018 [cited by applicant]
US 20190171711A1 · Carpenter, II · 2019 [cited by examiner]
US 20190172445A1 · Tomita · 2019 [cited by examiner]
US 20200192984A1 · Chen · 2020 [cited by examiner]
US 20210081426A1 · Gaudet · 2021 [cited by examiner]
US 20210082437A1 · Thomas · 2021 [cited by examiner]
US 20220084096A1 · Belousova · 2022 [cited by examiner]
US 20220165262A1 · Sumpter · 2022 [cited by examiner]
US 20220270591A1 · Shukla · 2022 [cited by examiner]
US 20220328039A1 · Avijeet · 2022 [cited by examiner]
CN 105955981A · 2016 [cited by applicant]
CN 106354855A · 2017 [cited by applicant]
WO WO2021226313A1 · 2021 [cited by examiner]
Brian Whitman, et al., Inferring Descriptions and Similarity for Music from Community Metadata, International Computer Music Association, 2002. [cited by applicant]
Claudiu S. Firan, et al., The Benefit of Using Tag-Based Profiles, Proceedings of the 2007 Latin American Web Conference, pp. 32-41 Nov. 2, 2007. [cited by applicant]
Kate Ching-Ju Lin, et al., SocioNet: A Social-Based Multimedia Access System for Unstructured P2P Networks, IEEE Transactions on Parallel and Distributed Systems, vol. 21, No. 7, Jul. 2010. [cited by applicant]
Michael Fleischman, et al., Recommendations Without User Preferences: A Natural Language Processing Approach, 2003. [cited by applicant]
Pasquale Lops, et al., Content-based Recommender Systems: State of the Art and Trends, Recommender Systems Handbook, Springer, 2011. [cited by applicant]
Pasquale Lops., et al., Improving Social Filtering Techniques Through WordNet-Based User Profiles, Springer-Verlag Berlin Heidelberg, UM 2007, LNAI 4511, pp. 268-277, 2007. [cited by applicant]
Shuo Chang, et al., Crowd-Based Personalized Natural Language Explanations for Recommendations, ACM, RecSys 16, Sep. 15-19, 2016, Boston , MA, USA. [cited by applicant]
Stephan Baumann, et al., Using natural language input and audio analysis for a human-oriented MIR system, Wedelmusic 2002. [cited by applicant]
Notification of Reexamination in Chinese Patent Application No. 201711364892.3 dated May 22, 2025. [cited by applicant]