IP Library Granted Patent US 12,373,091
Granted Patent B1
US 12,373,091 · App. 16/377,998 · Granted Jul 29, 2025

System and method for intelligent multi-modal interactions in merchandise and assortment planning

Inventors: Machiraju Pakasasana Rama Rao (Hyderabad, IN); Arun Raj Parwana Adiraju (Hyderabad, IN); Pawan Kumar Singh (Hyderabad, IN); Abhinav Kishore (Hyderabad, IN); Vineet Chaudhary (Hyderabad, IN)
Assignee: Blue Yonder Group, Inc.
G06F3/0487G06Q10/10G06F3/013G06F3/017G06F3/03543G06F3/0488G06F3/0489G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,091
App. No.
16/377,998
Granted
Jul 29, 2025
Kind
B1
Abstract

A system and method are disclosed for generating intelligent multi-modal system actions based, at least in part, on predicting a user action and one or more stored user inputs. Embodiments include a database and a computer comprising a processor and memory, the computer is configured to monitor user inputs using one or more sensors and one or more tactile interface devices, detect at least two modes of user input and store the user inputs in the database. The computer is further configured to evaluate the stored user inputs in the database and the at least two modes of user input to generate a system action and generate a system action based, at least in part, on predicting a user action and one or more stored user inputs.

Claims (65)

1. A system for assortment planning for products, comprising an assortment planner communicatively coupled to an inventory system over a network, the assortment planner further comprising:

a computer coupled with a database and comprising a processor and memory, the computer configured to:

monitor two or more modes of user inputs using one or more sensors and one or more tactile interface devices;

detect at least two modes of user input and store the at least two modes of user inputs in the database;

evaluate the stored user inputs in the database and the at least two modes of user input by deriving an inference based on determining whether a multinomial model or a Bernoulli model provides a better predictive model of the stored user inputs and based on applying a singular threshold duration to a mode of the at least two modes of user input;

predict a system action based on the derived inference, wherein the system action is directed to assortment planning;

generate the system action based on the prediction derived from the inference and the one or more stored user inputs;

monitor user input in response to the generated system action;

execute the user input instead of the generated system action based on a prioritization;

evaluate the monitored user input to adjust the predictive model based at least in part on a number of negative responses to the generated system action;

generate a product assortment by indicating the products that will be included or excluded in the product assortment for a particular planning period based on data regarding sales, profitability, transferable demand or similarity, for any one or more products or assortments; and

calculate a purchase quantity of items in the product assortment and place an order based on the product assortment.

2. The system of claim 1 , wherein the computer is further configured to:

track a user's identity throughout subsequent user interactions;

detect an additional user input;

store the additional user input in the database;

evaluate the stored additional user input in the database and the at least two modes of user input to generate a subsequent system action tailored to the identified user; and

generate a subsequent system action based on predicting a user action and the user's determined identity.

3. The system of claim 2 , wherein the computer is further configured to identify, track, and generate system actions for multiple users simultaneously.

4. The system of claim 1 , wherein the system action comprises one or more of generating a personalized application, opening a workspace, and rendering data for display.

5. The system of claim 1 , wherein the one or more sensors comprise one or more of an imaging sensor, a radio receiver, and a microphone.

6. The system of claim 1 , wherein the user input comprises one or more of keyboard input, mouse input, touch input, voice input, gestures, and eye movement.

7. A computer-implemented method for assortment planning for products, comprising:

providing a system comprising an assortment planner communicatively coupled to an inventory system over a network, wherein the assortment planner comprises a database and a computer, the computer comprising a processor and memory;

monitoring, using one or more sensors and one or more tactile interface devices, two or more modes of user inputs to the system;

detecting at least two modes of user input and storing the at least two modes of user inputs in the database;

evaluating the stored user inputs in the database and the at least two modes of user input by deriving an inference based on determining whether a multinomial model or a Bernoulli model provides a better predictive model of the stored user inputs and based on applying a singular threshold duration to a mode of the at least two modes of user input;

predicting a system action based on the derived inference, wherein the system action is directed to assortment planning;

generating the system action based on the prediction derived from the inference and the one or more stored user inputs;

monitoring user input in response to the generated system action;

executing the user input instead of the generated system action based on a prioritization;

evaluating the monitored user input to adjust the predictive model based at least in part on a number of negative responses to the generated system action;

generating a product assortment by indicating the products that will be included or excluded in the product assortment for a particular planning period based on data regarding sales, profitability, transferable demand or similarity, for any one or more products or assortments; and

calculating a purchase quantity of items in the product assortment and placing an order based on the product assortment.

8. The computer-implemented method of claim 7 , further comprising:

tracking a user's identity throughout subsequent user interactions;

detecting an additional user input;

storing the additional user input in the database;

evaluating the stored additional user input in the database and the at least two modes of user input to generate a subsequent system action tailored to the identified user; and

generating a subsequent system action based on predicting a user action and the user's determined identity.

9. The computer-implemented method of claim 8 , further comprising:

identifying, tracking, and generating system actions for multiple users simultaneously.

10. The computer-implemented method of claim 7 , wherein the system action comprises one or more of generating a personalized application, opening a workspace, and rendering data for display.

11. The computer-implemented method of claim 7 , wherein the one or more sensors comprise one or more of an imaging sensor, a radio receiver, and a microphone.

12. The computer-implemented method of claim 7 , wherein the user input comprises on or more of keyboard input, mouse input, touch input, voice input, gestures, and eye movement.

13. A non-transitory computer-readable storage medium embodied with software for assortment planning for products, the software when executed configured to:

monitor, using one or more sensors and one or more tactile interface devices, two or more modes of user inputs to a system, the system comprising an assortment planner communicatively coupled to an inventory system over a network, wherein the assortment planner comprises a database and a computer, the computer comprising a processor and memory;

detect at least two modes of user input and store the at least two modes of user inputs in the database;

evaluate the stored user inputs in the database and the at least two modes of user input by deriving an inference based on determining whether a multinomial model or a Bernoulli model provides a better predictive model of the stored user inputs and based on applying a singular threshold duration to a mode of the at least two modes of user input;

predict a system action based on the derived inference, wherein the system action is directed to assortment planning;

generate the system action based on the prediction derived from the inference and the one or more stored user inputs;

monitor user input in response to the generated system action; execute the user input instead of the generated system action based on a prioritization;

evaluate the monitored user input to adjust the predictive model based at least in part on a number of negative responses to the generated system action;

generate a product assortment by indicating the products that will be included or excluded in the product assortment for a particular planning period based on data regarding sales, profitability, transferable demand or similarity, for any one or more products or assortments; and

calculate a purchase quantity of items in the product assortment and place an order based on the product assortment.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the software is further configured to:

track a user's identity throughout subsequent user interactions;

detect an additional user input;

store the additional user input in the database;

evaluate the stored additional user input in the database and the at least two modes of user input to generate a subsequent system action tailored to the identified user; and

generate a subsequent system action based on predicting a user action and the user's determined identity.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the software is further configured to identify, track, and generate system actions for multiple users simultaneously.

16. The non-transitory computer-readable storage medium of claim 13 , wherein the system action comprises one or more of generating a personalized application, opening a workspace, and rendering data for display.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the one or more sensors comprise one or more of an imaging sensor, a radio receiver, and a microphone.

18. The non-transitory computer-readable storage medium of claim 13 , wherein the user input comprises on or more of keyboard input, mouse input, touch input, voice input, gestures, and eye movement.

Assignments (5)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053383/0117) Recorded Nov 3, 2021
From: U.S. BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: BLUE YONDER GROUP, INC.
Reel/Frame 058794/0776 →
RELEASE OF SECURITY INTEREST Recorded Sep 16, 2021
From: JPMORGAN CHASE BANK, N.A.
To: BLUE YONDER GROUP, INC.; BLUE YONDER, INC.; JDA SOFTWARE SERVICES, INC.; I2 TECHNOLOGIES INTERNATIONAL SERVICES, LLC; MANUGISTICS SERVICES, INC.; MANUGISTICS HOLDINGS DELAWARE II, INC.; REDPRAIRIE COLLABORATIVE FLOWCASTING GROUP, LLC; JDA SOFTWARE RUSSIA HOLDINGS, INC.; REDPRAIRIE SERVICES CORPORATION; BY BOND FINANCE, INC.; BY NETHERLANDS HOLDING, INC.; BY BENELUX HOLDING, INC.
Reel/Frame 057724/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2021
From: RAO, MACHIRAJU PAKASASANA RAMA; ADIRAJU, ARUN RAJ PARWANA; KISHORE, ABHINAV; CHAUDHARY, VINEET; SINGH, PAWAN KUMAR
To: JDA SOFTWARE GROUP, INC.
Reel/Frame 055994/0898 →
SECURITY AGREEMENT Recorded Aug 3, 2020
From: BLUE YONDER GROUP, INC.
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 053383/0117 →
CHANGE OF NAME Recorded Apr 14, 2020
From: JDA SOFTWARE GROUP, INC.
To: BLUE YONDER GROUP, INC.
Reel/Frame 052393/0344 →
Continuity (1)
Provisional Application 62678671 · May 31, 2018
References Cited (85)
US 5390281A · Luciw · 1995 [cited by examiner]
US 5726688A · Siefert · 1998 [cited by examiner]
US 6021403A · Horvitz · 2000 [cited by examiner]
US 6421453B1 · Kanevsky · 2002 [cited by examiner]
US 6567838B1 · Korenshtein · 2003 [cited by examiner]
US 7409356B1 · Geddes · 2008 [cited by examiner]
US 7519566B2 · Prigogin · 2009 [cited by examiner]
US 7644863B2 · Chen · 2010 [cited by examiner]
US 7679534B2 · Kay · 2010 [cited by examiner]
US 8364612B2 · Van Gael · 2013 [cited by examiner]
US 8650139B2 · Jain · 2014 [cited by examiner]
US 8843429B2 · Wang · 2014 [cited by examiner]
US 9152221B2 · Denker · 2015 [cited by examiner]
US 9165280B2 · Basson · 2015 [cited by examiner]
US 9197716B2 · Igelka · 2015 [cited by examiner]
US 9245225B2 · Winn · 2016 [cited by examiner]
US 9391986B2 · Schultz · 2016 [cited by examiner]
US 9508041B2 · Zhang · 2016 [cited by examiner]
US 9519408B2 · Shoemaker · 2016 [cited by examiner]
US 9536000B2 · Ramaiyer · 2017 [cited by examiner]
US 9558452B2 · Guiver · 2017 [cited by examiner]
US 9646317B2 · John · 2017 [cited by examiner]
US 10091180B1 · Moritz · 2018 [cited by examiner]
US 10504029B2 · Edelen · 2019 [cited by examiner]
US 11501042B2 · Steingrimsson · 2022 [cited by examiner]
US 20050017954A1 · Kay · 2005 [cited by examiner]
US 20060247915A1 · Bradford · 2006 [cited by examiner]
US 20080319827A1 · Yee · 2008 [cited by examiner]
US 20090192798A1 · Basson · 2009 [cited by examiner]
US 20090307162A1 · Bui · 2009 [cited by examiner]
US 20100115610A1 · Tredoux · 2010 [cited by examiner]
US 20100198768A1 · Zhou · 2010 [cited by examiner]
US 20100318576A1 · Kim · 2010 [cited by examiner]
US 20110258045A1 · Chickering · 2011 [cited by examiner]
US 20120023226A1 · Petersen · 2012 [cited by examiner]
US 20120324403A1 · Van De Ven · 2012 [cited by examiner]
US 20130311411A1 · Senanayake · 2013 [cited by examiner]
US 20140075328A1 · Hansen · 2014 [cited by examiner]
US 20140108994A1 · Medlock · 2014 [cited by examiner]
US 20140156566A1 · Kabiljo · 2014 [cited by examiner]
US 20140351189A1 · Winn · 2014 [cited by examiner]
US 20150134389A1 · Punera · 2015 [cited by examiner]
US 20150142717A1 · Guiver · 2015 [cited by examiner]
US 20150185995A1 · Shoemaker · 2015 [cited by examiner]
US 20150261399A1 · Puzis · 2015 [cited by examiner]
US 20150371023A1 · Chen · 2015 [cited by examiner]
US 20160036931A1 · Mathis · 2016 [cited by examiner]
US 20160092039A1 · Chien · 2016 [cited by examiner]
US 20160360336A1 · Gross · 2016 [cited by examiner]
US 20170004408A1 · Edelen · 2017 [cited by examiner]
US 20170004409A1 · Chu · 2017 [cited by examiner]
US 20170031575A1 · Dotan-Cohen · 2017 [cited by examiner]
US 20170076089A1 · Turgeman · 2017 [cited by examiner]
US 20170140285A1 · Dotan-Cohen · 2017 [cited by examiner]
US 20180012143A1 · Hansen · 2018 [cited by examiner]
US 20180018590A1 · Szeto · 2018 [cited by examiner]
US 20180053108A1 · Olabiyi · 2018 [cited by examiner]
US 20180069867A1 · Grajek · 2018 [cited by examiner]
US 20180217717A1 · Yasuda · 2018 [cited by examiner]
US 20180329957A1 · Frazzingaro · 2018 [cited by examiner]
US 20190087529A1 · Steingrimsson · 2019 [cited by examiner]
US 20190281249A1 · Grafton · 2019 [cited by examiner]
US 20190340202A1 · Kandur Raja · 2019 [cited by examiner]
Rahul Jain, Joy Bose, Tasleem Arif, Contextual adaptive user interface for Android devices, Dec. 13-15, 2013, 5 pages (Year: 2013). [cited by examiner]
Peitsang Wu, Kung-Jiuan Yang, Yung-Yao Hung, Bao-Yuan Huang, The Study of VMI Inventory Decision Support System Using Neural Network Technology, Aug. 22, 2008, 4 pages (Year: 2008). [cited by examiner]
Ziqing Xia, Kaikai Duan, Centelles Chulia, Rahul Srivastava, Bayesian vs Frequentist, retrieved from—https://indico.cern.ch/event/568904/contributions/2651065/attachments/1487369/2310671/BvsF.pdf, Jul. 4, 2017, 19 pages… [cited by examiner]
Mathias Johansson, Tomas Olofsson, Bayesian Model Selection for Markov, Hidden Markov, and Multinomial Models, retrieved from—https://ieeexplore.ieee.org/abstract/document/4063357, Jan. 15, 2007, 4 pages (Year: 2007). [cited by examiner]
Tom Loredo, Probability and Frequency (Lecture 3), retrieved from—hhttps://astrostatistics.psu.edu/samsi06/tutorials/tut1loredol3.pdf, Jan. 23, 2006, 28 pages (Year: 2006). [cited by examiner]
Abel Rodriguez, Gavino Puggioni, Mixed frequency models: Bayesian approaches to estimation and prediction, retrieved from—https://www.sciencedirect.com/science/article/pii/S0169207010000154, Feb. 21, 2010, 23 pages (Yea… [cited by examiner]
Jake VanderPlas, Frequentism and Bayesianism: A Python-driven Primer, retrieved from—https://arxiv.org/pdf/1411.5018.pdf, Nov. 18, 2014, 9 pages (Year: 2014). [cited by examiner]
Bernoulli NB vs MultiNomial NB, How to choose among different NB algorithms?, retrieved from—https://stats.stackexchange.com/questions/258458/bernoulli-nb-vs-multinomial-nb-how-to-choose-among-different-nb-algorithms, J… [cited by examiner]
Enric Junque de Fortuny, David Martens, and Foster Provost, Predictive Modeling With Big Data: Is Bigger Really Better?, retrieved from—https://www.liebertpub.com/doi/pdf/10.1089/big.2013.0037, Dec. 2013, 12 pages (Year… [cited by examiner]
Kendall Fortney, 10 Machine Learning Flavors in sklearn, retrieved from—https://medium.com/@kefortney/10-machine-learning-flavors-in-sklearn-948206342da2, Feb. 16, 2017, 9 pages (Year: 2017). [cited by examiner]
Implementing 3 Naive Bayes classifiers in scikit-learn, retrieved from—https://hub.packtpub.com/implementing-3-naive-bayes-classifiers-in-scikit-learn/, May 7, 2018, 11 pages (Year: 2018). [cited by examiner]
Kenzo Takahashi, Naive Bayes from Scratch in Python, retrieved from—https://kenzotakahashi.github.io/naive-bayes-from-scratch-in-python.html, Jan. 17, 2016, 13 pages (Year: 2016). [cited by examiner]
How to decide when to use Naive Bayes for classification, retrieved from—https://discuss.analyticsvidhya.com/t/how-to-decide-when-to-use-naive-bayes-for-classification/5720, Oct. 2015, 4 pages (Year: 2015). [cited by examiner]
What is the best form (Gaussian, Multinomial) of Naive Bayes to use with categorical (one-hot encoded) features?, retrieved from—https://stats.stackexchange.com/questions/215191/what-is-the-best-form-gaussian-multinomia… [cited by examiner]
Vangelis Metsis, Ion Androutsopoulos, Georgios Paliouras, Spam Filtering with Naive Bayes—Which Naive Bayes?, retrieved from—https://www2.aueb.gr/users/ion/docs/ceas2006_paper.pdf, Jul. 27-28, 2006, 9 pages (Year: 2006). [cited by examiner]
Matt Gormley, 10-701 Introduction to Machine Learning, retrieved from—https://www.cs.cmu.edu/˜mgormley/courses/10701-f16/slides/lecture3.pdf, Sep. 14, 2016, 63 pages (Year: 2016). [cited by examiner]
Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn, retrieved from—https://stackoverflow.com/questions/14254203/mixing-categorial-and-continuous-data-in-naive-bayes-classifier-using-sciki… [cited by examiner]
Francisco J. Samaniego, A Comparison of the Bayesian and Frequentist Approaches to Estimation, retrieved from—https://www.uaar.edu.pk/fs/books/17.pdf, 2010, 235 pages (Year: 2010). [cited by examiner]
Henrique X. Goulart, Mauro D. L. Tosi, Daniel Soares-Gonc, alves, Rodrigo F. Maia, Guilherme Wachs-Lopes, Hybrid Model for Word Prediction Using Naive Bayes and Latent Information, Mar. 2, 2018, 16 pages (Year: 2018). [cited by examiner]
Rodrigo Barbosa de Santis, Eduardo Pestana de Aguiar, Leonardo Goliatt, Predicting material backorders in inventory management using machine learning, 2017, 6 pages (Year: 2017). [cited by examiner]
Yan Tang Demey, Mikael Wolff, SIMISS: A Model-Based Searching Strategy for Inventory Management Systems, 2016, 11 pages ( Year: 2016). [cited by examiner]
Andrew R. Golding, A Bayesian hybrid method for context-sensitive spelling correction, Jun. 3, 1996, 15 pages (Year: 1996). [cited by examiner]