IP Library Granted Patent US 12,373,323
Granted Patent B2
US 12,373,323 · App. 18/527,979 · Granted Jul 29, 2025

Systems and methods for altering a graphical user interface

Inventors: Jiwen You (Sunnyvale, CA); Sinduja Subramaniam (San Jose, CA); Aleksandra Cerekovic (Sunnyvale, CA); Evren Korpeoglu (San Jose, CA); Kannan Achan (Saratoga, CA)
Assignee: Walmart Apollo, LLC
G06F11/3438G06F3/048G06F9/451G06F16/906G06F16/9536G06F17/16G06F18/2431G06N3/02G06N3/045G06N3/08G06N20/00H04L67/535
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,323
App. No.
18/527,979
Granted
Jul 29, 2025
Kind
B2
Abstract

A system can include one or more processors and one or more non-transitory computer-readable media storing computing instructions that, when executed on the one or more processors, cause the one or more processors to perform: selectively aggregating in-session user activity of a user with historical activity data of the user into one or more respective groups based on interactions of the user with a GUI over a period of time; predicting, using a set of predictive algorithms, one or more intents of the user based on the one or more respective groups; and facilitating a display of an altered GUI on an electronic device of the user based on the one or more intents of the user, as predicted. Other embodiments are disclosed herein.

Claims (78)

1. A system comprising:

one or more processors; and

one or more non-transitory computer-readable media storing computing instructions that, when executed on the one or more processors, cause the one or more processors to perform operations comprising:

selectively aggregating in-session user activity of a user with historical activity data of the user into one or more respective groups based on interactions of the user with a graphical user interface (GUI) over a period of time, wherein

selectively aggregating the in-session user activity of the user further comprises:

calculating a normalized point-wise mutual information (NPMI) score between two or more actions within the in-session user activity; and

grouping the two or more actions into a common intent when the NPMI score is above a threshold,

wherein the interactions are grouped based on at least one of:

recency of interactions;

a categorization level of a hierarchical categorization scheme of an item that is a subject of an interaction of the interactions;

a type of interaction performed on the GUI;

a distribution of interaction count in the categorization level of the hierarchical categorization scheme; or

a common intent;

predicting, using a set of predictive algorithms, one or more intents of the user based on the one or more respective groups; and

facilitating a display of an altered GUI on an electronic device of the user based on the one or more intents of the user, as predicted.

2. The system of claim 1 , wherein selectively aggregating the in-session user activity of the user with the historical activity data of the user comprises:

removing at least a portion of the historical activity data based on a user access portal of the in-session user activity of the user.

3. The system of claim 2 , wherein selectively aggregating the in-session user activity of the user with the historical activity data of the user further comprises:

creating a whitelist of actions, wherein the at least the portion of the historical activity data of the user does not include actions on the whitelist of actions.

4. The system of claim 3 , wherein selectively aggregating the in-session user activity of the user with the historical activity data of the user further comprises:

weighting the in-session user activity of the user and the historical activity data of the user by a price of an item interacted with during the in-session user activity or within the historical activity data of the user.

5. The system of claim 1 , wherein the set of predictive algorithms comprises a machine learning algorithm.

6. The system of claim 1 , wherein the set of predictive algorithms are based on at least one of:

user features from complementary intents; and

learned weights of a model of intent type.

7. The system of claim 1 , wherein using the set of predictive algorithms comprises:

applying a multi-class classification algorithm to the in-session user activity of the user and the historical activity data of the user.

8. The system of claim 1 , wherein the computing instructions, when executed on the one or more processors, further cause the one or more processors to perform an operation comprising:

training the set of predictive algorithms on the in-session user activity of the user and the historical activity data of the user as more data is gathered from a user session for the user.

9. The system of claim 1 , wherein facilitating the display of the altered GUI comprises:

re-ranking the one or more intents of the user, as predicted, into a re-ranked order; and

facilitating a display of GUI elements related to the one or more intents of the user, as predicted and re-ranked, in the re-ranked order.

10. The system of claim 1 , wherein the computing instructions, when executed on the one or more processors, further cause the one or more processors to perform an operation comprising:

re-ranking the one or more intents of the user based on a dot product of top ranked intents of the one or more intents of the user.

11. A method being implemented via execution of computing instructions configured to run at one or more processors and stored at non-transitory computer-readable media, the method comprising:

selectively aggregating in-session user activity of a user with historical activity data of the user into one or more respective groups based on interactions of the user with a graphical user interface (GUI) over a period of time, wherein selectively aggregating the in-session user activity of the user further comprises:

calculating a normalized point-wise mutual information (NPMI) score between two or more actions within the in-session user activity; and

grouping the two or more actions into a common intent when the NPMI score is above a threshold,

wherein the interactions are grouped based on at least one of:

recency of interactions;

a categorization level of a hierarchical categorization scheme of an item that is a subject of an interaction of the interactions;

a type of interaction performed on the GUI;

a distribution of interaction count in the categorization level of the hierarchical categorization scheme; or

a common intent;

predicting, using a set of predictive algorithms, one or more intents of the user based on the one or more respective groups; and

facilitating a display of an altered GUI on an electronic device of the user based on the one or more intents of the user, as predicted.

12. The method of claim 11 , wherein selectively aggregating the in-session user activity of the user with the historical activity data of the user comprises:

removing at least a portion of the historical activity data based on a user access portal of the in-session user activity of the user.

13. The method of claim 12 , wherein selectively aggregating the in-session user activity of the user with the historical activity data of the user further comprises:

creating a whitelist of actions, wherein the at least the portion of the historical activity data of the user does not include actions on the whitelist of actions.

14. The method of claim 13 , wherein selectively aggregating the in-session user activity of the user with the historical activity data of the user further comprises:

weighting the in-session user activity of the user and the historical activity data of the user by a price of an item interacted with during the in-session user activity or within the historical activity data of the user.

15. The method of claim 11 , wherein the set of predictive algorithms comprises a machine learning algorithm.

16. The method of claim 11 , wherein the set of predictive algorithms are based on at least one of:

user features from complementary intents; and

learned weights of a model of intent type.

17. The method of claim 11 , wherein using the set of predictive algorithms comprises:

applying a multi-class classification algorithm to the in-session user activity of the user and the historical activity data of the user.

18. The method of claim 11 further comprising:

training the set of predictive algorithms on the in-session user activity of the user and the historical activity data of the user as more data is gathered from a user session for the user.

19. The method of claim 11 , wherein facilitating the display of the altered GUI comprises:

re-ranking the one or more intents of the user, as predicted, into a re-ranked order; and

facilitating a display of GUI elements related to the one or more intents of the user, as predicted and re-ranked, in the re-ranked order.

20. A non-transitory computer-readable medium storing instructions, wherein the instructions, upon execution by a processor, cause the processor to perform operations comprising:

selectively aggregating in-session user activity of a user with historical activity data of the user into one or more respective groups based on interactions of the user with a graphical user interface (GUI) over a period of time, wherein

selectively aggregating the in-session user activity of the user further comprises:

calculating a normalized point-wise mutual information (NPMI) score between two or more actions within the in-session user activity; and

grouping the two or more actions into a common intent when the NPMI score is above a threshold,

wherein the interactions are grouped based on at least one of:

recency of interactions;

a categorization level of a hierarchical categorization scheme of an item that is a subject of an interaction of the interactions;

a type of interaction performed on the GUI;

a distribution of interaction count in the categorization level of the hierarchical categorization scheme; or

a common intent;

predicting, using a set of predictive algorithms, one or more intents of the user based on the one or more respective groups; and

facilitating a display of an altered GUI on an electronic device of the user based on the one or more intents of the user, as predicted.

21. The non-transitory computer-readable medium of claim 20 , wherein the operations further comprise:

removing at least a portion of the historical activity data based on a user access portal of the in-session user activity of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2023
From: YOU, JIWEN; SUBRAMANIAM, SINDUJA; CEREKOVIC, ALEKSANDRA; KORPEOGLU, EVREN; ACHAN, KANNAN
To: WALMART APOLLO, LLC
Reel/Frame 065908/0212 →
Continuity (3)
Continuation 18088065 · Dec 23, 2022
Continuation 17163484 · Jan 31, 2021
Related Publication 20240111653A1 · Apr 4, 2024
References Cited (45)
US 6266649B1 · Linden · 2001 [cited by applicant]
US 8965998B1 · Dicker et al. · 2015 [cited by applicant]
US 9661088B2 · Krishnamoorthy · 2017 [cited by applicant]
US 9946437B2 · Anbil et al. · 2018 [cited by applicant]
US 10776444B1 · Bailey et al. · 2020 [cited by applicant]
US 10853385B1 · Truong et al. · 2020 [cited by applicant]
US 10970329B1 · Al Majid et al. · 2021 [cited by applicant]
US 11082509B1 · Bandari · 2021 [cited by applicant]
US 20080162268A1 · Gilbert · 2008 [cited by examiner]
US 20100299343A1 · Ahari · 2010 [cited by examiner]
US 20150007065A1 · Krishnamoorthy · 2015 [cited by applicant]
US 20150046841A1 · Sharon et al. · 2015 [cited by applicant]
US 20150262077A1 · White · 2015 [cited by examiner]
US 20150286645A1 · Sinha · 2015 [cited by applicant]
US 20160034809A1 · Trenholm et al. · 2016 [cited by applicant]
US 20160239848A1 · Chang · 2016 [cited by examiner]
US 20160366126A1 · Sharifi · 2016 [cited by examiner]
US 20170206431A1 · Sun et al. · 2017 [cited by applicant]
US 20170251081A1 · Roychowdhury et al. · 2017 [cited by applicant]
US 20180218429A1 · Guo · 2018 [cited by examiner]
US 20180341839A1 · Malak et al. · 2018 [cited by applicant]
US 20180349347A1 · Ringger · 2018 [cited by examiner]
US 20190042981A1 · Bendfeldt · 2019 [cited by applicant]
US 20190205472A1 · Kulkarni · 2019 [cited by applicant]
US 20200004564A1 · Calegari · 2020 [cited by examiner]
US 20200034911A1 · Sriram et al. · 2020 [cited by applicant]
US 20200042211A1 · Rogulenko · 2020 [cited by examiner]
US 20200097725A1 · Mietke · 2020 [cited by applicant]
US 20200104148A1 · R et al. · 2020 [cited by applicant]
US 20200159862A1 · Kleiner et al. · 2020 [cited by applicant]
US 20200192078A1 · Spring et al. · 2020 [cited by applicant]
US 20200341602A1 · Schoppe et al. · 2020 [cited by applicant]
US 20210124468A1 · Song et al. · 2021 [cited by applicant]
US 20210406838A1 · Ramanath · 2021 [cited by applicant]
TW 201532430A · 2015 [cited by examiner]
WO 2011109219 · 2011 [cited by applicant]
WO 2019148199 · 2019 [cited by applicant]
WO 2021127778A1 · 2021 [cited by applicant]
Yang, “Interaction method between multiple electronic devices based on user intent and system thereof”, Aug. 16, 2015, Taiwan Invention Application Publication, 13 Pages. (Year: 2015). [cited by examiner]
Luo, “Highly-Accurate Community Detection via Pointwise Mutual Information-Incorporated Symmetric Non-Negative Matrix Factorization”, IEEE Transactions on Network Science and Engineering, vol. 8, No. 1, Jan.-Mar. 2021, … [cited by examiner]
Nayak, et al., “Session-Based Recommender Systems for Action Selection in GUI Test Generation,” Oct. 24-28, 2020, IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Oct. 202… [cited by applicant]
Trofimov, I., “Inferring Complementary Products From Baskets and Browsing Sessions,” arXiv:1809.09621v1 [cs.IR], published Sep. 25, 2018, 8 pgs. Sep. 25, 2018. [cited by applicant]
Hao, J., et al., “p. Companion: A Principled Framework for Diversified Complementary Product Recommendation,” CIKM'20, Oct. 19-23, 2020, virtual, 8 pgs. Oct. 19, 2020. [cited by applicant]
Barkan, O. and Koenigstein, N., “ITEM2VEC: Neural Item Embedding for Collaborative Filtering,” 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP) (2016) 6 pgs. 2016. [cited by applicant]
Pointwise mutual informatoin; Apr. 7, 2020; Wikipedia; pp. 1-5 Apr. 7, 2020. [cited by applicant]