IP Library Granted Patent US 12,551,795
Granted Patent B2
US 12,551,795 · App. 18/193,158 · Granted Feb 17, 2026

Automated personalized video game guidance system

Inventors: Siddharth Mysore Sthaneshwar (San Mateo, CA); Yunqi Zhao (Sunnyvale, CA); Xin Gao (San Francisco, CA); Alec Jarred Antrim (Algonquin, IL); Harold Henry Chaput (Castro Valley, CA); Fernando de Mesentier Silva (San Francisco, CA)
Assignee: Electronic Arts Inc.
A63F13/5375A63F13/79G06N3/092
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,551,795
App. No.
18/193,158
Granted
Feb 17, 2026
Kind
B2
Abstract

A device may access a feature vector generated based on interactions by a user with a video game. The device may access a cluster map comprising a mapping of user clusters, wherein each location within the cluster map is associated with a set of users whose feature vectors are within a threshold degree of similarity of each other. The cluster map may be generated using a plurality of extracted feature vectors obtained from interaction information. A device may determine a map location within the cluster map associated with the user based at least in part on the feature vector. A device may determine a target map location within the cluster map. A device may determine a guidance action based at least in part on the target map location and the map location associated with the user. A device may execute the guidance action.

Claims (47)

1 . A computer-implemented method comprising:

as implemented by an interactive computing system configured with specific computer-executable instructions,

accessing a feature vector associated with a user, wherein the feature vector is extracted from a set of user interaction data associated with the user and obtained based on interaction by the user with a video game during video game play via the interactive computing system, and wherein the feature vector comprises a set of variables that store data determined from the interaction by the user with the video game;

accessing a cluster map comprising a representation of a mapping of user clusters, wherein each location within the cluster map is associated with a set of users whose feature vectors extracted from each user's interaction with the video game during video game play are within a threshold degree of similarity of each other;

determining a map location within the cluster map associated with the user based at least in part on the feature vector, wherein the map location represents a cluster of users whose feature vectors are within a degree of similarity of the feature vector associated with the user;

determining a target map location within the cluster map;

determining a guidance action based at least in part on the target map location and the map location associated with the user; and

executing the guidance action.

2 . The computer-implemented method of claim 1 , wherein the cluster map comprises a self-organizing map generated by processing, using a neural network, a set of feature vectors extracted from user interaction data for a plurality of users that interact with the video game.

3 . The computer-implemented method of claim 1 , wherein determining the map location within the cluster map comprises comparing the feature vector with a set of features associated the map location.

4 . The computer-implemented method of claim 3 , wherein the set of features are determined based on a set of feature vectors associated with a set of users associated with the map location.

5 . The computer-implemented method of claim 1 , wherein the guidance action corresponds to an in-game tutorial, and wherein executing the guidance action comprises outputting the in-game tutorial.

6 . The computer-implemented method of claim 1 , wherein the guidance action corresponds to playable content of the video game, and wherein executing the guidance action comprises causing the playable content to be made available to the user.

7 . The computer-implemented method of claim 6 , wherein the playable content is dynamically generated.

8 . The computer-implemented method of claim 1 , wherein the target map location is associated with a set of features, and wherein the guidance action is determined to reduce a difference between the feature vector of the user and the set of features of the target map location over time thereby adjusting the map location associated with the user to be the target map location.

9 . The computer-implemented method of claim 1 , wherein the target map location and the map location associated with the user are the same, and wherein the guidance action is determined so as to maintain the user associated with the target map location.

10 . The computer-implemented method of claim 1 , wherein the guidance action is determined using a reinforcement-learning based policy.

11 . The computer-implemented method of claim 10 , wherein the guidance action is executed at a first time, and wherein, at a second time that is later than the first time, the method further comprises:

determining a second map location within the cluster map associated with the user based at least in part on a second feature vector associated with the user;

determining whether the second map location matches the target map location; and

in response to determining that the second map location does not match the target map location, initiating a remedial action.

12 . The computer-implemented method of claim 11 , wherein the remedial action modifies the reinforcement-learning based policy.

13 . The computer-implemented method of claim 1 , further comprising:

receiving an indication of a target goal associated with the video game; and

selecting the target map location based at least in part on the target goal.

14 . The computer-implemented method of claim 1 , further comprising:

extracting a set of features from a set of user interaction data associated with a plurality of users that interact with the video game;

applying a map-based machine learning algorithm to the set of features to obtain the cluster map;

receiving an identification of a key feature indicator; and

categorizing clusters of users within the cluster map based at least in part on the key feature indicator.

15 . The computer-implemented method of claim 14 , wherein the map location is associated with a first value of the key feature indicator, wherein the first value of the key feature indicator is associated with the feature vector of the user, and wherein a second value of the key feature indicator is associated with the target map location.

16 . A system comprising:

an electronic data store configured to store a cluster map comprising a mapping of user clusters; and

a hardware processor of an interactive computing system in communication with the electronic data store, the hardware processor configured to execute specific computer-executable instructions to at least:

access a feature vector associated with a user, wherein the feature vector is extracted from a set of user interaction data associated with the user and obtained based on interaction by the user with a video game during video game play via the interactive computing system, and wherein the feature vector comprises a set of variables that store data determined from the interaction by the user with the video game;

access the cluster map from the electronic data store, wherein each location within the cluster map is associated with a set of users whose feature vectors extracted from each user's interaction with the video game during video game play are within a threshold degree of similarity of each other;

determine a map location within the cluster map associated with the user based at least in part on the feature vector, wherein the map location represents a cluster of users whose feature vectors are within a degree of similarity of the feature vector associated with the user;

identify a target map location within the cluster map;

select a guidance action based at least in part on the target map location and the map location associated with the user; and

cause the guidance action to be executed.

17 . The system of claim 16 , wherein the guidance action comprises a recommendation of playable content within the video game to access, and wherein the hardware processor causes the guidance action to be executed by causing a modification to a state of the video game to trigger initiation of the playable content.

18 . The system of claim 16 , wherein the guidance action comprises a user-specific in-game tutorial, and wherein the hardware processor causes the guidance action to be executed by causing the video game to present the user-specific in-game tutorial to the user.

19 . The system of claim 16 , wherein the guidance action is selected to modify user interaction with the video game such that the association of the user with the map location changes to an association with the target map location over a time period.

20 . The system of claim 16 , wherein the hardware processor is further configured to execute specific computer-executable instructions to at least:

determine a second map location within the cluster map associated with the user after the user interacts with the video game for a threshold time period;

compare the second map location to the target map location; and

update a guidance policy that include the guidance action based at least in part on the comparison of the second map location to the target map location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2023
From: STHANESHWAR, SIDDHARTH MYSORE; ZHAO, YUNQI; GAO, XIN; ANTRIM, ALEC JARRED; CHAPUT, HAROLD HENRY; DE MESENTIER SILVA, FERNANDO
To: ELECTRONIC ARTS INC.
Reel/Frame 063214/0322 →
Continuity (1)
Related Publication 20240325901A1 · Oct 3, 2024
References Cited (184)
US 5274801A · Gordon · 1993 [cited by applicant]
US 5683082A · Takemoto et al. · 1997 [cited by applicant]
US 6106395A · Begis · 2000 [cited by applicant]
US 6253193B1 · Ginter et al. · 2001 [cited by applicant]
US 6285380B1 · Perlin · 2001 [cited by applicant]
US 7390254B2 · Hirai · 2008 [cited by applicant]
US 7636701B2 · Funge et al. · 2009 [cited by applicant]
US 8100770B2 · Yamazaki et al. · 2012 [cited by applicant]
US 8142282B2 · Canessa et al. · 2012 [cited by applicant]
US 8267764B1 · Aoki et al. · 2012 [cited by applicant]
US 8398476B1 · Sidhu et al. · 2013 [cited by applicant]
US 8540560B2 · Crowley et al. · 2013 [cited by applicant]
US 8821290B2 · Fujisawa et al. · 2014 [cited by applicant]
US 8907193B2 · Cross et al. · 2014 [cited by applicant]
US 8914251B2 · Ohta · 2014 [cited by applicant]
US 9001118B2 · Molyneaux et al. · 2015 [cited by applicant]
US 9013489B2 · Evertt et al. · 2015 [cited by applicant]
US 9033796B2 · Fujisawa et al. · 2015 [cited by applicant]
US 9069441B2 · Jacob · 2015 [cited by applicant]
US 9461876B2 · Van Dusen · 2016 [cited by examiner]
US 9616329B2 · Szufnara et al. · 2017 [cited by applicant]
US 9734594B2 · Auclair et al. · 2017 [cited by applicant]
US 9919217B2 · Aghdaie et al. · 2018 [cited by applicant]
US 9949697B2 · Iscoe et al. · 2018 [cited by applicant]
US 10004984B2 · Voris et al. · 2018 [cited by applicant]
US 10105603B2 · Bucher · 2018 [cited by applicant]
US 10286323B2 · Aghdaie et al. · 2019 [cited by applicant]
US 10357718B2 · Aghdaie et al. · 2019 [cited by applicant]
US 10403001B2 · Auclair et al. · 2019 [cited by applicant]
US 10478730B1 · Burnett · 2019 [cited by applicant]
US 10569176B2 · D'angelo et al. · 2020 [cited by applicant]
US 10713543B1 · Skuin et al. · 2020 [cited by applicant]
US 10799798B2 · Aghdaie et al. · 2020 [cited by applicant]
US 10807004B2 · Aghdaie et al. · 2020 [cited by applicant]
US 10839215B2 · Somers et al. · 2020 [cited by applicant]
US 10872345B1 · Walters · 2020 [cited by examiner]
US 10940393B2 · Somers et al. · 2021 [cited by applicant]
US 10953334B2 · Kolen et al. · 2021 [cited by applicant]
US 11110353B2 · Somers et al. · 2021 [cited by applicant]
US 11276216B2 · Borovikov et al. · 2022 [cited by applicant]
US 11369880B2 · Aghdaie et al. · 2022 [cited by applicant]
US 11406899B2 · Kolen et al. · 2022 [cited by applicant]
US 11413539B2 · Aghdaie et al. · 2022 [cited by applicant]
US 11458399B2 · Aghdaie et al. · 2022 [cited by applicant]
US 11532172B2 · Skuin et al. · 2022 [cited by applicant]
US 11875445B2 · Keable · 2024 [cited by applicant]
US 20040067788A1 · Angelopoulos · 2004 [cited by applicant]
US 20040152512A1 · Collodi et al. · 2004 [cited by applicant]
US 20050130725A1 · Creamer et al. · 2005 [cited by applicant]
US 20070054717A1 · Youm et al. · 2007 [cited by applicant]
US 20070060364A1 · Osgood et al. · 2007 [cited by applicant]
US 20070066403A1 · Conkwright · 2007 [cited by applicant]
US 20070260567A1 · Funge et al. · 2007 [cited by applicant]
US 20080097948A1 · Funge et al. · 2008 [cited by applicant]
US 20080266250A1 · Jacob · 2008 [cited by applicant]
US 20080268961A1 · Brook · 2008 [cited by applicant]
US 20090202114A1 · Morin et al. · 2009 [cited by applicant]
US 20090307671A1 · White et al. · 2009 [cited by applicant]
US 20100144444A1 · Graham · 2010 [cited by applicant]
US 20100302257A1 · Perez et al. · 2010 [cited by applicant]
US 20110007079A1 · Perez et al. · 2011 [cited by applicant]
US 20110035280A1 · Fordyce, III · 2011 [cited by applicant]
US 20110295649A1 · Fine et al. · 2011 [cited by applicant]
US 20120083330A1 · Ocko · 2012 [cited by applicant]
US 20120115580A1 · Hornik et al. · 2012 [cited by applicant]
US 20120220376A1 · Takayama et al. · 2012 [cited by applicant]
US 20120233105A1 · Cavallaro et al. · 2012 [cited by applicant]
US 20120244941A1 · Ostergren et al. · 2012 [cited by applicant]
US 20120276964A1 · Jones et al. · 2012 [cited by applicant]
US 20120295708A1 · Hernandez et al. · 2012 [cited by applicant]
US 20120309520A1 · Evertt et al. · 2012 [cited by applicant]
US 20130178281A1 · Ayyar et al. · 2013 [cited by applicant]
US 20130237304A1 · Oakes · 2013 [cited by examiner]
US 20130316779A1 · Vogel · 2013 [cited by applicant]
US 20130316795A1 · Vogel · 2013 [cited by applicant]
US 20130342527A1 · Molyneaux et al. · 2013 [cited by applicant]
US 20140169690A1 · Miyashita · 2014 [cited by examiner]
US 20140235346A1 · Kim et al. · 2014 [cited by applicant]
US 20140249961A1 · Zagel et al. · 2014 [cited by applicant]
US 20140274370A1 · Shah · 2014 [cited by applicant]
US 20140294361A1 · Acharya · 2014 [cited by examiner]
US 20150105161A1 · Sumaki et al. · 2015 [cited by applicant]
US 20150111641A1 · Timm · 2015 [cited by applicant]
US 20150213646A1 · Ma et al. · 2015 [cited by applicant]
US 20150287166A1 · Cerny · 2015 [cited by applicant]
US 20150302505A1 · Di et al. · 2015 [cited by applicant]
US 20150339532A1 · Sharma et al. · 2015 [cited by applicant]
US 20160005270A1 · Marr et al. · 2016 [cited by applicant]
US 20160067612A1 · Ntoulas et al. · 2016 [cited by applicant]
US 20170061685A1 · Auclair et al. · 2017 [cited by applicant]
US 20170064284A1 · Auclair · 2017 [cited by applicant]
US 20170124753A1 · Arisman · 2017 [cited by applicant]
US 20170259177A1 · Aghdaie et al. · 2017 [cited by applicant]
US 20170312634A1 · Ledoux et al. · 2017 [cited by applicant]
US 20170316601A1 · Kakarlapudi et al. · 2017 [cited by applicant]
US 20170358122A1 · Cwik et al. · 2017 [cited by applicant]
US 20170365102A1 · Huston et al. · 2017 [cited by applicant]
US 20180001216A1 · Bruzzo et al. · 2018 [cited by applicant]
US 20180018894A1 · Coulson, Sr. · 2018 [cited by examiner]
US 20180082123A1 · Katz et al. · 2018 [cited by applicant]
US 20180082467A1 · Andersson et al. · 2018 [cited by applicant]
US 20180117465A1 · Voris et al. · 2018 [cited by applicant]
US 20180161673A1 · Pasternack et al. · 2018 [cited by applicant]
US 20180161682A1 · Myhill · 2018 [cited by applicant]
US 20180169526A1 · Aghdaie et al. · 2018 [cited by applicant]
US 20180214777A1 · Hingorani · 2018 [cited by examiner]
US 20180240268A1 · Nevraev · 2018 [cited by applicant]
US 20180243656A1 · Aghdaie et al. · 2018 [cited by applicant]
US 20180268652A1 · Crittenden · 2018 [cited by applicant]
US 20180349808A1 · Sahadi · 2018 [cited by examiner]
US 20180350144A1 · Rathod · 2018 [cited by examiner]
US 20190087965A1 · Datta · 2019 [cited by applicant]
US 20190184286A1 · Du et al. · 2019 [cited by applicant]
US 20190197402A1 · Kovacs et al. · 2019 [cited by applicant]
US 20190213423A1 · Haberstroh · 2019 [cited by examiner]
US 20190279618A1 · Yadav · 2019 [cited by examiner]
US 20190294881A1 · Polak et al. · 2019 [cited by applicant]
US 20190354759A1 · Somers et al. · 2019 [cited by applicant]
US 20190381407A1 · Aghdaie et al. · 2019 [cited by applicant]
US 20190388789A1 · Aghdaie et al. · 2019 [cited by applicant]
US 20200078685A1 · Aghdaie et al. · 2020 [cited by applicant]
US 20200098173A1 · McCall · 2020 [cited by applicant]
US 20200104337A1 · Kelly · 2020 [cited by examiner]
US 20200193671A1 · Tamir · 2020 [cited by applicant]
US 20200306640A1 · Kolen et al. · 2020 [cited by applicant]
US 20200342677A1 · Molyneaux et al. · 2020 [cited by applicant]
US 20210001229A1 · Somers et al. · 2021 [cited by applicant]
US 20210008456A1 · Somers et al. · 2021 [cited by applicant]
US 20210027119A1 · Skuin et al. · 2021 [cited by applicant]
US 20210038975A1 · Grillet · 2021 [cited by examiner]
US 20210086083A1 · Aghdaie et al. · 2021 [cited by applicant]
US 20210093974A1 · Aghdaie et al. · 2021 [cited by applicant]
US 20210275925A1 · Kolen et al. · 2021 [cited by applicant]
US 20210314525A1 · Raduchel · 2021 [cited by examiner]
US 20220014895A1 · Horelik · 2022 [cited by examiner]
US 20220038474A1 · Nag · 2022 [cited by examiner]
US 20230114325A1 · Keable · 2023 [cited by applicant]
US 20230296398A1 · Sanchez-Rosito · 2023 [cited by examiner]
US 20240005146A1 · Anand · 2024 [cited by examiner]
US 20240153195A1 · Keable · 2024 [cited by applicant]
US 20240325901A1 · Sthaneshwar et al. · 2024 [cited by applicant]
US 20250093932A1 · Dorsey · 2025 [cited by examiner]
CN 104657412A · 2015 [cited by applicant]
CN 106213306A · 2016 [cited by applicant]
CN 107274466A · 2017 [cited by applicant]
CN 108499108A · 2018 [cited by applicant]
CN 108604222A · 2018 [cited by applicant]
CN 109359120A · 2019 [cited by applicant]
CN 109933982A · 2019 [cited by applicant]
CN 111744200A · 2020 [cited by applicant]
CN 112169339A · 2021 [cited by applicant]
KR 1020090092007A · 2009 [cited by applicant]
KR 1020120052228 · 2012 [cited by applicant]
KR 1020130118433A · 2013 [cited by applicant]
KR 1020140033088 · 2014 [cited by applicant]
KR 101603681B1 · 2016 [cited by applicant]
KR 1020160115959 · 2016 [cited by applicant]
KR 1020160145732 · 2016 [cited by applicant]
KR 102060879B1 · 2019 [cited by applicant]
KR 102296906B1 · 2021 [cited by applicant]
KR 102360420B1 · 2022 [cited by applicant]
Aponte et al., “Measuring the level of difficulty in single player video games,” Elsevier, Entertainment Computing (2011) 205-213. [cited by applicant]
Aristidou et al., “Inverse Kinematics Techniques in Computer Graphics: A Survey,” Comp Graphics Forum, vol. 00:1-24 (2017). [cited by applicant]
Bengio, et al., Curriculum Learning, Proceedings of the 26th International Conference on Machine Learning, 2009, in 8 pages. [cited by applicant]
Biggs et al., “Creatures Great and SMAL: Recovering the Shape and Motion of Animals from Video”, Dec. 6, 2018, Springer, Computer Vision—ACCV: Asian Conference on Computer Vision 2018, pp. 3-19. [cited by applicant]
Chen et al., “Visualization System for Animating Vertebrate Animal Models”, 2012, IEEE, 2012 Conference on Technologies and Applications of Artificial Intelligence, pp. 244-249. [cited by applicant]
Chou et al., “Self Adversarial Training for Human Pose Estimation”, Nov. 15, 2018, APSI PA, Proceedings, APSI PA Annual Summit and Conference 2018, pp. 17-30. [cited by applicant]
Davis et al., “A Sketching Interface for Articulated Figure Animation,” Eurographics—SIGGRAPH Symp on Comp Animation (2003). [cited by applicant]
Donges, Niklas, Transfer Learning—Towards Data Science, Apr. 23, 2018, https://towardsdatascience.com/transfer-learning-946518f95666. [cited by applicant]
Du et al., “Hierarchical Recurrent Neural Network for Skeleton Based Action Recognition”, Jun. 2015, IEEE, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015, pp. 1110-1118. [cited by applicant]
Ho, et al, Generative Adversarial Imitation Learning, pp. 1-14, arXiv:1606.03476v1 [cs.LG]; Jun. 10, 2016. [cited by applicant]
Isola et al., “Image-to-Image Translation with Conditional Adversarial Networks,” BAIR Lab, UC Berkeley (Nov. 26, 2018). [cited by applicant]
Kanazawa et al., “Learning Category-Specific Mesh Reconstruction from Image Collections”, 2018, The European Conference on Computer Vision (ECCV), pp. 371-386. [cited by applicant]
Mehta et al., “Vnect: Real-time 3D Human Pose Estimation with a Single RGB Camera,” ACM Transactions on Graphics, vol. 36:4 (Jul. 2017). [cited by applicant]
Pittman, “The Pac-Man Dossier,” Gamasutra, downloaded on Jun. 1, 2018, available at «https://web.archive.org/web/20161107115846/https://www.gamasutra.com/view/feature/3938/the_pacman_dossier.php?print=1>>. [cited by applicant]
Pruett, “Defining the All-Important Difficulty Curve,” J of Ed, Comm & Value, vol. 8:1, Jan.-Feb. 2008, http ://com mons.pacificu. edu/cg i/viewcontent.cg i?article= 1 002&context=inter08. [cited by applicant]
Shih et al., “Video-based Motion Capturing for Skelton-based 3D Models,” National Taiwan University. [cited by applicant]
Shorten, “Image-to-Image Translation with Conditional Adversarial Networks,” Pix2Pix, https://towardsdatascience.com/pix2pix.869c17900998?gi=e4c177e8a7c7 (Jan. 29, 2019). [cited by applicant]
Van de Panne, “Control for Simulated Human and Animal Motion,” Dept Comp Sci, University of Toronto (1998). [cited by applicant]
Zweng et al., “Unexpected Human Behavior Recognition in Image Sequences using Multiple Features”, Aug. 26, 2010, IEEE, 2010 20th International Conference on Pattern Recognition, pp. 368-371. [cited by applicant]
“Feature Vector”, Brilliant Math & Science Wiki, retrieved on Sep. 4, 2025 from <https://brilliant.org/wiki/feature-vector/>, in 2 pages. [cited by applicant]
“What is Feature Vector”, Deepchecks, retrieved on Sep. 4, 2025 from <https://www.deepchecks.com/glossary/feature-vector/>, in 4 pages. [cited by applicant]
Alarcon, “Building Vido Game Levels with the Help of AI”, May 9, 2018, Nvidia Developer Technical Blog, retrieved from <https://developer.nvidia.com/blog/ai-helps-video-game-developers-create-new-levels/>, in 9 pages. [cited by applicant]
Xu et al., “Personalized recurrent neural network language model based on transfer learning”, Aug. 30, 2018, Journal of Nanjing University of Science and Technology. 2018(04) p. 401-408. [cited by applicant]