IP Library › Granted Patent US 12,589,308
Granted Patent B2
US 12,589,308 · App. 18/213,868 · Granted Mar 31, 2026

Generative narrative game experience with player feedback

Inventors: Sudha Rao (Bothell, WA); William Brennan Dolan (Kirkland, WA); Christopher John Brockett (Kirkland, WA); Weijia Xu (Bellevue, WA); Nebojsa Jojic (Redmond, WA); Gabriel A. Desgarennes (Issaquah, WA); Yun Hui Xu (San Francisco, CA)
Assignee: Microsoft Technology Licensing, LLC
A63F13/67A63F13/47A63F13/65
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,589,308
App. No.
18/213,868
Filed
Jun 25, 2023
Granted
Mar 31, 2026
Kind
B2
Art Unit
3715
USPC
463/23
Abstract

Described are systems and methods for evolving computer-implemented narrative games based on player feedback, levering generative artificial intelligence (AI), such as Generative Pre-Trained Transformer (GPT) or other foundation models, to create new game content responsive to player input, measure player engagement metrics during gameplay, and/or modify the game based on the generated new content and/or player engagement.

Claims (37)

1 . A method comprising:

tracking a player's path through a narrative state graph associated with a computer-implemented narrative game, the narrative state graph comprising a plurality of nodes corresponding to event points in the game;

monitoring the player's interactions with game assets along the player's path;

determining, for each node along the player's path, a local player engagement metric based at least in part on the monitored interactions associated with the node;

determining a global player engagement metric based at least in part on the monitored interactions associated with all nodes along the player's path; and

using a foundation model to modify the narrative state graph based on the local and global player engagement metrics.

2 . The method of claim 1 , wherein the local and global player engagement metrics are determined by the foundation model or another foundation model.

3 . The method of claim 1 , further comprising acquiring indicators of the player's real-world reaction to the game along the player's path as derived from at least one of audio or video signals, wherein the local and global player engagement metrics are determined further based on the indicators of the player's real-world reaction.

4 . The method of claim 1 , wherein modifying the narrative state graph comprises at least one of adding a node to the narrative state graph, deleting a node from the narrative state graph, adding a link between a pair of nodes, or deleting a link between a pair of nodes.

5 . The method of claim 1 , wherein each of the plurality of nodes falls into one of a plurality of domains, the plurality of domains comprising at least two of main quest, side quest, no quest, and minigame, and wherein modifying the narrative state graph comprises moving at least one of the nodes from one domain to another domain.

6 . The method of claim 1 , wherein the player's path is tracked, the player's interactions are monitored, and local and global player engagement metrics are determined for multiple players, and wherein the foundation model is used to modify the narrative state graph based on an aggregate of the local and global engagement metrics of the multiple players.

7 . The method of claim 6 , wherein monitoring the player's interactions for multiple players comprises monitoring interactions between the multiple players via the game, and wherein the narrative state graph is modified further based in part on the interactions between the multiple players.

8 . The method of claim 1 , wherein the game assets comprise one or more assets controlled by one or more computer-controlled agents and the monitored interactions comprise player input to the one or more computer-controlled agents, the method further comprising operating the foundation model or another foundation model on prompts comprising the player input to generate a model output, and controlling the one or more computer-controlled agents at least in part based on the model output.

9 . The method of claim 8 , wherein modifying the narrative state graph comprises incorporating at least a portion of the model output into the narrative state graph.

10 . The method of claim 8 , wherein the player's interactions are monitored for multiple players and wherein the model output is based on monitored interactions of the multiple players with multiple computer-controlled agents used in conjunction.

11 . The method of claim 8 , wherein the one or more computer-controlled agents comprise a conversational agent controlled at least in part based on natural-language model output generated by the foundation model from a prompt comprising natural-language player input received as part of the monitored interactions.

12 . The method of claim 11 , wherein the conversational agent is associated with a non-player character.

13 . The method of claim 8 , wherein at least one of the one or more computer-controlled agents is controlled at least in part based on programmatic output generated by the foundation model from the prompts.

14 . The method of claim 8 , wherein the foundation model operating on the prompts comprising the player input is a multi-modal model and the one or more computer-controlled agents are controlled based on multi-modal model output of the multi-modal foundation model.

15 . The method of claim 14 , wherein the multi-modal model output comprises at least two of natural-language output, programmatic output, and visual output.

16 . A system comprising:

one or more computer processors; and

computer memory storing instructions which, when executed, cause the one or more computer processors to perform operations comprising:

tracking a player's path through a narrative state graph associated with a computer-implemented narrative game, the narrative state graph comprising a plurality of nodes corresponding to event points in the game;

monitoring the player's interactions with game assets along the player's path;

determining, for each node along the player's path, a local player engagement metric based at least in part on the monitored interactions associated with the node;

determining a global player engagement metric based at least in part on the monitored interactions associated with all nodes along the player's path; and

using a foundation model to modify the narrative state graph based on the local and global player engagement metrics.

17 . The system of claim 16 , wherein the local and global player engagement metrics are determined by the foundation model or another foundation model.

18 . The system of claim 16 , wherein modifying the narrative state graph comprises at least one of adding a node to the narrative state graph, deleting a node from the narrative state graph, adding a link between a pair of nodes, or deleting a link between a pair of nodes.

19 . The system of claim 16 , wherein the game assets comprise one or more assets controlled by one or more computer-controlled agents and the monitored interactions comprise player input to the one or more computer-controlled agents, the operations further comprising operating the foundation model or another foundation model on prompts comprising the player input to generate a model output, and controlling the one or more computer-controlled agents at least in part based on the model output, wherein modifying the narrative state graph comprises incorporating at least a portion of the model output into the narrative state graph.

20 . A non-transitory machine-readable medium storing machine-readable instructions which, when executed by one or more computer processors, cause the one or more computer processors to perform operations comprising:

tracking a player's path through a narrative state graph associated with a computer-implemented narrative game, the narrative state graph comprising a plurality of nodes corresponding to event points in the game;

monitoring the player's interactions with game assets along the player's path;

determining, for each node along the player's path, a local player engagement metric based at least in part on the monitored interactions associated with the node;

determining a global player engagement metric based at least in part on the monitored interactions associated with all nodes along the player's path; and

using a foundation model to modify the narrative state graph based on the local and global player engagement metrics.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2023
From: RAO, SUDHA; DOLAN, WILLIAM BRENNAN; BROCKETT, CHRISTOPHER JOHN; XU, WEIJIA; JOJIC, NEBOJSA; DESGARENNES, GABRIEL A.; XU, YUN HUI
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 064362/0113 →
Continuity (1)
Related Publication 20240424405A1 · Dec 26, 2024
References Cited (201)
US 7149970B1 · Pratley et al. · 2006 [cited by applicant]
US 8688698B1 · Black et al. · 2014 [cited by applicant]
US 10105608B1 · George · 2018 [cited by examiner]
US 10853398B2 · Fisher · 2020 [cited by applicant]
US 20070066403A1 · Conkwright · 2007 [cited by examiner]
US 20110239119A1 · Phillips et al. · 2011 [cited by applicant]
US 20110300847A1 · Quy · 2011 [cited by examiner]
US 20120028713A1 · Driemeyer · 2012 [cited by examiner]
US 20120157197A1 · Watkins, Jr. · 2012 [cited by examiner]
US 20120275714A1 · Gao · 2012 [cited by examiner]
US 20130108994A1 · Srinivasa · 2013 [cited by applicant]
US 20130145240A1 · Anderson · 2013 [cited by examiner]
US 20140004948A1 · Watkins, Jr. · 2014 [cited by examiner]
US 20140223284A1 · Rankin, Jr. et al. · 2014 [cited by applicant]
US 20150221169A1 · Filipour · 2015 [cited by examiner]
US 20160092428A1 · Llic et al. · 2016 [cited by applicant]
US 20160103841A1 · Zupancic · 2016 [cited by applicant]
US 20160246891A1 · Accardo · 2016 [cited by examiner]
US 20160263477A1 · Ladd · 2016 [cited by examiner]
US 20160274705A1 · Kapadia · 2016 [cited by examiner]
US 20170220545A1 · Gururajan et al. · 2017 [cited by applicant]
US 20180239833A1 · Zholudev et al. · 2018 [cited by applicant]
US 20180359172A1 · Yadav · 2018 [cited by applicant]
US 20190001219A1 · Sardari · 2019 [cited by applicant]
US 20190005029A1 · Mills et al. · 2019 [cited by applicant]
US 20190046879A1 · Halper · 2019 [cited by examiner]
US 20190197402A1 · KovÁcs et al. · 2019 [cited by applicant]
US 20190205772A1 · Kohlmeier et al. · 2019 [cited by applicant]
US 20190251150A1 · Vishwa · 2019 [cited by applicant]
US 20190354594A1 · Foster et al. · 2019 [cited by applicant]
US 20190377785A1 · N et al. · 2019 [cited by applicant]
US 20190388787A1 · Padmanabhan · 2019 [cited by examiner]
US 20200097340A1 · Balik et al. · 2020 [cited by applicant]
US 20200098353A1 · Olabiyi · 2020 [cited by applicant]
US 20200137463A1 · Kumar et al. · 2020 [cited by applicant]
US 20200155943A1 · Eatedali · 2020 [cited by examiner]
US 20200206631A1 · Sumant · 2020 [cited by examiner]
US 20200226871A1 · Itzkowitz · 2020 [cited by examiner]
US 20200336804A1 · Cui · 2020 [cited by examiner]
US 20200342164A1 · Satterfield et al. · 2020 [cited by applicant]
US 20200405213A1 · Chappell, III · 2020 [cited by applicant]
US 20210086089A1 · Pardeshi · 2021 [cited by examiner]
US 20210097133A1 · Liao et al. · 2021 [cited by applicant]
US 20210158811A1 · Di Fabbrizio et al. · 2021 [cited by applicant]
US 20210165481A1 · Brugarolas Brufau · 2021 [cited by examiner]
US 20210283505A1 · Bansal · 2021 [cited by applicant]
US 20210304636A1 · Desmond · 2021 [cited by examiner]
US 20210312301A1 · Azmandian · 2021 [cited by applicant]
US 20210374863A1 · Zarlengo · 2021 [cited by applicant]
US 20220016519A1 · Van Der Steen · 2022 [cited by examiner]
US 20220035640A1 · Daei · 2022 [cited by applicant]
US 20220088474A1 · Dicken · 2022 [cited by applicant]
US 20220168653A1 · Weising · 2022 [cited by examiner]
US 20220198135A1 · Peleg · 2022 [cited by applicant]
US 20220414320A1 · Dolan et al. · 2022 [cited by applicant]
US 20230122202A1 · Dolan et al. · 2023 [cited by applicant]
US 20230123430A1 · Dolan et al. · 2023 [cited by applicant]
US 20230123535A1 · Dolan et al. · 2023 [cited by applicant]
US 20230124765A1 · Desgarennes et al. · 2023 [cited by applicant]
US 20230125036A1 · Volum et al. · 2023 [cited by applicant]
US 20230381665A1 · Dolan · 2023 [cited by applicant]
CN 110599592A · 2019 [cited by applicant]
CN 108959271B · 2020 [cited by applicant]
EP 0992007B1 · 2009 [cited by applicant]
WO 2009076555A2 · 2009 [cited by applicant]
WO 2018004839A1 · 2018 [cited by applicant]
WO 2021003471A1 · 2021 [cited by applicant]
WO 2021076302A1 · 2021 [cited by applicant]
WO 2021108164A1 · 2021 [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2024/034565, Sep. 17, 2024, 15 pages. [cited by applicant]
Kybartas, et al., “Analysis of ReGEN as a Graph-Rewriting System for Quest Generation”, IEEE Transactions on Computational Intelligence and AI in Games, vol. 6, Issue 2, Nov. 7, 2013, pp. 228-242. [cited by applicant]
Final Office Action mailed on Feb. 1, 2024, in U.S. Appl. No. 17/517,329, 21 pages. [cited by applicant]
Non-Final Office Action mailed on Jan. 18, 2024, in U.S. Appl. No. 17/356,440, 29 pages. [cited by applicant]
Gao, et al., “Jointly Optimizing Diversity and Relevance in Neural Response Generation”, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Te… [cited by applicant]
Gao, et al., “Neural Approaches to Conversational AI”, In Journal of Foundations and Trends® in Information Retrieval, vol. 13, No. 2-3, 2019, 64 Pages. [cited by applicant]
Gao, et al., “Structuring Latent Spaces for Stylized Response Generation”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Langu… [cited by applicant]
Ghazvininejad, et al., “A Knowledge-Grounded Neural Conversation Model”, In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, Apr. 2, 2018, pp. 5110-5117. [cited by applicant]
Gupta, et al., “A Deep Generative Framework for Paraphrase Generation”, In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, Feb. 2, 2018, pp. 5149-5156. [cited by applicant]
Guu, et al., “Generating Sentences by Editing Prototypes”, In Journal of Transactions of the Association for Computational Linguistics, vol. 6, 2018, pp. 437-450. [cited by applicant]
Guu, et al., “REALM: Retrieval-Augmented Language Model Pre-Training”, In Repository of arXiv:2002.08909v1, Feb. 10, 2020, 12 Pages. [cited by applicant]
Harrison, et al., “Toward Automated Story Generation with Markov Chain Monte Carlo Methods and Deep Neural Networks”, In Journal of the Workshops of the Thirteenth AAAI Conference on Artificial Intelligence and Interact… [cited by applicant]
Hokamp, et al., “Lexically Constrained Decoding for Sequence Generation Using Grid Beam Search”, In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Jul. 30, 2017, pp. 1535-1546. [cited by applicant]
Zhao, et al., “Unsupervised Discrete Sentence Representation Learning for Interpretable Neural Dialog Generation”, In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Jul. 15, 201… [cited by applicant]
Holtzman, et al., “The Curious Case of Neural Text Degeneration”, In Proceedings of the International Conference on Learning Representations, Apr. 26, 2020, pp. 1-16. [cited by applicant]
Hu, et al., “Improved Lexically Constrained Decoding for Translation and Monolingual Rewriting”, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Lan… [cited by applicant]
Hu, et al., “PARABANK: Monolingual Bitext Generation and Sentential Paraphrasing via Lexically-Constrained Neural Machine Translation”, In Proceedings of the AAAI Conference on Artificial Intelligence, Jan. 27, 2019, pp… [cited by applicant]
Hu, et al., “Toward Controlled Generation of Text”, In Proceedings of the 34th International Conference on Machine Learning, vol. 70, Aug. 6, 2017, 10 Pages. [cited by applicant]
Ippolito, et al., “Unsupervised Hierarchical Story Infilling”, In Proceedings of the First Workshop on Narrative Understanding, Jun. 7, 2019, pp. 37-43. [cited by applicant]
Iso, et al., “Fact-based Text Editing”, In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Jul. 5, 2020, pp. 171-182. [cited by applicant]
Jain, et al., “Story Generation from Sequence of Independent Short Descriptions”, In Repository of arXiv:1707.05501v2, Aug. 21, 2017, 7 Pages. [cited by applicant]
Keskar, et al., “Ctrl: A Conditional Transformer Language Model for Controllable Generation”, In Repository of arXiv:1909.05858v2, Sep. 20, 2019, pp. 1-18. [cited by applicant]
Kiss, et al., “Unsupervised Multilingual Sentence Boundary Detection”, In Journal of Computational Linguistics, vol. 32, No. 4, Dec. 2006, pp. 485-525. [cited by applicant]
Koncel-Kedziorski, et al., “Text Generation from Knowledge Graphs with Graph Transformers”, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language… [cited by applicant]
Lebowitz, Michael, “Story Telling as Planning and Learning”, In Journal of Poetics, vol. 14, Issue 6, Nov. 1985, 25 Pages. [cited by applicant]
Li, et al., “A Diversity-Promoting Objective Function for Neural Conversation Models”, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Tech… [cited by applicant]
Zhang, et al., “DialoGPT: Large-scale Generative Pre-training for Conversational Response Generation”, In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Jul. 5, 2020, pp. 270-27… [cited by applicant]
Liu, et al., “Generating Wikipedia by Summarizing Long Sequences”, In Repository of arXiv:1801.10198v1, Jan. 30, 2018, pp. 1-18. [cited by applicant]
Liu, et al., “Knowledge Aware Conversation Generation with Explainable Reasoning over Augmented Graphs”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joi… [cited by applicant]
Liu, et al., “Knowledge Diffusion for Neural Dialogue Generation”, In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Long Papers), Jul. 15, 2018, pp. 1489-1498. [cited by applicant]
Liu, et al., “Table-to-Text Generation by Structure-Aware Seq2seq Learning”, In Proceedings of the AAAI Conference on Artificial Intelligence, Feb. 2, 2018, pp. 4881-4888. [cited by applicant]
Marrese-Taylor, et al., “Variational Inference for Learning Representations of Natural Language Edits”, In Repository of arXiv:2004.09143v1, Apr. 20, 2020, 11 Pages. [cited by applicant]
Martin, et al., “Event Representations for Automated Story Generation with Deep Neural Nets”, In Repository of arXiv:1706.01331v3, Sep. 12, 2017, 9 Pages. [cited by applicant]
Miao, et al., “CGMH: Constrained Sentence Generation by Metropolis-Hastings Sampling”, In Proceedings of the 33rd AAAI Conference on Artificial Intelligence, Jul. 17, 2019, pp. 6834-6842. [cited by applicant]
Min, et al., “Knowledge Guided Text Retrieval and Reading for Open Domain Question Answering”, In Repository of arXiv:1911.03868v1, Nov. 10, 2019, 11 Pages. [cited by applicant]
Moghe, et al., “Towards Exploiting Background Knowledge for Building Conversation Systems”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Oct. 31, 2018, pp. 2322-2332. [cited by applicant]
Papineni, et al., “BLEU: A Method for Automatic Evaluation of Machine Translation”, In Proceedings of 40th Annual Meeting on Association for Computational Linguistics, Jul. 7, 2002, 8 Pages. [cited by applicant]
Peng, et al., “Towards Controllable Story Generation”, In Proceedings of the First Workshop on Storytelling, Jun. 5, 2018., pp. 43-49. [cited by applicant]
Pirolli, et al., “The Sensemaking Process and leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis”, In Proceedings of International Conference on Intelligence Analysis, vol. 5, May 2, 20… [cited by applicant]
Prabhumoye, et al., “Towards Content Transfer through Grounded Text Generation”, In Repository of arXiv:1905.05293v1, May 13, 2019, 11 Pages. [cited by applicant]
Qin, et al., “Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading”, In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Jul. 28, 2019, pp. 5427-54… [cited by applicant]
Radford, et al., “Language Models are Unsupervised Multitask Learners”, Retrieved From: https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf, Feb. 14, 2019, 24 Pages. [cited by applicant]
Raffel, et al., “Exploring the Limits of Transfer Learning with A Unified Text-to-Text Transformer”, In Repository of arXiv:1910.10683v1, Oct. 23, 2019, pp. 1-52. [cited by applicant]
Rashkin, et al., “PLOTMACHINES: Outline-Conditioned Generation with Dynamic Plot State Tracking”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Nov. 16, 2020, pp. 4274-4295. [cited by applicant]
See, et al., “What Makes a Good Conversation? How Controllable Attributes Affect Human Judgments”, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human L… [cited by applicant]
Shang, et al., “Neural Responding Machine for Short-Text Conversation”, In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural La… [cited by applicant]
Sordoni, et al., “A Neural Network Approach to Context-Sensitive Generation of Conversational Responses”, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics:H… [cited by applicant]
Sun, et al., “The Feasibility of Embedding Based Automatic Evaluation for Single Document Summarization”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Jo… [cited by applicant]
Tambwekar, et al., “Controllable Neural Story Plot Generation via Reward Shaping”, In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, Aug. 10, 2019, pp. 5982-5988. [cited by applicant]
Tang, et al., “Target-Guided Open-Domain Conversation”, In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Jul. 28, 2019, pp. 5624-5634. [cited by applicant]
Vaswani, et al., “Attention Is All You Need”, In Proceedings of the 31st Conference on Neural Information Processing Systems, Dec. 4, 2017, pp. 1-11. [cited by applicant]
Mnyals, et al., “A Neural Conversational Model”, In Repository of arXiv:1506.05869v3, Jul. 22, 2015, 8 Pages. [cited by applicant]
Wiseman, et al., “Challenges in Data-to-Document Generation”, In Repository of arxiv:/1707.08052v1, Jul. 25, 2017, 13 Pages. [cited by applicant]
Wu, et al., “A Controllable Model of Grounded Response Generation”, In Repository of arXiv:2005.00613v1, May 1, 2020, 11 Pages. [cited by applicant]
Non-Final Office Action mailed on Apr. 2, 2025, in U.S. Appl. No. 17/517,378, 20 Pages. [cited by applicant]
“Black & White (video game)”, Retrieved From: https://en.wikipedia.org/w/index.php?title=Black_%26_White (video_game)&oldid=1083759441, Apr. 20, 2022, 21 Pages. [cited by applicant]
“GitHub Copilot”, Retrieved from: https://web.archive.org/web/20210927023930/https://copilot.github.com/, Sep. 27, 2021, pp. 1-16. [cited by applicant]
“Leisure Suit Larry (PC/DOS) 1987, Sierra On-Line (AGI, EGA)”, Retrieved From: https://www.youtube.com/watch? V=FpOnfDW2iJo, Sep. 14, 2017, 3 Pages. [cited by applicant]
“Mineflayer”, Retrieved from: https://web.archive.org/web/20210410144547/https://mineflayer.prismarine.js.org/#/, Apr. 10, 2021, pp. 1-10. [cited by applicant]
“OpenAI Codex”, Retrieved from: https://web.archive.org/web/20210708045044/https://gpt3demo.com/apps/openai-codex, Jul. 8, 2021, pp. 1-7. [cited by applicant]
“Wikimedia Downloads”, Retrieved from: https://web.archive.org/web/20210505181954/https://dumps.wikimedia.org/, May 5, 2021, pp. 1-3. [cited by applicant]
“Final Office Action Issued in U.S. Appl. No. 17/356,440”, Mailed Date: Dec. 8, 2022, 30 Pages. [cited by applicant]
“Non Final Office Action Issued in U.S. Appl. No. 17/356,440”, Mailed Date: Apr. 19, 2022, 24 Pages. [cited by applicant]
“Non Final Office Action Issued In U.S. Appl. No. 17/517,329”, Mailed Date: Oct. 10, 2023, 15 Pages. [cited by applicant]
Attardi, et al., “WikiExtractor”, Retrieved from: https://github.com/attardi/wikiextractor, Jan. 24, 2023, pp. 1-8. [cited by applicant]
Bird, et al., “Natural Language Processing with Python”, In Publication of O'Reilly Media, Jun. 2009, 502 Pages. [cited by applicant]
Bommasani, et al., “On the Opportunities and Risks of Foundation Models”, In Repository of arXiv:2108.07258v1, Aug. 16, 2021, pp. 1-211. [cited by applicant]
Brown, et al., “Language Models are Few-Shot Learners”, In Repository of arXiv:2005.14165v1, May 28, 2020, pp. 1-72. [cited by applicant]
Chang, et al., “SceneSeer: 3D Scene Design with Natural Language”, In Repository of arXiv:1703.00050v1, Feb. 28, 2017, pp. 1-10. [cited by applicant]
Chen, et al., “Reading Wikipedia to Answer Open-Domain Questions”, In Repository of arXiv:1704.00051v2, Apr. 28, 2017, 10 Pages. [cited by applicant]
Dathathri, et al., “Plug and Play Language Models: A Simple Approach to Controlled Text Generation”, In Repository of arXiv:1912.02164v3, Jan. 8, 2020, pp. 1-34. [cited by applicant]
Dinan, et al., “Wizard of Wikipedia: Knowledge-powered Conversational Agents”, In Repository of arXiv:1811.01241v2, Feb. 21, 2019, pp. 1-18. [cited by applicant]
Doddington, George, “Automatic Evaluation of Machine Translation Quality using N-gram Co-Occurrence Statistics”, In Proceedings of the Second International Conference on Human Language Technology, Mar. 24, 2002, pp. 138… [cited by applicant]
Dong, et al., “Learning to Generate Product Reviews from Attributes”, In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: vol. 1, Long Papers, Apr. 3, 2017, pp… [cited by applicant]
Faltings, et al., “Text Editing by Command”, In Repository of arXiv:2010.12826v1, Oct. 24, 2020, 14 Pages. [cited by applicant]
Fan, et al., “Hierarchical Neural Story Generation”, In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Jul. 15, 2018, pp. 889-898. [cited by applicant]
Faruqui, et al., “WikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse”, In Repository of arXiv:1808.09422v1, Aug. 28, 2018, 11 Pages. [cited by applicant]
Ficler, et al., “Controlling Linguistic Style Aspects in Neural Language Generation”, In Proceedings of the Workshop on Stylistic Variation, Sep. 7, 2017, pp. 94-104. [cited by applicant]
Florez-Puga, et al., “Query-Enabled Behavior Trees”, In IEEE Transactions on Computational Intelligence and AI in Games, vol. 1, Issue 4, Dec. 2009, pp. 298-308. [cited by applicant]
Guckelsnerger, et al., “New And Surprising Ways to Be Mean”, In Proceedings of IEEE Conference on Computational Intelligence and Games, Aug. 14, 2018, 8 Pages. [cited by applicant]
Kluwer, et al., “Talking NPCs in a Virtual Game World”, In Proceedings of the ACL System Demonstrations, Jul. 13, 2010, pp. 36-41. [cited by applicant]
Li, et al., “A Persona-Based Neural Conversation Model”, In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Aug. 7, 2016, pp. 994-1003. [cited by applicant]
Li, et al., “Automatic 3D Scene Generation based on Maya”, In Proceedings of IEEE 10th International Conference on Computer-Aided Industrial Design & Conceptual Design, Nov. 26, 2009, pp. 981-985. [cited by applicant]
Luan, et al., “Multi-Task Learning for Speaker-Role Adaptation in Neural Conversation Models”, In Proceedings of the 8th International Joint Conference on Natural Language Processing, Nov. 27, 2017, pp. 605-614. [cited by applicant]
Ma, et al., “Language-Driven Synthesis of 3D Scenes from Scene Databases”, In Journal of ACM Transactions on Graphics, vol. 37, Issue 6, Nov. 2018, 16 Pages. [cited by applicant]
Mousavi, et al., “Deep Reinforcement Learning: An Overview”, In Repository of arXiv:1806.08894v1, Jun. 23, 2018, pp. 1-17. [cited by applicant]
Nan, et al., “Deep NLP-based Co-evolvement for Synthesizing Code Analysis from Natural Language”, In Proceedings of the 30th ACM SIGPLAN International Conference on Compiler Construction, Mar. 2, 2021, pp. 141-152. [cited by applicant]
Parisotto, et al., “Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning”, In Repository of arXiv:1511.06342v4, Feb. 22, 2016, pp. 1-16. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/030156”, Mailed Date: Jul. 19, 2022, 13 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/044051”, Mailed Date: Jan. 5, 2023, 10 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/044303”, Mailed Date: Jan. 5, 2023, 10 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/044776”, Mailed Date: Jan. 18, 2023, 10 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/046633”, Mailed Date: Jan. 19, 2023, 12 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/046634”, Mailed Date: Jan. 20, 2023, 12 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US23/019020”, Mailed Date: Sep. 4, 2023, 15 Pages. [cited by applicant]
“Invitation to Pay Additional Fees Issued in PCT Application No. PCT/US23/019020”, Mailed Date: Jul. 14, 2023, 9 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US23/019022”, Mailed Date: Sep. 4, 2023, 17 Pages. [cited by applicant]
“Invitation to Pay Additional Fees Issued in PCT Application No. PCT/US23/019022”, Mailed Date: Jul. 12, 2023, 11 Pages. [cited by applicant]
“Invitation to Pay Additional Fee Issued in PCT Application No. PCT/US23/023263”, Mailed Date: Sep. 6, 2023, 10 Pages. [cited by applicant]
Presland, et al., “Creating Complex Interactive 3D Visualisations of Naval Battles from Natural Language Narratives”, In Proceedings of Developments in E-systems Engineering, Sep. 6, 2010, pp. 113-118. [cited by applicant]
Quirk, et al., “Language to Code: Learning Semantic Parsers for If-This-Then-That Recipes”, In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conf… [cited by applicant]
Seversky, et al., “Real-time Automatic 3D Scene Generation from Natural Language Voice and Text Descriptions”, In Proceedings of the 14th ACM international conference on Multimedia, Oct. 23, 2006, 4 Pages. [cited by applicant]
Simonini, Thomas, “Jammo the Robot”, Retrieved from: https://github.com/simoninithomas/jammo_the_robot, Sep. 16, 2021, 2 Pages. [cited by applicant]
Zhu, et al., “Flexible End-to-End Dialogue System for Knowledge Grounded Conversation”, In Repository of arXiv:1709.04264v1, Sep. 13, 2017, 8 Pages. [cited by applicant]
Zhou, et al., “A Dataset for Document Grounded Conversations”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Oct. 31, 2018, pp. 708-713. [cited by applicant]
Non-Final Office Action mailed on May 9, 2024, in U.S. Appl. No. 17/517,329, 17 pages. [cited by applicant]
Wu, et al., “Response Generation by Context-Aware Prototype Editing”, In Proceedings of The Thirty-Third AAAI Conference on Artificial Intelligence, Jan. 27, 2019, pp. 7281-7288. [cited by applicant]
Xu, et al., “A Skeleton-based Model for Promoting Coherence among Sentences in Narrative Story Generation”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Oct. 31, 2018, pp. 4306-4… [cited by applicant]
Yang, et al., “Identifying Semantic Edit Intentions from Revisions in Wikipedia”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Sep. 7, 2017, pp. 2000-2010. [cited by applicant]
Yao, et al., “Plan-and-Write: Towards Better Automatic Storytelling”, In Repository of arXiv:1811.05701v3, Feb. 19, 2019, 11 Pages. [cited by applicant]
Yavuz, et al., “DeepCopy: Grounded Response Generation with Hierarchical Pointer Networks”, In Proceedings of the 32nd Conference on Neural Information Processing Systems, Dec. 3, 2018, pp. 1-10. [cited by applicant]
Yin, et al., “Learning to Represent Edits”, In Repository of arXiv:1810.13337v2, Feb. 22, 2019, pp. 1-22. [cited by applicant]
Young, et al., “Augmenting End-to-End Dialogue Systems with Commonsense Knowledge”, In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, Feb. 2, 2018, pp. 4970-4977. [cited by applicant]
Zellers, et al., “Defending Against Neural Fake News”, In Journal of Advances in Neural Information Processing Systems, Dec. 8, 2019, pp. 1-12. [cited by applicant]
Zhang, et al., “BERTScore: Evaluating text generation with BERT”, In Repository of arXiv:1904.09675v3, Feb. 24, 2020, pp. 1-43. [cited by applicant]
Zhang, et al., “Modeling the Relationship between User Comments and Edits in Document Revision”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confe… [cited by applicant]
Zhang, et al., “Pointer: Constrained Text Generation via Insertion-based Generative Pre-training”, In Repository of arXiv:2005.00558v2, Sep. 27, 2020, 22 Pages. [cited by applicant]
Non-Final Office Action mailed on Sep. 28, 2024, in U.S. Appl. No. 17/961,189, 56 pages. [cited by applicant]
Final Office Action mailed on Oct. 24, 2024, in U.S. Appl. No. 17/517,329, 15 pages. [cited by applicant]
Final Office Action mailed on Feb. 13, 2025, in U.S. Appl. No. 17/961,189, 60 Pages. [cited by applicant]
Non-Final Office Action mailed on Dec. 31, 2024, in U.S. Appl. No. 17/356,440, 47 Pages. [cited by applicant]
Final Office Action mailed on Jul. 18, 2024, in U.S. Appl. No. 17/356,440, 41 pages. [cited by applicant]
Non-Final Office Action mailed on Oct. 3, 2025, in U.S. Appl. No. 17/517,329, 15 pages. [cited by applicant]
Final Office Action mailed on Jun. 10, 2025, in U.S. Appl. No. 17/356,440, 34 pages. [cited by applicant]
Kluwer, et al., “Talking NPCs in a Virtual Game World”, In Proceedings of the ACL 2010 System Demonstrations, 2010, pp. 36-41. [cited by applicant]
Non-Final Office Action mailed on Sep. 11, 2025, in U.S. Appl. No. 17/961,189, 70 Pages. [cited by applicant]
Non-final office action mailed on Oct. 10, 2025, in U.S. Appl. No. 17/959,706, 15 pages. [cited by applicant]
First Examination Report Received for Indian Application No. 202417027794, mailed on Nov. 26, 2025, 08 pages. [cited by applicant]
Non-Final Office Action mailed on Nov. 25, 2025, in U.S. Appl. No. 17/356,440 21 pages. [cited by applicant]
Communication pursuant to Article 94(3) received for European Application No. 22729983.1, mailed on Dec. 4, 2025, 09 Pages. [cited by applicant]
International Preliminary Report on Patentability (Chapter I) received for PCT Application No. PCT/US2024/034565, mailed on Jan. 8, 2026, 9 Pages. [cited by applicant]
Final Office Action mailed on Feb. 19, 2026, in U.S. Appl. No. 17/517,329, 20 pages. [cited by applicant]