IP Library › Granted Patent US 12,505,282
Granted Patent B2
US 12,505,282 · App. 18/410,621 · Granted Dec 23, 2025

Language model for abstractive summarization

Inventors: Luke Percival de Oliveira (San Francisco, CA); Alfredo Láinez Rodrigo (Madrid, ES)
Assignee: Twilio Inc.
G06F40/166G06F40/284G06N3/04G06N3/08H04M3/5183
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,505,282
App. No.
18/410,621
Granted
Dec 23, 2025
Kind
B2
Abstract

Methods, systems, and computer programs are presented for abstractive summarization of text by viewing sequence transduction as a language modeling problem. One method comprises an operation for training a machine-learning program to create a machine-learning model that estimates a word to be added to a running summary for the text being summarized. The method further comprises operations for detecting the text to be summarized, initializing the running summary, and performing a plurality of iterations. Each iteration comprises providing, to the machine-learning model, the source text and the running summary, and adding, using the machine-learning model, a new word to the running summary. Further, the method comprises an operation for storing, on a memory, the running summary as the summary of the text.

Claims (54)

1 . A method comprising:

training a machine-learning model to output a word to be added to a summary of text, the machine-learning model being trained to output the word based on the text and on the summary of the text;

by one or more processors, accessing the text;

inputting, by the one or more processors, the text and the summary of the text into the machine-learning model trained to output the word to be added to the inputted summary of the text based on the inputted text and on the inputted summary to which the outputted word is to be added; and

adding, by the one or more processors, the outputted word to the summary of the text.

2 . The method of claim 1 , wherein:

the summary is a running summary of the accessed text; and

the machine-learning model is trained to output the word to be included in the running summary of the accessed text.

3 . The method of claim 1 , further comprising:

initializing the summary by causing the summary to be empty.

4 . The method of claim 1 , wherein:

the accessed text represents a turn in a conversation that includes multiple turns.

5 . The method of claim 1 , further comprising:

causing presentation of at least a portion of the summary with the added word.

6 . The method of claim 1 , wherein:

the machine-learning model is trained to estimate the word based on the inputted text and on the inputted summary of the text and to output the estimated word in response to the inputting of the text and the summary of the text.

7 . The method of claim 1 , wherein:

the machine-learning model is trained based on multiple conversations and multiple summaries, each of the multiple conversations being summarized by a corresponding summary among multiple summaries.

8 . A system comprising:

one or more processors; and

one or more computer-readable media storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

training a machine-learning model to output a word to be added to a summary of text, the machine-learning model being trained to output the word based on the text and on the summary of the text;

accessing the text;

inputting the text and the summary of the text into the machine-learning model trained to output the word to be added to the inputted summary of the text based on the inputted text and on the inputted summary to which the outputted word is to be added; and

adding the outputted word to the summary of the text.

9 . The system of claim 8 , wherein:

the summary is a running summary of the accessed text; and

the machine-learning model is trained to output the word to be included in the running summary of the accessed text.

10 . The system of claim 8 , wherein the operations further comprise:

initializing the summary by causing the summary to be empty.

11 . The system of claim 8 , wherein:

the accessed text represents a turn in a conversation that includes multiple turns.

12 . The system of claim 8 , wherein the operations further comprise:

causing presentation of at least a portion of the summary with the added word.

13 . The system of claim 8 , wherein:

the machine-learning model is trained to estimate the word based on the inputted text and on the inputted summary of the text and to output the estimated word in response to the inputting of the text and the summary of the text.

14 . The system of claim 8 , wherein:

the machine-learning model is trained based on multiple conversations and multiple summaries, each of the multiple conversations being summarized by a corresponding summary among multiple summaries.

15 . A non-transitory machine-readable medium storing instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

training a machine-learning model to output a word to be added to a summary of text, the machine-learning model being trained to output the word based on the text and on the summary of the text;

accessing the text;

inputting the text and the summary of the text into the machine-learning model trained to output the word to be added to the inputted summary of the text based on the inputted text and on the inputted summary to which the outputted word is to be added; and

adding the outputted word to the summary of the text.

16 . The non-transitory machine-readable medium of claim 15 , wherein:

the summary is a running summary of the accessed text; and

the machine-learning model is trained to output the word to be included in the running summary of the accessed text.

17 . The non-transitory machine-readable medium of claim 15 , wherein the operations further comprise:

initializing the summary by causing the summary to be empty.

18 . The non-transitory machine-readable medium of claim 15 , wherein:

the accessed text represents a turn in a conversation that includes multiple turns.

19 . The non-transitory machine-readable medium of claim 15 , wherein the operations further comprise:

causing presentation of at least a portion of the summary with the added word.

20 . The non-transitory machine-readable medium of claim 15 , wherein:

the machine-learning model is trained to estimate the word based on the inputted text and on the inputted summary of the text and to output the estimated word in response to the inputting of the text and the summary of the text.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2024
From: DE OLIVEIRA, LUKE PERCIVAL; RODRIGO, ALFREDO LÁINEZ
To: TWILIO INC.
Reel/Frame 066121/0989 →
Continuity (4)
Continuation 17939176 · Sep 7, 2022
Continuation 17304081 · Jun 14, 2021
Provisional Application 63072538 · Aug 31, 2020
Related Publication 20240152689A1 · May 9, 2024
References Cited (175)
US 3568155A · Abraham et al. · 1971 [cited by applicant]
US 5384703A · Withgott · 1995 [cited by examiner]
US 5945933A · Kalkstein · 1999 [cited by applicant]
US 6138139A · Beck et al. · 2000 [cited by applicant]
US 6567805B1 · Johnson et al. · 2003 [cited by applicant]
US 7702508B2 · Bennett · 2010 [cited by applicant]
US 7725321B2 · Bennett · 2010 [cited by applicant]
US 7801910B2 · Houh et al. · 2010 [cited by applicant]
US 8428227B2 · Angel et al. · 2013 [cited by applicant]
US 8494133B2 · Jeffs et al. · 2013 [cited by applicant]
US 8775165B1 · Oikawa · 2014 [cited by applicant]
US 8798242B1 · Sankaranarayanan · 2014 [cited by applicant]
US 8942359B2 · Seetharaman et al. · 2015 [cited by applicant]
US 8983975B2 · Kenton et al. · 2015 [cited by applicant]
US 9880807B1 · Haggerty et al. · 2018 [cited by applicant]
US 9910909B2 · Hegde et al. · 2018 [cited by applicant]
US 9965726B1 · Tablan et al. · 2018 [cited by applicant]
US 10089639B2 · Kannan et al. · 2018 [cited by applicant]
US 10388272B1 · Thomson et al. · 2019 [cited by applicant]
US 10453455B2 · Manuvinakurike et al. · 2019 [cited by applicant]
US 10467339B1 · Shen · 2019 [cited by applicant]
US 10839335B2 · Weisman et al. · 2020 [cited by applicant]
US 10978056B1 · Challa et al. · 2021 [cited by applicant]
US 11165900B2 · Sachdev · 2021 [cited by applicant]
US 11170154B1 · Van Dyke et al. · 2021 [cited by applicant]
US 11170175B1 · Kohli et al. · 2021 [cited by applicant]
US 11475210B2 · De Oliveira et al. · 2022 [cited by applicant]
US 11568231B2 · Meteer et al. · 2023 [cited by applicant]
US 11765267B2 · Cole et al. · 2023 [cited by applicant]
US 11809804B2 · Láinez et al. · 2023 [cited by applicant]
US 11848025B2 · Proenca et al. · 2023 [cited by applicant]
US 11941348B2 · De Oliveira et al. · 2024 [cited by applicant]
US 11947872B1 · Mahler-Haug et al. · 2024 [cited by applicant]
US 12079573B2 · Láinez Rodrigo et al. · 2024 [cited by applicant]
US 12158902B2 · de Oliveira et al. · 2024 [cited by applicant]
US 12166919B2 · Cole et al. · 2024 [cited by applicant]
US 12197842B2 · Láinez Rodrigo et al. · 2025 [cited by applicant]
US 20020046018A1 · Marcu · 2002 [cited by examiner]
US 20040093200A1 · Scott · 2004 [cited by applicant]
US 20070133437A1 · Wengrovitz et al. · 2007 [cited by applicant]
US 20090030894A1 · Mamou et al. · 2009 [cited by applicant]
US 20100104086A1 · Park · 2010 [cited by applicant]
US 20100332477A1 · Jeffs et al. · 2010 [cited by applicant]
US 20130007037A1 · Azzam et al. · 2013 [cited by applicant]
US 20140108369A1 · Nijjer · 2014 [cited by applicant]
US 20140169547A1 · Murgai · 2014 [cited by applicant]
US 20150032448A1 · Wasserblat et al. · 2015 [cited by applicant]
US 20150046783A1 · O'donoghue et al. · 2015 [cited by applicant]
US 20150106091A1 · Wetjen et al. · 2015 [cited by applicant]
US 20150181020A1 · Fitzsimmons et al. · 2015 [cited by applicant]
US 20150256677A1 · Konig et al. · 2015 [cited by applicant]
US 20160092792A1 · Chandrasekaran et al. · 2016 [cited by applicant]
US 20180113854A1 · Vig et al. · 2018 [cited by applicant]
US 20180143956A1 · Skarbovsky et al. · 2018 [cited by applicant]
US 20180332165A1 · Cunningham et al. · 2018 [cited by applicant]
US 20190121852A1 · Applegate et al. · 2019 [cited by applicant]
US 20190392837A1 · Jung et al. · 2019 [cited by applicant]
US 20200279017A1 · Norton · 2020 [cited by examiner]
US 20210056170A1 · Bohannon · 2021 [cited by examiner]
US 20210158805A1 · Sivasubramanian et al. · 2021 [cited by applicant]
US 20210264097A1 · Herzig · 2021 [cited by examiner]
US 20210294829A1 · Bender · 2021 [cited by examiner]
US 20210335367A1 · Graff et al. · 2021 [cited by applicant]
US 20210365485A1 · Kohita · 2021 [cited by examiner]
US 20220067269A1 · De Oliveira et al. · 2022 [cited by applicant]
US 20220067284A1 · He · 2022 [cited by examiner]
US 20220121884A1 · Zadeh et al. · 2022 [cited by applicant]
US 20220156296A1 · De Oliveira et al. · 2022 [cited by applicant]
US 20220156460A1 · Láinez Rodrigo et al. · 2022 [cited by applicant]
US 20220210268A1 · Cole et al. · 2022 [cited by applicant]
US 20220261631A1 · Cohen et al. · 2022 [cited by applicant]
US 20220382959A1 · Láinez Rodrigo et al. · 2022 [cited by applicant]
US 20220414319A1 · De Oliveira et al. · 2022 [cited by applicant]
US 20230134796A1 · Bhatnagar et al. · 2023 [cited by applicant]
US 20230388413A1 · Cole et al. · 2023 [cited by applicant]
US 20240020458A1 · Láinez Rodrigo et al. · 2024 [cited by applicant]
US 20240037418A1 · Durairaj et al. · 2024 [cited by applicant]
US 20240378384A1 · Rodrigo et al. · 2024 [cited by applicant]
US 20250030797A1 · Cole et al. · 2025 [cited by applicant]
US 20250045306A1 · de Oliveira et al. · 2025 [cited by applicant]
US 20250071077A1 · Chen et al. · 2025 [cited by applicant]
US 20250094684A1 · Rodrigo et al. · 2025 [cited by applicant]
US 20250103620A1 · De Oliveira et al. · 2025 [cited by applicant]
US 20250124219A1 · de Oliveira et al. · 2025 [cited by applicant]
WO WO2021234610A1 · 2021 [cited by examiner]
WO WO2022086939A1 · 2022 [cited by applicant]
U.S. Appl. No. 18/784,206, filed Jul. 25, 2024, Tool for Categorizing and Extracting Data From Audio Conversations. [cited by applicant]
U.S. Appl. No. 17/305,976, filed Jul. 19, 2021, Transition-Driven Transcript Search (as amended). [cited by applicant]
U.S. Appl. No. 17/447,039 U.S. Pat. No. 11,765,267, filed Sep. 7, 2021, Tool for Annotating and Reviewing Audio Conversations. [cited by applicant]
U.S. Appl. No. 18/448,675, filed Aug. 11, 2023, Tool for Annotating and Reviewing Audio Conversations. [cited by applicant]
U.S. Appl. No. 17/304,081 U.S. Pat. No. 11,475,210, filed Jun. 14, 2021, Language Model for Abstractive Summarization. [cited by applicant]
U.S. Appl. No. 17/939,176 U.S. Pat. No. 11,941,348, filed Sep. 7, 2022, Language Model for Abstractive Summarization. [cited by applicant]
U.S. Appl. No. 17/449,405, filed Sep. 29, 2021, Tool for Categorizing and Extracting Data from Audio Conversations. [cited by applicant]
U.S. Appl. No. 17/303,279 U.S. Pat. No. 11,809,804, filed May 26, 2021, Text Formatter. [cited by applicant]
U.S. Appl. No. 18/373,450, filed Sep. 27, 2023, Text Formatter. [cited by applicant]
U.S. Appl. No. 18/400,529, filed Dec. 29, 2023, Capturing Output of Language Operator-Based Communication Analysis. [cited by applicant]
“U.S. Appl. No. 17/449,405, Notice of Allowance mailed Apr. 29, 2024”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 18/448,675, Response filed Jun. 12, 2024 to Non Final Office Action mailed Mar. 12, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/373,450, Non Final Office Action mailed Jun. 17, 2024”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Response filed Jun. 25, 2024 to Non Final Office Action mailed Mar. 26, 2024”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/448,675, Notice of Allowance mailed Jul. 5, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 18/400,529, Non Final Office Action mailed Jul. 18, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Notice of Allowance mailed Jul. 22, 2024”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 18/448,675, Supplemental Notice of Allowability mailed Jul. 30, 2024”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/449,405, Corrected Notice of Allowability mailed Aug. 7, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Supplemental Notice of Allowability mailed Aug. 9, 2024”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 18/373,450, Examiner Interview Summary mailed Aug. 12, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/303,279, Notice of Allowance mailed Aug. 24, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/304,081, Notice of Allowability mailed Jul. 20, 2022”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/304,081, Notice of Allowance mailed Jun. 9, 2022”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Examiner Interview Summary mailed Dec. 12, 2023”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Final Office Action mailed Jan. 9, 2024”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Non Final Office Action mailed Mar. 26, 2024”, 18 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Non Final Office Action mailed Sep. 21, 2023”, 17 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Response filed Mar. 6, 2024 to Final Office Action mailed Jan. 9, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, Response filed Dec. 14, 2023 to Non Final Office Action mailed Sep. 21, 2023”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/447,039, Examiner Interview Summary mailed Nov. 7, 2022”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/447,039, Final Office Action mailed Feb. 21, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/447,039, Non Final Office Action mailed Aug. 16, 2022”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/447,039, Notice of Allowance mailed May 12, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/447,039, Response filed Apr. 21, 2023 to Final Office Action mailed Feb. 21, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/447,039, Response filed Nov. 16, 2022 to Non Final Office Action mailed Aug. 16, 2022”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/449,405, Examiner Interview Summary mailed Jan. 24, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/449,405, Non Final Office Action mailed Nov. 27, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/449,405, Response filed Feb. 27, 2024 to Non Final Office Action mailed Nov. 27, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/939,176, Non Final Office Action mailed Jun. 15, 2023”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/939,176, Notice of Allowance mailed Nov. 8, 2023”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/939,176, Response filed Sep. 14, 2023 to Non Final Office Action mailed Jun. 15, 2023”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/939,176, Supplemental Notice of Allowability mailed Feb. 21, 2024”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 18/448,675, Non Final Office Action mailed Mar. 12, 2024”, 8 pgs. [cited by applicant]
Ba, Jimmy Lei, et al., “Layer Normalization”, (Jul. 21, 2016), 14 pgs. [cited by applicant]
Celikyilmaz, Asli, et al., “Deep Communicating Agents for Abstractive Summarization”, arXiv preprint, arXiv:1803.10357v3 [cs.CL], (Aug. 15, 2018), 14 pgs. [cited by applicant]
Chopra, Sumit, et al., “Abstractive Sentence Summarization with Attentive Recurrent Neural Networks”, Proceedings of the NAACL-HLT16, (2016), 93-98. [cited by applicant]
Dai, et al., “Semi-supervised Sequence Learning”, arXiv preprint, arXiv:1511.01432 [cs.LG], (Nov. 4, 2015), 10 pgs. [cited by applicant]
Devlin, Jacob, et al., “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”, (2018), 14 pgs. [cited by applicant]
Efstathiou, et al., “Semantic Source Code Models Using Identifier Embeddings”, IEEE/ACM 16th International Conference on Mining Software Repositories (MSR), (2019), 29-33. [cited by applicant]
Gehrmann, Sebastian, et al., “Bottom-Up Abstractive Summarization”, arXiv preprint, arXiv:1808.10792v2 [cs.CL], (Oct. 9, 2018), 12 pgs. [cited by applicant]
Gu, Jiatao, et al., “Incorporating Copying Mechanism in Sequence-to-Sequence Learning”, arXiv preprint, arXiv:1603.06393v3, (Jun. 8, 2016), 10 pgs. [cited by applicant]
Holtzman, Ari, et al., “The Curious Case of Neural Text Degeneration”, 8th International Conference on Learning Representations (ICLR), (Apr. 2020), 16 pgs. [cited by applicant]
Howard, Jeremy, et al., “Universal Language Model Fine-tuning for Text Classification”, arXiv preprint, arXiv:1801.06146v5 [cs.CL], (May 23, 2018), 12 pgs. [cited by applicant]
Kingma, Diederik P, et al., “Adam: A Method for Stochastic Optimization”, (Jan. 30, 2017), 15 pgs. [cited by applicant]
Kudo, Taku, et al., “SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing”, arXiv preprint, arXiv:1808.06226v1 [cs.CL], (Aug. 19, 2018), 6 pgs. [cited by applicant]
Li, Piji, et al., “Actor-Critic based Training Framework for Abstractive Summarization”, arXiv preprint, arXiv:1803.11070v2 [cs.CL], (Aug. 15, 2018), 10 pgs. [cited by applicant]
Lin, Chin-Yew, “Rouge: A Package for Automatic Evaluation of Summaries”, Text Summarization Branches Out: Proceedings of the ACL-04 Workshop, Barcelona, Spain., [Online]. Retrieved from the Internet: <URL: https://www.a… [cited by applicant]
Liu, Peter J, et al., “Generating Wikipedia by Summarizing Long Sequences”, arXiv preprint, arXiv:1801.10198v1 [cs.CL], (Jan. 30, 2018), 18 pgs. [cited by applicant]
Lloret, Elena, et al., “The Challenging Task of Summary Evaluation: An Overview”, Author preprint, Language Resources and Evaluation, 52:1, 101-148, (2017), 54 pages. [cited by applicant]
Nallapati, Ramesh, et al., “Abstractive text summarization using sequence-to-sequence RNNs and beyond”, arXiv preprint, arXiv:1602.06023v5 [cs.CL], [Online] Retrieved from the internet: <https://www.aclweb.org/anthology… [cited by applicant]
Narayan, Shashi, et al., “Don't Give Me the Details, Just the Summary.”, arxiv prepint, arixiv 1808.08745v1 cs.cl, (Aug. 27, 2018), 11 pages. [cited by applicant]
Paulus, Romain, et al., “A Deep Reinforced Model for Abstractive Summarization”, arXiv:1705.04304v3 [cs.CL], (Nov. 13, 2017), 12 pgs. [cited by applicant]
Peters, Matthew, et al., “Deep contextualized word representations”, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1… [cited by applicant]
Radford, Alec, et al., “Improving Language Understanding Generative Pre-Training”, author preprint, (2018), 12 pgs. [cited by applicant]
Radford, Alec, et al., “Language Models are Unsupervised Multitask Learners”, author preprint, (2018), 24 pgs. [cited by applicant]
Rush, Alexander M, et al., “A Neural Attention Model for Abstractive Sentence Summarization”, arXiv preprint, arXiv:1509.00685v2 [cs.CL], (Sep. 3, 2015), 11 pgs. [cited by applicant]
Schluter, Natalie, “The limits of automatic summarisation according to ROUGE”, Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: vol. 2, Short Papers, (Apr. 3-7… [cited by applicant]
See, Abigail, et al., “Get to the Point: Summarization with Pointer-Generator Networks”, arXiv preprint, arXiv:1704.04368v2 [cs.CL], (Apr. 25, 2017), 20 pgs. [cited by applicant]
Sennrich, Rico, et al., “Neural Machine Translation of Rare Words with Subword Units”, In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL Berlin, Germany, vol. 1: Long Papers… [cited by applicant]
Sutskever, Ilya, et al., “Sequence to Sequence Learning with Neural Networks”, Part of Advances in Neural Information Processing Systems 27 (NIPS 2014), (2014), 9 pgs. [cited by applicant]
Tu, Zhaopeng, et al., “Modeling Coverage for Neural Machine Translation”, arXiv preprint, arXiv:1601.04811v6 [cs.CL], (Aug. 6, 2016), 11 pgs. [cited by applicant]
Vaswani, Ashish, et al., “Attention is All You Need”, 31st Conference on Neural Information Processing Systems (NIPS), arXiv:1706.03762v5 [cs.CL], (Dec. 6, 2017), 15 pgs. [cited by applicant]
Vinyals, Oriol, et al., “Pointer Networks”, arXiv preprint, arXiv:1506.03134v2 [stat.ML], (Jan. 2, 2017), 9 pgs. [cited by applicant]
Wu, Yonghui, et al., “Googles Neural Machine Translation System: Bridging the Gap between Human and Machine Translation”, arXiv preprint, arXiv:1609.08144v2 cs.CL, (Oct. 8, 2016), 23 pgs. [cited by applicant]
Zeng, Wenyuan, et al., “Efficient Summarization with Read-Again and Copy Mechanism”, arXiv preprint, arXiv:1611.03382v1 [cs.CL], (Nov. 10, 2016), 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, 312 Amendment filed Sep. 13, 2024”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 18/373,450, Response filed Sep. 17, 2024 to Non Final Office Action mailed Jun. 17, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/305,976, PTO Response to Rule 312 Communication mailed Sep. 20, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18 373,450, Notice of Allowance mailed Sep. 25, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 18/448,675, 312 Amendment filed Oct. 3, 2024”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 18/373,450, Corrected Notice of Allowability mailed Oct. 15, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18/400,529, Response filed Oct. 16, 2024 to Non Final Office Action mailed Jul. 18, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 18/448,675, Supplemental Notice of Allowability mailed Oct. 22, 2024”, 6 pgs. [cited by applicant]
Parr, Terence, “Towards a Universal Code Formatter through Machine Learning”, Proceedings of The 2016 Acm Sigplan International Conference on Software Language Engineering, (Oct. 2016), 15 pgs. [cited by applicant]
Solovyeva, “Comparison of Different Machine Learning Approaches to Text Classification”, Conference of Russian Young Researchers in Electrical and Electronic Engineering, copyright 2022 IEEE, (2022), 4 pgs. [cited by applicant]
“U.S. Appl. No. 18/400,529, Final Office Action mailed Jan. 30, 2025”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 18/400,529, Notice of Allowance mailed May 14, 2025”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 18/400,529, Response filed Mar. 31, 2025 to Final Office Action mailed Jan. 30, 2025”, 8 pgs. [cited by applicant]