IP Library › Granted Patent US 12,718,102
Granted Patent B2
US 12,718,102 · App. 17/325,117 · Granted Aug 25, 2026

Low-rank adaptation of neural network models

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,718,102
App. No.
17/325,117
Filed
May 19, 2021
Granted
Aug 25, 2026
Kind
B2
Art Unit
2126
USPC
706/15
Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2021
From: CHEN, WEIZHU; HU, JINGFENG; SHEN, YELONG; WANG, SHEAN; LIU, YABIN
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 056436/0949 →
Continuity (1)
Related Publication 20220383126A1 · Dec 1, 2022
References Cited (20)
US 20140019388A1 · Kingsbury · 2014 [cited by examiner]
US 20200265196A1 · Ravi et al. · 2020 [cited by applicant]
Authors: Hutchinson et al. Title: A Sparse Plus Low-Rank Exponential Language Model for Limited Resource Scenarios Date: Mar. 2015 (Year: 2015). [cited by examiner]
Authors: Choromanski & Colwell Title: Rethinking Attention with Performers Date: Oct. 23, 2020 (Year: 2020). [cited by examiner]
Authors: Zhao et al Title: Low-Rank Plus Diagonal Adaptation for Deep Neural Networks Published: May 19, 2016 (Year: 2016). [cited by examiner]
Hu, et al., “LoRA: Low-Rank Adaptation of Large Language Models”, In repository of arxiv code: 2106.09685v2 [cs.CL], Oct. 16, 2021, 26 Pages. [cited by applicant]
Mao, et al., “LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression”, In repository of arxiv code: 2004.04124v2 [cs.CL], Oct. 21, 2020, 10 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/026611”, Mailed Date: Aug. 9, 2022, 15 Pages. [cited by applicant]
Pfeiffer, et al., “MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer”, In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Nov. 16, 2020, pp. 7654-7673. [cited by applicant]
Aghajanyan, et al., “Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning”, In Repository of arXiv:2012.13255v1, Dec. 22, 2020, pp. 1-11. [cited by applicant]
Brown, et al., “Language Models are Few-Shot Learners”, In Repository of arXiv:2005.14165v4, Jul. 22, 2020, 75 Pages. [cited by applicant]
Houlsby, et al., “Parameter-Efficient Transfer Learning for Nlp”, In Repository of arXiv:1902.00751v2, Jun. 13, 2019, 13 Pages. [cited by applicant]
Li, et al., “Prefix-Tuning: Optimizing Continuous Prompts for Generation”, In Repository of arXiv:2101.00190v1, Jan. 1, 2021, 15 Pages. [cited by applicant]
Radford, et al., “Language Models are Unsupervised Multitask Learners”, In Journal of OpenAI Blog, vol. 1, Issue 8, Feb. 24, 2019, 24 Pages. [cited by applicant]
Rajpurkar, et al., “Know what you don't know: Unanswerable questions for squad”, In Journal of Computing Research Repository, Jun. 2018, 9 Pages. [cited by applicant]
Reddy, et al., “CoQA: A Conversational Question Answering Challenge”, In Journal of Computing Research Repository, Aug. 21, 2018, 16 Pages. [cited by applicant]
Williams, et al., “A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference”, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human … [cited by applicant]
Zhong, et al., “Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning”, In Journal of Computing Research Repository, Aug. 31, 2017, 13 Pages. [cited by applicant]
Communication pursuant to Article 94(3) EPC received in European Application No. 22724541.2, mailed on Nov. 13, 2025, 9 pages. [cited by applicant]
First Office Action Received for Chinese Application No. 202280036502.2, mailed on Mar. 11, 2026, 08 pages. (English Translation Provided). [cited by applicant]