IP Library › Granted Patent US 12,210,847
Granted Patent B2
US 12,210,847 · App. 17/435,018 · Granted Jan 28, 2025

Sentence generation using pre-trained model with word importance and focus point

Inventors: Itsumi Saito (Tokyo, JP); Kyosuke Nishida (Tokyo, JP); Atsushi Otsuka (Tokyo, JP); Kosuke Nishida (Tokyo, JP); Hisako Asano (Tokyo, JP); Junji Tomita (Tokyo, JP)
Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
G06F40/56G06F40/226
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,210,847
App. No.
17/435,018
Filed
Aug 30, 2021
Granted
Jan 28, 2025
Kind
B2
Art Unit
2658
USPC
704/9
Abstract

A sentence generation device has: an estimation unit for receiving input of a first sentence and a focus point related to generation of a second sentence to be generated based on the first sentence, and estimating importance of each word constituting the first sentence using a pre-trained model; and a generation unit for generating the second sentence based on the importance, and thus makes it possible to evaluate importance of a constituent element of an input sentence in correspondence with a designated focus point.

Claims (8)

1. A sentence generation learning device comprising a processor configured to execute operations comprising:

receiving input of a first sentence and a focus point related to generation of a second sentence to be generated based on the first sentence, wherein the focus point as represented in character string form is distinct from the first sentence and a part of the first sentence;

estimating importance of each word constituting the first sentence using a machine learning model according to the focus point;

generating the second sentence based on the importance; and

learning a parameter of the machine learning model using:

a first error between the estimated importance of a word according to the focus point and a label indicating whether or not the word is included in an output sentence that is a correct answer, and

a second error between the generated second sentence and the output sentence that is the correct answer.

2. The sentence generation learning device according to claim 1 , wherein the machine learning model includes a model trained using training data, and the training data include an input sentence, the output sentence, the focus point, and the label.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2022
From: SAITO, ITSUMI; NISHIDA, KYOSUKE; OTSUKA, ATSUSHI; NISHIDA, KOSUKE; ASANO, HISAKO; TOMITA, JUNJI
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Reel/Frame 061636/0794 →
Priority Claims (1)
JP 2019-037617 · Mar 1, 2019 · national
Continuity (1)
Related Publication 20220138438A1 · May 5, 2022
References Cited (29)
US 5708822A · Wical · 1998 [cited by examiner]
US 11188824B2 · Strope · 2021 [cited by examiner]
US 11954435B2 · Saito · 2024 [cited by examiner]
US 20080040114A1 · Zhou · 2008 [cited by examiner]
US 20080109425A1 · Yih · 2008 [cited by examiner]
US 20110093258A1 · Xu · 2011 [cited by examiner]
US 20120029908A1 · Takamatsu · 2012 [cited by examiner]
US 20170132512A1 · Ioffe · 2017 [cited by examiner]
US 20170169355A1 · Boyer · 2017 [cited by examiner]
US 20180060722A1 · Hwang · 2018 [cited by examiner]
US 20180365220A1 · Chakraborty · 2018 [cited by examiner]
US 20190205372A1 · Li · 2019 [cited by examiner]
US 20190384807A1 · Dernoncourt · 2019 [cited by examiner]
US 20200081980A1 · Eisenberg · 2020 [cited by examiner]
US 20200184012A1 · Stoyanovsky · 2020 [cited by examiner]
US 20200242197A1 · Srinivasan · 2020 [cited by examiner]
US 20220138239A1 · Saito · 2022 [cited by examiner]
US 20220343076A1 · Saito · 2022 [cited by examiner]
US 20220366140A1 · Saito · 2022 [cited by examiner]
US 20230028376A1 · Saito · 2023 [cited by examiner]
US 20230130902A1 · Saito · 2023 [cited by examiner]
JP 2016118813A · 2016 [cited by applicant]
Gehrmann et al. (2018) “Bottom-Up Abstractive Summarization” Proceedings of the 2018 Conference on Empirical Methodsnin Natural Language Processing, pp. 4098-4109. [cited by applicant]
Nishikawa et al. (2015) “Query-dependent summary using document structure for Wikipedia articles” Proceedings of the 21st Annual Meeting of the Natural Language Processing Society, Mar. 16, 2015, pp. 589-592. [cited by applicant]
Wang et al. (2018) “Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification” Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Jul. 15, 2018, pp. 1918-19… [cited by applicant]
Hu et al. (2018) “Reinforced Mnemonic Reader for Machine Reading Comprehension” Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, Jul. 13, 2018, pp. 4099-4106. [cited by applicant]
Hsu et al. (2018) “A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss” Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Jul. 15, 2018, pp. 132-1… [cited by applicant]
See et al. (2017) “Get To The Point: Summarization with Pointer-Generator Networks” Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Jul. 30, 2017, pp. 1073-1083. [cited by applicant]
Bajaj et al. (2018) “MS MARCO: A Human Generated Machine Reading Comprehension Dataset” arXiv, Oct. 31, 2018. [cited by applicant]
Cited By (1)
US 12,737,705