IP Library Granted Patent US 11,869,491
Granted Patent B2
US 11,869,491 · App. 17/425,696 · Granted Jan 9, 2024

Abstract generation device, method, program, and recording medium

Inventors: Tsutomu Hirao (Tokyo, JP); Atsunori Ogawa (Tokyo, JP); Tomohiro Nakatani (Tokyo, JP); Masaaki Nagata (Tokyo, JP)
Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
G10L15/193G10L15/083G10L15/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,869,491
App. No.
17/425,696
Granted
Jan 9, 2024
Kind
B2
Abstract

A speech recognition unit converts an input utterance sequence into a confusion network sequence constituted by a k-best of candidate words of speech recognition results; a lattice generating unit generates a lattice sequence having the candidate words as internal nodes and a combination of k words among the candidate words for an identical speech as an external node, in which edges are extended between internal nodes other than internal nodes included in an identical external node, from the confusion network sequence; an integer programming problem generating unit generates an integer programming problem for selecting a path that maximizes an objective function including at least a coverage score of an important word, of paths following the internal nodes with the edges extended, in the lattice sequence; and the summary generating unit generates a high-quality summary having less speech recognition errors and low redundancy using candidate words indicated by the internal nodes included in the path selected by solving the integer programming problem, under a constraint on the length of a summary to be generated.

Claims (22)

1. A summary generating apparatus comprising a processor configured to execute operations comprising:

converting an input utterance sequence into a confusion network sequence constituted by a k-best of candidate words of speech recognition results;

generating, a lattice sequence having the candidate words as internal nodes and a combination of k words among the candidate words for an identical speech as an external node, in which edges are extended between internal nodes other than internal nodes included in an identical external node, from the confusion network sequence;

generating an integer programming problem for selecting a path that maximizes an objective function including at least a coverage score of an important word, of paths following the internal nodes with the edges extended, in the lattice sequence; and

generating a summary of the utterance sequence using the candidate words indicated by the internal nodes included in the path selected by solving the integer programming problem, under a constraint on a length of a summary to be generated.

2. The summary generating apparatus according to claim 1 , wherein the coverage score of the important word is a score that increases when the number of candidate words included in the summary to be generated increases, among candidate words that are independent words included in the lattice sequence.

3. A computer-readable non-transitory recording medium storing computer-executable summary generating program instructions that when executed by a processor cause a computer system to execute operations as the summary generating apparatus according to claim 2 .

4. The summary generating apparatus according to claim 2 , wherein the objective function further comprises a score of the internal node represented by an importance of a candidate word included in the summary to be generated, and a score of an edge indicating a likelihood of connection between candidate words at both ends of the edge included in the summary to be generated.

5. A computer-readable non-transitory recording medium storing computer-executable summary generating program instructions that when executed by a processor cause a computer system to execute operations as the summary generating apparatus according to claim 4 .

6. The summary generating apparatus according to claim 1 , wherein the objective function further comprises a score of the internal node represented by an importance of a candidate word included in the summary to be generated, and a score of an edge indicating a likelihood of connection between candidate words at both ends of the edge included in the summary to be generated.

7. The summary generating apparatus according to claim 6 , wherein the score of the internal node comprises an appearance frequency and an inverse document frequency of the candidate word and a confidence of speech recognition for the candidate word.

8. A computer-readable non-transitory recording medium storing computer-executable summary generating program instructions that when executed by a processor cause a computer system to execute operations as the summary generating apparatus according to claim 7 .

9. The summary generating apparatus according to claim 6 , wherein the score of the edge comprises a bigram appearance rate of candidate words at both ends of the edge.

10. A computer-readable non-transitory recording medium storing computer-executable summary generating program instructions that when executed by a processor cause a computer system to execute operations as f the summary generating apparatus according to claim 9 .

11. A computer-readable non-transitory recording medium storing computer-executable summary generating program instructions that when executed by a processor cause a computer system to execute operations as the summary generating apparatus according to claim 6 .

12. A computer-readable non-transitory recording medium storing computer-executable summary generating program instructions that when executed by a processor cause a computer system to execute operations as the summary generating apparatus according to claim 1 .

13. A computer-readable non-transitory storage medium that stores a summary generating program that when executed by a processor cause a computer to execute operations as the summary generating apparatus according to claim 1 .

14. A summary generating method performed at a summary generating apparatus comprising a speech recognition unit, a lattice generating unit, an integer programming problem generating unit, and a summary generating unit, the method comprising:

converting, at the speech recognition unit, an input utterance sequence into a confusion network sequence constituted by a k-best of candidate words of speech recognition results;

generating, at the lattice generating unit, a lattice sequence having the candidate words as internal nodes and a combination of k words among the candidate words for an identical speech as an external node, in which edges are extended between internal nodes other than internal nodes included in an identical external node, from the confusion network sequence;

generating, at the integer programming problem generating unit, an integer programming problem for selecting a path that maximizes an objective function including at least a coverage score of an important word, of paths following the internal nodes with the edges extended, in the lattice sequence; and

generating, at the summary generating unit, a summary of the utterance sequence using the candidate words indicated by the internal nodes included in the path selected by solving the integer programming problem, under a constraint on a length of a summary to be generated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2021
From: HIRAO, TSUTOMU; OGAWA, ATSUNORI; NAKATANI, TOMOHIRO; NAGATA, MASAAKI
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Reel/Frame 056967/0896 →
Priority Claims (1)
JP 2019-012210 · Jan 28, 2019 · national
Continuity (1)
Related Publication 20220189468A1 · Jun 16, 2022