Granted Patent B2

US 12,633,285 · App. 17/824,007 · Granted May 19, 2026

Inventor: Hiromasa Yoshimoto (Tokyo, JP)

Assignee: THE UNIVERSITY OF TOKYO

G10L15/08G06F3/14G10L15/22G10L25/57

Abstract

Claims (97)

1 . An information processing apparatus comprising:

a processor configured to execute a program so as to:

cause a display to display a plurality of objects, the plurality of objects being configured to be selected by a plurality of selectors who have heard a conversation of subjects, one of the plurality of objects corresponding to one of a plurality of utterance types, the one of the plurality of utterance types being included in the conversation;

cause the display to display a plurality of rows, the plurality of rows corresponding to the plurality of utterance types, respectively, an extending direction of each of the plurality of rows being along a time-series indicator;

cause the display to display an interface for reproducing a video or an audio of the conversation, the interface being configured with a seek bar and a plurality of operation buttons;

receive a first selection input from a first selector of the plurality of selectors while reproducing the conversation by operating the interface and information of a first time, the first selection input corresponding to a first object of the plurality of objects, the first object corresponding to a first utterance type of the plurality of utterance types included in the conversation, the first time representing a time at which the first object has been selected by the first selector;

generate a first symbol corresponding to the first selection input;

cause the display to display the first symbol in a first row of the plurality of rows corresponding to the first utterance type at a first position indicating the first time along the time-series indicator;

receive a second selection input from a second selector of the plurality of selectors while reproducing the conversation by operating the interface and information of a second time, the second selection input corresponding to a second object of the plurality of objects, the second object corresponding to a second utterance type of the plurality of utterance types included in the conversation, the second time representing a time at which the second object has been selected by the second selector;

generate a second symbol corresponding to the second selection input;

cause the display to display the second symbol in a second row of the plurality of rows corresponding to the second utterance type at a second position indicating the second time along the time-series indicator; and

cause, upon receiving both the first and second selection inputs, the display to selectively display only a consistent comparison result or only an inconsistent comparison result based on comparison between the first and second selection inputs.

2 . The information processing apparatus according to claim 1 , wherein

the processor is further configured to: to cause the display to display the consistent comparison result under a condition in which:

the first utterance type and the second utterance type are the same, the first row and the second row are the same, and a difference between the first time and the second time is within a predetermined range.

3 . The information processing apparatus according to claim 1 , wherein

the processor is further configured to cause the display to display the inconsistent comparison result under a condition in which:

the first utterance type and the second utterance type are different from each other; or

the difference between the first time and the second time is outside the predetermined range.

4 . The information processing apparatus according to claim 1 , wherein

the processor is further configured to cause the display to display the consistent comparison result under a condition in which:

the first utterance type and the second utterance type are the same, the first row and the second row are the same, and the first time and the second time are the same.

5 . The information processing apparatus according to claim 1 , wherein

the processor is further configured to:

cause the display to display the video representing the conversation; and

cause the display to display the first symbol at the first position indicating the first time in a synchronizing manner as a playing time of the video with respect to the conversation.

6 . The information processing apparatus according to claim 5 , wherein

the display has a plurality of display areas including first, second, and third display areas, and

the processor is further configured to:

cause the display to display the plurality of objects in the first display area;

cause the display to display the first and second symbols and the plurality of rows in the second display area; and

cause the display to display the interface and the video in the third display area.

7 . The information processing apparatus according to claim 1 , wherein

the processor is further configured to:

play the audio representing the conversation; and

cause the display to display the first symbol at the first position indicating the first time in a synchronizing manner as a playing time of the audio with respect to the conversation.

8 . The information processing apparatus according to claim 1 , wherein

the first symbol is either a character, a character string, a mark, or an icon, and

the first symbol is arranged on a time axis along the time-series indicator in the display with respect to the conversation.

9 . The information processing apparatus according to claim 1 , wherein

the processor is further configured to:

record the conversation of the subjects in a memory;

keep playing the recorded conversation in the memory while the processor receives a plurality of selection inputs from the first selector and information of a plurality of times, the plurality of selection inputs corresponding to one or more objects of the plurality of objects, the one or more objects corresponding to one or more utterance types of the plurality of utterance types included in the conversation, the plurality of times representing times at which the one or more objects have been selected by the first selector;

generate a plurality of symbols corresponding to the plurality of selection inputs; and

cause the display to display, in the plurality of rows, the plurality of symbols at a plurality of positions indicating the one or more objects and the plurality of times along the time-series indicator.

10 . The information processing apparatus according to claim 1 , wherein

the processor is further configured to:

cause the display to display the plurality of objects in order; and

cause the display to display the plurality of rows such that an order of the plurality of utterance types assigned to the plurality of rows matches the order of the plurality of objects corresponding to the plurality of utterance types, respectively.

11 . A non-transitory computer readable medium storing a program, causing a computer to execute the program by a processor so as to perform the steps of:

causing a display to display a plurality of objects, the plurality of objects being configured to be selected by a plurality of selectors who have heard a conversation of subjects, one of the plurality of objects corresponding to one of a plurality of utterance types, the one of the plurality of utterance types being included in the conversation;

causing the display to display a plurality of rows, the plurality of rows corresponding to the plurality of utterance types, respectively, an extending direction of each of the plurality of rows being along a time-series indicator;

causing the display to display an interface for reproducing a video or an audio of the conversation, the interface being configured with a seek bar and a plurality of operation buttons;

receiving a first selection input from a first selector of the plurality of selectors while reproducing the conversation by operating the interface and information of a first time, the first selection input corresponding to a first object of the plurality of objects, the first object corresponding to a first utterance type of the plurality of utterance types included in the conversation, the first time representing a time at which the first object has been selected by the first selector;

generating a first symbol corresponding to the first selection input;

causing the display to display the first symbol in a first row of the plurality of rows corresponding to the first utterance type at a first position indicating the first time along the time-series indicator;

receiving a second selection input from a second selector of the plurality of selectors while reproducing the conversation by operating the interface and information of a second time, the second selection input corresponding to a second object of the plurality of objects, the second object corresponding to a second utterance type of the plurality of utterance types included in the conversation, the second time representing a time at which the second object has been selected by the second selector;

generating a second symbol corresponding to the second selection input;

causing the display to display the second symbol in a second row of the plurality of rows corresponding to the second utterance type at a second position indicating the second time along the time-series indicator; and

causing, upon receiving both the first and second selection inputs, the display to selectively display only a consistent comparison result or only an inconsistent comparison result based on comparison between the first and second selection inputs.

12 . The non-transitory computer readable medium according to claim 11 , wherein

the processor is further configured to cause the display to display the consistent comparison result under a condition in which:

the first utterance type and the second utterance type are the same, the first row and the second row are the same, and a difference between the first time and the second time is within a predetermined range.

13 . The non-transitory computer readable medium according to claim 11 , wherein

the processor is further configured to cause the display to display the inconsistent comparison result under a condition in which:

the first utterance type and the second utterance type are different from each other; or

the difference between the first time and the second time is outside the predetermined range.

14 . The non-transitory computer readable medium according to claim 11 , wherein

the processor is further configured to cause the display to display the consistent comparison result under a condition in which:

the first utterance type and the second utterance type are the same, the first row and the second row are the same, and the first time and the second time are the same.

15 . The non-transitory computer readable medium according to claim 11 , wherein

the processor is further configured to:

cause the display to display the video representing the conversation; and

cause the display to display the first symbol at the first position indicating the first time in a synchronizing manner as a playing time of the video with respect to the conversation.

16 . The non-transitory computer readable medium according to claim 15 , wherein

the display has a plurality of display areas including first, second, and third display areas, and

the processor is further configured to:

cause the display to display the plurality of objects in the first display area;

cause the display to display the first and second symbols and the plurality of rows in the second display area; and

cause the display to display the interface and the video in the third display area.

17 . The non-transitory computer readable medium according to claim 11 , wherein

the processor is further configured to:

play the audio representing the conversation; and

cause the display to display the first symbol at the first position indicating the first time in a synchronizing manner as a playing time of the audio with respect to the conversation.

18 . The non-transitory computer readable medium according to claim 11 , wherein

the first symbol is either a character, a character string, a mark, or an icon, and

the first symbol is arranged on a time axis along the time-series indicator in the display with respect to the conversation.

19 . The non-transitory computer readable medium according to claim 11 , wherein

the processor is further configured to:

record the conversation of the subjects in a memory of the computer;

keep playing the recorded conversation in the memory while the processor receives a plurality of selection inputs from the first selector and information of a plurality of times, the plurality of selection inputs corresponding to one or more objects of the plurality of objects, the one or more objects corresponding to one or more utterance types of the plurality of utterance types included in the conversation, the plurality of times representing times at which the one or more objects have been selected by the first selector;

generate a plurality of symbols corresponding to the plurality of selection inputs; and

cause the display to display, in the plurality of rows, the plurality of symbols at a plurality of positions indicating the one or more objects and the plurality of times along the time-series indicator.

20 . The non-transitory computer readable medium according to claim 11 , wherein

the processor is further configured to:

cause the display to display the plurality of objects in order; and

cause the display to display the plurality of rows such that an order of the plurality of utterance types assigned to the plurality of rows matches the order of the plurality of objects corresponding to the plurality of utterance types, respectively.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (14)