IP Library Granted Patent US 11,243,741
Granted Patent B2
US 11,243,741 · App. 16/967,448 · Granted Feb 8, 2022

Display control device and display control method

Inventor: Tomohiro Iwasaki (Tokyo, JP)
Assignee: MITSUBISHI ELECTRIC CORPORATION
G06F3/167G06F3/0482G06F3/1423G10L15/22G10L15/30G06F2203/04803G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,243,741
App. No.
16/967,448
Granted
Feb 8, 2022
Kind
B2
Abstract

Provided is a display control device to perform, on a display device having display regions in which a plurality of applications each are displayed, display control based on a speech content of a spoken voice. A display controller of the display control device acquires first information allowing identification of at least one application related to the speech content from among the plurality of applications and second information allowing identification of at least one processing target in processing to be performed by the at least one application. The at least one processing target is related to the speech content. The display controller performs control to cause, in a display region identified based on the first information, the at least one processing target identified based on the second information. The at least one processing target is a processing target in processing to be performed by the application to be displayed.

Claims (38)

1. A display control device to perform, on a display device having display regions in which a plurality of applications each are displayed, display control based on a speech content of a spoken voice, the display control device comprising:

a processor to execute a program; and

a memory to store the program which, when executed by the processor, causes the processor to perform processes of

acquiring first information and second information, the first information allowing identification of applications related to the speech content from among the plurality of applications, the second information allowing identification of a plurality of processing targets to be potentially processed by the applications, the plurality of processing targets being related to the speech content, and

performing control to cause the display device to simultaneously display, in different ones of the display regions each displaying a corresponding one of the applications identified based on the first information, respective textual lists of recognition candidates determined according to recognition of the spoken voice,

wherein each of the textual lists includes as a recognition candidate at least one of the plurality of processing targets to be potentially processed by the corresponding one of the applications.

2. The display control device according to claim 1 , wherein

the processes performed by the processor further include

recognizing the spoken voice,

referencing a database in which the speech content acquired by recognizing the spoken voice, the first information, and the second information are associated, and

outputting the first information and the second information related to the speech content, and

the memory stores the database.

3. The display control device according to claim 1 , wherein

the processes performed by the processor further include

managing display region information representing a correspondence between the applications and the display regions to display the respective applications, and

identifying, based on the display region information, a display region to display the at least one application identified based on the first information.

4. The display control device according to claim 1 , wherein

the processes performed by the processor further include

providing identification symbols not overlapping one another to the respective processing targets, and

causing each of the plurality of processing targets to be displayed, along with each of the identification symbols, in the corresponding display region as a recognition candidate.

5. The display control device according to claim 4 , wherein

the processes performed by the processor further include

providing the identification symbols to the respective processing targets in accordance with a degree of priority determined in advance for each of the display regions to display the recognition candidate.

6. The display control device according to claim 1 , wherein

the processes performed by the processor further include

calculating acoustic reliabilities for the respective plurality of processing targets, each acoustic reliability representing a likelihood that the corresponding one of the plurality of processing targets was correctly recognized from the spoken voice; and

causing the one of the plurality of processing targets having the highest acoustic reliability to be displayed as an emphasized recognition candidate relative to the other recognition targets displayed in the textual lists.

7. A display control device to perform, on a display device having display regions in which a plurality of applications each are displayed, display control based on a speech content of a spoken voice, the display control device comprising:

a processor to execute a program; and

a memory to store the program which, when executed by the processor, causes the processor to perform processes of

acquiring first information and second information, the first information allowing identification of at least one application related to the speech content from among the plurality of applications, the second information allowing identification of at least one processing target in processing to be performed by the at least one application, the at least one processing target being related to the speech content, and

performing control to cause the display device to display, in one of the display regions to display one application identified based on the first information, processing targets in processing to be performed by the one application as recognition candidates, the processing targets being identified based on the second information, or to cause the display device to display, in two or more of the display regions to respectively display two or more applications identified based on the first information, at least one processing target in processing to be performed by each of the two or more applications as a recognition candidate, the at least one processing target being identified based on the second information, wherein

the processes performed by the processor further include

causing the at least one processing target to be displayed as the recognition candidate within an upper limit of the number of recognition candidates to be displayed determined in advance for each of the display regions.

8. A display control method of performing, on a display device having display regions in which a plurality of applications each are displayed, display control based on a speech content of a spoken voice, the display control method comprising:

acquiring first information and second information, the first information allowing identification of applications related to the speech content from among the plurality of applications, the second information allowing identification of a plurality of processing targets to be potentially processed by the at least one application, the plurality of processing targets being related to the speech content; and

performing control to cause the display device to simultaneously display, in different ones of the display regions each displaying a corresponding one of the applications identified based on the first information, respective textual lists of recognition candidates determined according to recognition of the spoken voice,

wherein each of the textual lists includes as a recognition candidate at least one of the plurality of processing targets to be potentially processed by the corresponding one of the applications.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: IWASAKI, TOMOHIRO
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 053407/0097 →
Continuity (1)
Related Publication 20210216275A1 · Jul 15, 2021
Cited By (1)
US 12,346,622