Granted Patent B2

US 12,592,235 · App. 18/278,975 · Granted Mar 31, 2026

Inventors: Daniel Krüger (Roth, DE); Florian Kubo (Fuchsstadt, DE); Martina Schubert (Altdorf, DE)

Assignee: Siemens Aktiengesellschaft

G10L15/22G06F40/30G10L15/26G10L2015/223

Abstract

Claims (25)

1 . A voice control system of a user interface of an asset of an automation system, the voice control system comprising:

a natural language understanding (NLU) component comprising an NLU configuration; and

an NLU configuration generator that automatically generates the NLU configuration based on engineering data that is related to the asset of the automation system and that is taken from an automation or engineering project, wherein the engineering data comprises data related to a structure and/or functional structure and/or user interfaces of the asset and wherein the NLU configuration generator is configured to generate annotated examples and descriptions of the data related to the structure and/or functional structure and/or user interfaces of the asset when generating the NLU configuration from the engineering data, wherein the annotated examples comprise sentences, wherein intents, entities and entity roles are identified in the sentences, and the descriptions comprise value ranges and/or RegEx.

2 . The voice control system of claim 1 , wherein the NLU component is configured to receive text input corresponding to a user utterance and, based on the received text input and with the NLU configuration, the NLU component is further configured to generate a semantic representation of the received text input, and based on the semantic representation of the received text input at least one machine-recognizable/-readable command for the asset is generated.

3 . The voice control system of claim 1 , wherein each intent is implemented as an atomic function or as a chain of steps.

4 . The voice control system of claim 1 , wherein an entity role is assigned to each entity.

5 . The voice control system of claim 1 , wherein the NLU configuration comprises at least one profile in which effective areas are restricted and/or are data regarding access rights.

6 . The voice control system of claim 1 , wherein the NLU configuration generator is further configured to use historical data when generating the NLU configuration.

7 . The voice control system of claim 6 , wherein the historical data is control data.

8 . A user interface of an asset for an automation system comprising a voice control system as set forth in claim 1 .

9 . A computer-implemented method for configuring an NLU component of a voice control system of an asset of an automation system, the computer implemented method comprising:

automatically generating an NLU configuration of the NLU component based on engineering data relating to the asset and taken from an automation or engineering project, with the engineering data comprising data related to a structure and/or functional structure and/or user interfaces of the asset;

configuring the generated NLU configuration to generate annotated examples and descriptions of the data related to the structure and/or functional structure and/or user interfaces of the asset when generating the NLU configuration from the engineering data, wherein the annotated examples comprise sentences; and

identifying Intents, entities and entity roles in the sentences and the descriptions comprise value ranges and/or RegEx.

10 . The computer-implemented method of claim 9 , further comprising generating the NLU configuration for the NLU component during engineering of the asset in the engineering project and/or based on the engineering data taken from an existing/completed automation project.

11 . A method for voice-assisted control of an asset of an automation system, the method comprising:

automatically generating an NLU configuration of an NLU component of a voice control program based on engineering data relating to the asset and taken from an automation or engineering project, with the engineering data comprising data related to a structure and/or functional structure and/or user interfaces of the asset;

configuring the generated NLU configuration to generate annotated examples and descriptions of the data related to the structure and/or functional structure and/or user interfaces of the asset when generating the NLU configuration from the engineering data, wherein the annotated examples comprise sentences;

identifying intents, entities and entity roles in the sentences, and the descriptions comprise value ranges and/or RegEx;

receiving an audio input generated by a user of the asset of the automation system with the voice control program;

generating text from the audio input with an automatic speech recognition component of the voice control program;

generating a corresponding semantic representation from the text with the NLU component of the voice control program;

generating a machine-readable query to the asset of the automation system from the semantic representation of the text with a dialog manager component of the voice control program;

forwarding the machine-readable query as a functional query to the asset of the automation system by the dialog manager of the voice control program; and

controlling the asset of the automation system according to the functional query.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (16)