Electronic system and control method thereof
An electronic system and a control method thereof are provided. The electronic system includes a projection device and at least one peripheral device. The control method of the electronic system includes: sending an original instruction to a natural language model through the projection device, wherein the projection device has a communication interface and is communicatively connected to the at least one peripheral device through the communication interface; in response to the original instruction corresponding to an operation of the at least one peripheral device, generating at least one standard instruction according to the original instruction through the natural language model; and controlling the at least one peripheral device through the projection device to perform the operation corresponding to the original instruction according to the at least one standard instruction.
1 . A control method of an electronic system, wherein the electronic system comprises a projection device and at least one peripheral device, the control method comprising steps of:
obtaining at least one device description of the at least one peripheral device connected to a communication interface through the projection device, and transmitting the at least one device description to a cloud server, wherein a projector rule instruction is stored in the cloud server;
in response to receiving the at least one device description from the projection device, transmitting the at least one device description and the projector rule instruction to a natural language model through the cloud server; and
generating at least one peripheral device rule instruction based on the at least one device description and the projector rule instruction, and transmitting the at least one peripheral device rule instruction to the cloud server through the natural language model,
sending an original instruction to the natural language model through the projection device, wherein the projection device has the communication interface and is communicatively connected to the at least one peripheral device through the communication interface;
in response to receiving the original instruction from the projection device, transmitting the original instruction, the projector rule instruction, and the at least one peripheral device rule instruction to the natural language model through the cloud server;
in response to the original instruction corresponding to an operation of the projection device and the at least one peripheral device, generating at least one standard instruction based on the original instruction through the natural language model; and
controlling the projection device and the at least one peripheral device through the projection device to perform the operation corresponding to the original instruction according to the at least one standard instruction,
wherein the step of generating the at least one standard instruction based on the original instruction through the natural language model comprises:
generating the at least one standard instruction based on the original instruction, the projector rule instruction, and the at least one peripheral device rule instruction through the natural language model, wherein the projector rule instruction is configured to make the at least one standard instruction generated by the natural language model conform to operations executable by the projection device, and the at least one peripheral device rule instruction is configured to make the at least one standard instruction generated by the natural language model conform to operations executable by the at least one peripheral device.
2 . The control method of the electronic system as claimed in claim 1 , further comprising:
in response to the projection device detecting a change of the at least one peripheral device connected to the communication interface, obtaining at least one updated device description through the projection device and transmitting the at least one updated device description to the cloud server, so that the natural language model generates the corresponding at least one peripheral device rule instruction according to the at least one updated device description.
3 . The control method of the electronic system as claimed in claim 1 , wherein after the step of transmitting the at least one peripheral device rule instruction to the cloud server through the natural language model, the control method further comprises:
associating and storing the at least one peripheral device rule instruction with the projection device through the cloud server; or
associating and storing the at least one peripheral device rule instruction with a user account of the projection device through the cloud server.
4 . The control method of the electronic system as claimed in claim 1 , wherein the at least one peripheral device rule instruction comprises at least one of a product type of the at least one peripheral device and a description of the communication interface connected to the at least one peripheral device.
5 . The control method of the electronic system as claimed in claim 1 , further comprising:
in response to receiving a voice signal, converting the voice signal into the original instruction in a text form through the projection device; or
in response to receiving the voice signal, converting the voice signal into the original instruction in the text form through a terminal device paired to the projection device; or
in response to receiving the voice signal, transmitting the voice signal to a cloud server through the projection device or the terminal device, so that the cloud server converts the voice signal into the original instruction in the text form.
6 . The control method of the electronic system as claimed in claim 1 , further comprising:
in response to receiving a voice signal, transmitting the voice signal to the natural language model through the projection device, and using the voice signal as the original instruction.
7 . The control method of the electronic system as claimed in claim 1 , further comprising:
converting the at least one standard instruction into corresponding at least one control code to execute the at least one control code to control the at least one peripheral device through the projection device, wherein the at least one control code corresponds to the operation required by the original instruction; or
converting the at least one standard instruction into the corresponding at least one control code, and transmitting the at least one control code to the projection device through a cloud server, so that the projection device executes the at least one control code to control the at least one peripheral device.
8 . An electronic system, comprising:
at least one peripheral device;
a projection device, configured to receive an original instruction, the projection device comprising:
a communication interface, communicatively connected to the at least one peripheral device; and
a processor, coupled to the communication interface,
a cloud server, connected to the projection device through the communication interface, and
a natural language model, connected to the projection device through the communication interface, the natural language model is configured to generate at least one standard instruction based on the original instruction, a projector rule instruction, and at least one peripheral device rule instruction, wherein the projector rule instruction is configured to make the at least one standard instruction generated by the natural language model conform to operations executable by the projection device, and the at least one peripheral device rule instruction is configured to make the at least one standard instruction generated by the natural language model conform to operations executable by the at least one peripheral device,
wherein the processor is configured to obtain at least one device description of the at least one peripheral device connected to the communication interface through the communication interface,
the cloud server stores the projector rule instruction, and the cloud server is configured to transmit the at least one device description and the projector rule instruction to the natural language model in response to receiving the at least one device description from the projection device,
the natural language model is configured to generate the at least one peripheral device rule instruction based on the at least one device description and the projector rule instruction, and transmit the at least one peripheral device rule instruction to the cloud server, in response to receiving the at least one device description and the projector rule instruction, and
in response to the original instruction corresponding to an operation of the projection device and the at least one peripheral device, the processor is configured to receive the at least one standard instruction corresponding to the original instruction through the communication interface; and
control the projection device and the at least one peripheral device to perform the operation corresponding to the original instruction according to the at least one standard instruction.
9 . The electronic system as claimed in claim 8 , wherein the cloud server is configured to:
in response to receiving the original instruction from the projection device, transmit the original instruction, the projector rule instruction and the at least one peripheral device rule instruction to the natural language model;
the natural language model is configured to:
in response to receiving the original instruction, the projector rule instruction and the at least one peripheral device rule instruction, generate the at least one standard instruction based on the original instruction, the projector rule instruction and the at least one peripheral device rule instruction.
10 . The electronic system as claimed in claim 8 , wherein the processor is configured to:
in response to detecting a change of the at least one peripheral device connected to the communication interface, obtain at least one updated device description through the communication interface and transmit the at least one updated device description to the cloud server, so that the natural language model generates the corresponding at least one peripheral device rule instruction according to the at least one updated device description.
11 . The electronic system as claimed in claim 8 , wherein the cloud server is configured to:
associate and store the at least one peripheral device rule instruction with the projection device; or
associate and store the at least one peripheral device rule instruction with a user account of the projection device.
12 . The electronic system as claimed in claim 8 , wherein the at least one peripheral device rule instruction comprises at least one of a product type of the at least one peripheral device and a description of the communication interface connected to the at least one peripheral device.
13 . The electronic system as claimed in claim 8 , wherein the processor is configured to:
in response to receiving a voice signal, transmit the voice signal to the natural language model through the communication interface, and use the voice signal as the original instruction.
14 . The electronic system as claimed in claim 8 , wherein
the processor is configured to:
in response to receiving a voice signal, convert the voice signal into the original instruction in a text form; or
in response to receiving the voice signal, transmit the voice signal to a cloud server, so that the cloud server converts the voice signal into the original instruction in the text form; or
the electronic system further comprises a terminal device coupled to the projection device, and the terminal device is configured to:
in response to receiving the voice signal, convert the voice signal into the original instruction in a text form; or
in response to receiving the voice signal, transmit the voice signal to a cloud server, so that the cloud server converts the voice signal into the original instruction in the text form.
15 . The electronic system as claimed in claim 8 , wherein
the processor is configured to convert the at least one standard instruction into corresponding at least one control code to execute the at least one control code to control the at least one peripheral device, wherein the at least one control code corresponds to the operation required by the original instruction, or
the electronic system further comprises a cloud server, and the cloud server is configured to convert the at least one standard instruction into the corresponding at least one control code, and transmit the at least one control code to the projection device, so that the projection device executes the at least one control code to control the at least one peripheral device.