Gesture instruction execution method and apparatus, system, and storage medium
View Patent ↗This application provides a gesture instruction execution method, apparatus, and system, and a storage medium. One example method includes obtaining a plurality of gesture instructions acting on different areas of a target screen; obtaining an operation area on the target screen corresponding to each of the obtained plurality of gesture instructions; determining, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction; and controlling, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction.
1 . A gesture instruction execution method, wherein the method comprises:
obtaining a plurality of gesture instructions acting on different areas of a target screen, wherein the obtaining a plurality of gesture instructions acting on different areas of a target screen comprises obtaining the plurality of gesture instructions that act on the different areas of the target screen at the same time;
obtaining an operation area on the target screen corresponding to each of the obtained plurality of gesture instructions;
determining, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction, wherein each gesture instruction corresponds to a different target application;
controlling, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction, wherein controlling the target application corresponding to each gesture instruction comprises displaying a plurality of windows according of the plurality of gesture instructions on the target screen, wherein each of the plurality of windows corresponds to a respective target application of the each gesture instruction, wherein the target screen is a central control screen of a control domain cockpit, and wherein the different areas of the target screen comprise a first area on a driver side of the central control screen and a second area on a front passenger side of the central control screen, and wherein a first window for a first application is displayed on the second area on the front passenger side with a larger preconfigured window size than a second window for a second application that is displayed on the first area on the driver side, and wherein a received driver side gesture instruction controls a change of display of the second application in the first area but not on the second area, wherein a received passenger side gesture instruction controls a change of display of the first application in the second area but not on the first area;
storing window ranges of the plurality of applications in an open state in a stack, wherein a screen range to which each application of the plurality of applications belongs comprises a window range of the respective application in the open state; and
performing stack management on the window range of each of the plurality of applications in the open state by using the stack, wherein performing stack management comprises:
moving a window object of the second application to a free multi-window stack in a multi-window stack manager;
assigning a value to the window object of the second application in the free multi-window stack; and
updating a window range in the window object of the second application to a preconfigured window range, wherein the window range comprises a window size and a window location.
2 . The method according to claim 1 , wherein a screen range to which each application of the plurality of applications belongs comprises at least one of a range covered by an icon of the application or a window range of the application in an open state.
3 . The method according to claim 1 , wherein the determining, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction comprises:
determining, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and the screen ranges to which the plurality of applications on the target screen belong, target applications respectively corresponding to the plurality of gesture instructions.
4 . The method according to claim 1 , wherein the controlling, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction comprises:
controlling, at the same time based on the instruction content of each gesture instruction, target applications respectively corresponding to the plurality of gesture instructions.
5 . The method according to claim 1 , wherein the gesture instruction comprises a touch gesture instruction.
6 . The method according to claim 1 , wherein the window range of the application in the open state is a preconfigured window range.
7 . The method according to claim 1 , wherein the window range of the application in the open state is a window range to which each application belongs when the application exits last time.
8 . A gesture instruction execution apparatus, wherein the apparatus comprises:
at least one processor; and
one or more memories coupled to the at least one processor and storing programming instructions for execution by the at least one processor to cause the apparatus to:
obtain a plurality of gesture instructions that act on different areas of a target screen, wherein the obtain a plurality of gesture instructions acting on different areas of a target screen comprises obtain the plurality of gesture instructions that act on the different areas of the target screen at the same time;
obtain an operation area on the target screen that corresponds to each of the plurality of gesture instructions; and
determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction, wherein each gesture instruction corresponds to a different target application;
control, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction, wherein the control the target application corresponding to each gesture instruction comprises display a plurality of windows according of the plurality of gesture instructions on the target screen, wherein each of the plurality of windows corresponds to a respective target application of the each gesture instruction, wherein the target screen is a central control screen of a control domain cockpit, and wherein the different areas of the target screen comprise a first area on a driver side of the central control screen and a second area on a front passenger side of the central control screen, and wherein a first window for a first application is displayed on the second area on the front passenger side with a larger preconfigured window size than a second window for a second application that is displayed on the first area on the driver side, and wherein a received driver side gesture instruction controls a change of display of the second application in the first area but not on the second area, wherein a received passenger side gesture instruction controls a change of display of the first application in the second area but not on the first area;
store window ranges of the plurality of applications in an open state in a stack, wherein a screen range to which each application of the plurality of applications belongs comprises a window range of the respective application in the open state; and
perform stack management on the window range of each of the plurality of applications in the open state by using the stack, wherein perform stack management comprises:
move a window object of the second application to a free multi-window stack in a multi-window stack manager;
assign a value to the window object of the second application in the free multi-window stack; and
update a window range in the window object of the second application to a preconfigured window range, wherein the window range comprises a window size and a window location.
9 . The apparatus according to claim 8 , wherein the programming instructions, when executed by the at least one processor, cause the apparatus to determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and the screen ranges to which the plurality of applications on the target screen belong, target applications respectively corresponding to the plurality of gesture instructions.
10 . The apparatus according to claim 8 , wherein the programming instructions, when executed by the at least one processor, cause the apparatus to control, at the same time based on the instruction content of each gesture instruction, target applications respectively corresponding to the plurality of gesture instructions.
11 . The apparatus according to claim 8 , wherein the gesture instruction comprises a touch gesture instruction.
12 . A gesture control system, wherein the gesture control system comprises at least one processor and a target screen, and the at least one processor is configured to execute instructions to cause the gesture control system to:
obtain a plurality of gesture instructions acting on different areas of a target screen, wherein the obtain a plurality of gesture instructions acting on different areas of a target screen comprises obtain the plurality of gesture instructions that act on the different areas of the target screen at the same time;
obtain an operation area on the target screen corresponding to each of the obtained plurality of gesture instructions;
determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction, wherein each gesture instruction corresponds to a different target application;
control, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction, wherein the control the target application corresponding to each gesture instruction comprises display a plurality of windows according of the plurality of gesture instructions on the target screen, wherein each of the plurality of windows corresponds to a respective target application of the each gesture instruction, wherein the target screen is a central control screen of a control domain cockpit, and wherein the different areas of the target screen comprise a first area on a driver side of the central control screen and a second area on a front passenger side of the central control screen, and wherein a first window for a first application is displayed on the second area on the front passenger side with a larger preconfigured window size than a second window for a second application that is displayed on the first area on the driver side, and wherein a received driver side gesture instruction controls a change of display of the second application in the first area but not on the second area, wherein a received passenger side gesture instruction controls a change of display of the first application in the second area but not on the first area;
store window ranges of the plurality of applications in an open state in a stack, wherein a screen range to which each application of the plurality of applications belongs comprises a window range of the respective application in the open state; and
perform stack management on the window range of each of the plurality of applications in the open state by using the stack, wherein perform stack management comprises:
move a window object of the second application to a free multi-window stack in a multi-window stack manager;
assign a value to the window object of the second application in the free multi-window stack; and
update a window range in the window object of the second application to a preconfigured window range, wherein the window range comprises a window size and a window location.
13 . The gesture control system according to claim 12 , wherein the determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction comprises:
determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and the screen ranges to which the plurality of applications on the target screen belong, target applications respectively corresponding to the plurality of gesture instructions.
14 . The gesture control system according to claim 12 , wherein the control, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction comprises:
control, at the same time based on the instruction content of each gesture instruction, target applications respectively corresponding to the plurality of gesture instructions.
15 . The gesture control system according to claim 12 , wherein the gesture instruction comprises a touch gesture instruction.
16 . A non-transitory computer-readable storage medium, wherein the storage medium stores at least one instruction, that when executed by at least one processor, causes a computer to:
obtain a plurality of gesture instructions acting on different areas of a target screen, wherein the obtain a plurality of gesture instructions acting on different areas of a target screen comprises obtain the plurality of gesture instructions that act on the different areas of the target screen at the same time;
obtain an operation area on the target screen corresponding to each of the obtained plurality of gesture instructions, wherein each gesture instruction corresponds to a different target application;
determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction;
control, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction, wherein the control the target application corresponding to each gesture instruction comprises display a plurality of windows according of the plurality of gesture instructions on the target screen, wherein each of the plurality of windows corresponds to a respective target application of the each gesture instruction, wherein the target screen is a central control screen of a control domain cockpit, and wherein the different areas of the target screen comprise a first area on a driver side of the central control screen and a second area on a front passenger side of the central control screen, and wherein a first window for a first application is displayed on the second area on the front passenger side with a larger preconfigured window size than a second window for a second application that is displayed on the first area on the driver side, and wherein a received driver side gesture instruction controls a change of display of the second application in the first area but not on the second area, wherein a received passenger side gesture instruction controls a change of display of the first application in the second area but not on the first area;
store window ranges of the plurality of applications in an open state in a stack, wherein a screen range to which each application of the plurality of applications belongs comprises a window range of the respective application in the open state; and
perform stack management on the window range of each of the plurality of applications in the open state by using the stack, wherein perform stack management comprises:
move a window object of the second application to a free multi-window stack in a multi-window stack manager;
assign a value to the window object of the second application in the free multi-window stack; and
update a window range in the window object of the second application to a preconfigured window range, wherein the window range comprises a window size and a window location.
17 . The non-transitory computer-readable storage medium according to claim 16 , wherein a screen range to which each application of the plurality of applications belongs comprises at least one of a range covered by an icon of the application or a window range of the application in an open state.
18 . The non-transitory computer-readable storage medium according to claim 16 , wherein the determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and screen ranges to which a plurality of applications on the target screen belong, a target application corresponding to each gesture instruction comprises:
determine, based on the operation area on the target screen corresponding to each of the plurality of gesture instructions and the screen ranges to which the plurality of applications on the target screen belong, target applications respectively corresponding to the plurality of gesture instructions.
19 . The non-transitory computer-readable storage medium according to claim 16 , wherein the control, based on instruction content of each gesture instruction, the target application corresponding to each gesture instruction comprises:
control, at the same time based on the instruction content of each gesture instruction, target applications respectively corresponding to the plurality of gesture instructions.
20 . The non-transitory computer-readable storage medium according to claim 16 , wherein the gesture instruction comprises a touch gesture instruction.