IP Library Granted Patent US 10,802,704
Granted Patent B2
US 10,802,704 · App. 15/566,582 · Granted Oct 13, 2020

Gesture control method, apparatus, terminal device, and storage medium

Inventor: Wei Wang (Shanghai, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
G06F3/04883G06F1/1694G06F3/0484G06F3/0346G06F2200/1636G06F2203/04808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,802,704
App. No.
15/566,582
Granted
Oct 13, 2020
Kind
B2
Abstract

A gesture control method, a gesture control apparatus and a terminal device to enrich interaction manners of the terminal device, where the method includes detecting a touch action performed on a touchscreen of a terminal device, obtaining a contact area of the touch action on the touchscreen and a z-axis acceleration generated when the touch action is in contact with the touchscreen, determining that the touch action is a joint touch action when the contact area is larger than a preset area and the z-axis acceleration is greater than a preset acceleration, identifying a gesture type corresponding to the joint touch action, and calling a preset function of the terminal device according to the gesture type.

Claims (106)

1. A method, comprising:

detecting a first touch action performed on a touchscreen of a terminal device;

obtaining a first contact area of the first touch action on the touchscreen by:

obtaining a quantity of pixels (m) of the first touch action in a contact region of the touchscreen, a total quantity of pixels (n) included in the touchscreen, and a total area (s) occupied by the touchscreen; and

obtaining the first contact area of the first touch action on the touchscreen by calculation using a formula s*(m/n);

obtaining, using a gravity acceleration sensor of the terminal device, a first z-axis acceleration generated in response to identifying that the first touch action is in contact with the touchscreen;

identifying that the first touch action is a first joint touch action in response to identifying that the first contact area is larger than a preset area and the first z-axis acceleration is greater than a preset acceleration;

identifying a first gesture type corresponding to the first joint touch action as a three-point single-tap gesture type;

calling a full-screen capture function of the terminal device in response to identifying that the first gesture type is the three-point single-tap gesture type;

detecting a second touch action performed on the touchscreen;

obtaining a second contact area of the second touch action on the touchscreen and a second z-axis acceleration generated in response to identifying that the second touch action is in contact with the touchscreen;

identifying that the second touch action is a second joint touch action in response to identifying that the second contact area is larger than the preset area and the second z-axis acceleration is greater than the preset acceleration;

identifying a second gesture type corresponding to the second joint touch action as an S-track gesture type; and

calling a photographing function of the terminal device in response to identifying that the second gesture type is the S-track gesture type.

2. The method of claim 1 , wherein prior to identifying the first gesture type, the method comprises

determining that a user interface on which the first joint touch action is performed is the user interface of an instant communications software and wherein the full-screen capture function is called based on the first gesture type being the three-point single-tap gesture type and the user interface being the user interface of the instant communications software.

3. The method of claim 1 , wherein identifying the first gesture type and calling the full-screen capture function comprises:

determining a user interface on which the first joint touch action is performed;

querying an application program associated with the three-point single-tap gesture type; and

starting the application program in response to identifying that the user interface on which the first joint touch action is performed is a system desktop of the terminal device.

4. The method of claim 1 , wherein before detecting the first touch action, the method further comprises:

customizing a mapping relationship between the full-screen capture function and the three-point single-tap gesture type; and

storing the mapping relationship in a mapping relationship database.

5. The method of claim 1 , further comprising:

determining a user interface on which the first joint touch action is performed;

querying an application program associated with the first gesture type; and

closing the application program in response to identifying that the user interface on which the first joint touch action is performed is a system desktop of the terminal device.

6. The method of claim 1 , further comprising:

determining a user interface on which the second joint touch action is performed; and

performing an operation on the user interface according to the second gesture type, wherein the operation comprises icon arrangement.

7. The method of claim 1 , further comprising:

determining a user interface on which the second joint touch action is performed; and

performing an operation on the user interface according to the second gesture type, wherein the operation comprises theme replacement.

8. The method of claim 1 , further comprising:

detecting a third touch action performed on the touchscreen;

obtaining a third contact area of the third touch action and a third z-axis acceleration generated when the third touch action is in contact with the touchscreen;

identifying that the third touch action is the second joint touch action in response to identifying that the third contact area is larger than the preset area and the third z-axis acceleration is greater than the preset acceleration;

identifying a third gesture type corresponding to a third touch action as a second-track gesture type; and

calling the photographing function of the terminal device in response to identifying that the third gesture type is the second-track gesture type.

9. A gesture-identification apparatus, comprising:

a gravity acceleration sensor;

a memory comprising program code; and

a processor coupled to the memory and the gravity acceleration sensor, wherein the processor is configured to execute the program code to cause the processor to be configured to:

detect a touch action performed on a touchscreen of a terminal device;

obtain a contact area of the touch action on the touchscreen, wherein the program code is configured to cause the processor to obtain the contact area by causing the processor to:

obtain a quantity of pixels (m) of the touch action in a contact region of the touchscreen, a total quantity of pixels (n) included in the touchscreen, and a total area (s) occupied by the touchscreen; and

obtain the contact area of the touch action on the touchscreen by calculation using a formula s*(m/n);

obtain, using the gravity acceleration sensor, a z-axis acceleration generated in response to identifying that the touch action is in contact with the touchscreen;

determine that the touch action is a joint touch action in response to identifying that the contact area is larger than a preset area and the z-axis acceleration is greater than a preset acceleration;

identify a gesture type corresponding to the joint touch action as a three-point single-tap gesture type;

call a full-screen capture function of the terminal device in response to identifying that the gesture type is the three-point single-tap gesture type;

detect a second touch action performed on the touchscreen;

obtain a second contact area of the touch action on the touchscreen and a second z-axis acceleration generated in response to identifying that the second touch action is in contact with the touchscreen;

identify that the second touch action is a second joint touch action in response to identifying that the second contact area is larger than the preset area and the second z-axis acceleration is greater than the preset acceleration;

identify a second gesture type corresponding to the second joint touch action as an M-type track gesture type; and

call a video recording function of the terminal device in response to identifying that the second gesture type is the M-type gesture type.

10. The gesture-identification apparatus of claim 9 , wherein in response to identifying the gesture type and calling the full-screen capture function, the program code further causes the processor to be configured to:

determine that a user interface on which the joint touch action is performed is the user interface of an instant communications software; and

call the full-screen capture function based on the gesture type being the three-point single-tap gesture type and the user interface being the user interface of the instant communications software.

11. The gesture-identification apparatus of claim 9 , wherein the program code further causes the processor to be configured to:

determine a user interface on which the joint touch action is performed;

query an application program associated with the three-point single-tap gesture type; and

start the application program in response to identifying that the user interface on which the joint touch action is performed is a system desktop of the terminal device.

12. The gesture-identification apparatus of claim 9 , wherein the program code further causes the processor to be configured to:

customize a mapping relationship between the full-screen capture function and the three-point single-tap gesture type; and

store the mapping relationship in a mapping relationship database.

13. The gesture-identification apparatus of claim 9 , wherein the program code further causes the processor to be configured to:

determine a user interface on which the joint touch action is performed;

query an application program associated with the gesture type; and

close the application program in response to identifying that the user interface on which the joint touch action is performed is a system desktop of the terminal device.

14. The gesture-identification apparatus of claim 9 , wherein the program code further causes the processor to be configured to:

determine a user interface on which the second joint touch action is performed; and

perform an operation on the user interface according to the second gesture type, wherein the operation comprises icon arrangement.

15. The gesture-identification apparatus of claim 9 , wherein the program code further causes the processor to be configured to:

determine a user interface on which the second joint touch action is performed; and

perform an operation on the user interface according to the second gesture type, wherein the operation comprises theme replacement.

16. The gesture-identification apparatus of claim 9 , wherein the program code further causes the processor to be configured to:

detect a third touch action performed on the touchscreen;

obtain a third contact area of the third touch action and a third z-axis acceleration generated in response to identifying that the third touch action is in contact with the touchscreen;

identify that the third touch action is the second joint touch action in response to identifying that the third contact area is larger than the preset area and the third z-axis acceleration is greater than the preset acceleration;

identify a third gesture type corresponding to the third touch action as a second-track gesture type; and

call a photographing function of the terminal device in response to identifying that the third gesture type is the second-track gesture type.

17. A non-transitory storage medium storing computer-executable instructions that, when executed by a computer, cause the computer to be configured to:

detect a touch action performed on a touchscreen of a terminal device;

obtain a contact area of the touch action on the touchscreen, wherein the computer-executable instructions are configured to cause the computer to obtain the contact area by causing the computer to:

obtain a quantity of pixels (m) of the touch action in a contact region of the touchscreen, a total quantity of pixels (n) included in the touchscreen, and a total area (s) occupied by the touchscreen; and

obtain the contact area of the touch action on the touchscreen by calculation using a formula s*(m/n);

obtain, using a gravity acceleration sensor, a z-axis acceleration generated in response to identifying that the touch action is in contact with the touchscreen;

determine that the touch action is a joint touch action in response to identifying that the contact area is larger than a preset area and the z-axis acceleration is greater than a preset acceleration;

identify a gesture type corresponding to the joint touch action as a three-point single-tap gesture type;

call a full-screen capture function of the terminal device in response to identifying that the gesture type is the three-point single-tap gesture type;

detect a second touch action performed on the touchscreen;

obtain a second contact area of the touch action on the touchscreen and a second z-axis acceleration generated in response to identifying that the second touch action is in contact with the touchscreen;

identify that the second touch action is a second joint touch action in response to identifying that the second contact area is larger than the preset area and the second z-axis acceleration is greater than the preset acceleration;

identify a second gesture type corresponding to the second joint touch action as an S-track gesture type; and

call a photographing function of the terminal device in response to identifying that the second gesture type is the S-track gesture type.

18. The non-transitory storage medium of claim 17 , wherein the computer-executable instructions further cause the computer to be configured to:

determine a user interface on which the joint touch action is performed;

query an application program associated with the gesture type; and

close the application program in response to identifying that the user interface on which the joint touch action is performed as a system desktop of the terminal device.

19. The non-transitory storage medium of claim 17 , wherein the computer-executable instructions further cause the computer to be configured to:

determine a user interface on which the second joint touch action is performed;

and perform an operation on the user interface according to the second gesture type, wherein the operation comprises icon arrangement.

20. The non-transitory storage medium of claim 17 , wherein the computer-executable instructions further cause the computer to be configured to:

determine a user interface on which the second joint touch action is performed; and

perform an operation on the user interface according to the second gesture type, wherein the operation comprises theme replacement.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: HUAWEI TECHNOLOGIES CO., LTD.
To: HONOR DEVICE CO., LTD.
Reel/Frame 055919/0344 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2018
From: WANG, WEI
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 044801/0537 →
Cited By (1)
US 12,645,302