Gesture recognition method, apparatus and system based on coupling capacitance
A gesture recognition method, apparatus and system based on coupling capacitance, which are configured to solve the technical problem in the prior art of it not being possible to recognize a complex gesture due to the fact that the coordinates of a manipulation body on a three-dimensional plane cannot be determined. The method comprises: establishing a spatial rectangular coordinate system by taking a first position point of a contact face of a capacitive touch screen as an origin; acquiring an X-axis coordinate and a Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to a first sensor; acquiring the difference between a first coupling capacitance value and a second coupling capacitance value, and determining a Z-axis coordinate of at least one manipulation body in the spatial rectangular coordinate system according to the difference; and generating a movement trajectory of the at least one manipulation body according to a change in spatial coordinates of the at least one manipulation body in the spatial rectangular coordinate system, and identifying the movement trajectory to obtain a gesture recognition result.
1. A method of gesture recognition based on coupling capacitance, comprising:
establishing a spatial rectangular coordinate system by taking a first point of a contact surface of a capacitive touch screen as an origin, a Z axis of the spatial rectangular coordinate system being perpendicular to the contact surface;
acquiring an X-axis coordinate and a Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to a first sensor electrode, wherein the first sensor electrode is a sensor electrode of the capacitive touch screen that forms the coupling capacitance along with at least one operating body and has a greatest capacitance change signal increase;
acquiring a difference between first coupling capacitance and second coupling capacitance, and determining a Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to the difference, wherein the first coupling capacitance is coupling capacitance formed between the first sensor electrode and a thin film transistor (TFT) power signal control line of the capacitive touch screen when the Z-axis coordinate corresponding to the at least one operating body is beyond a preset interval, and the second coupling capacitance is coupling capacitance formed between the first sensor electrode and the TFT power signal control line when the Z-axis coordinate corresponding to the at least one operating body is within the preset interval;
generating a movement trajectory of the at least one operating body according to changes in spatial coordinates of the at least one operating body in the spatial rectangular coordinate system, wherein the spatial coordinates comprise the X-axis coordinate, the Y-axis coordinate and the Z-axis coordinate; and
obtaining a gesture recognition result by recognizing the movement trajectory;
wherein the acquiring the X-axis coordinate and the Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to the first sensor electrode comprises:
acquiring an output pin index of an integrated circuit of the capacitive touch screen corresponding to the first sensor electrode, and determining the output pin index as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system.
2. The method according to claim 1 , wherein the determining the output pin index as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system comprises:
prestoring a correspondence between output pin indexes and coordinates in the spatial rectangular coordinate system; and
determining an X-axis coordinate and a Y-axis coordinate corresponding to a current output pin index in the spatial rectangular coordinate system according to the correspondence as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system.
3. The method according to claim 1 , wherein the acquiring the difference between the first coupling capacitance and the second coupling capacitance comprises:
acquiring capacitance input to the first sensor electrode by a charging module of an integrated circuit of the capacitive touch screen, where the charging module is configured to input capacitance to a sensor electrode of which a capacitance change signal is increased in the capacitive touch screen; and
determining the capacitance input to the first sensor electrode as the difference between the first coupling capacitance and the second coupling capacitance.
4. The method according to claim 3 , wherein the determining the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to the difference comprises:
determining the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to a first formula and the difference;
the first formula being:
d
=
ε
S
4
π
k
C
f
wherein d represents the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system, Cƒ represents the difference, ε represents a relative dielectric constant, S represents an effective overlapping area between the at least one operating body and the first sensor electrode, and k represents an electrostatic force constant.
5. The method according to claim 1 , wherein the generating the movement trajectory of the at least one operating body according to the changes in spatial coordinates of the at least one operating body in the spatial rectangular coordinate system comprises:
determining whether a Z-axis coordinate of any spatial coordinates of the at least one operating body in the spatial rectangular coordinate system is within the preset interval;
determining that the any spatial coordinates are valid spatial coordinates in response to the Z-axis coordinate of the any spatial coordinates of the at least one operating body in the spatial rectangular coordinate system being within the preset interval; and
generating the movement trajectory of the at least one operating body according to changes in the valid spatial coordinates.
6. The method according to claim 1 , wherein the establishing the spatial rectangular coordinate system by taking the first point of the contact surface of the capacitive touch screen as the origin, the Z axis of the spatial rectangular coordinate system being perpendicular to the contact surface comprises:
establishing the spatial rectangular coordinate system by taking a center point of the contact surface of the capacitive touch screen as the origin, the Z axis of the spatial rectangular coordinate system being perpendicular to the contact surface.
7. An electronic device of gesture recognition based on coupling capacitance, comprising:
a memory configured to store a program instruction; and
a processor configured to call the program instruction stored in the memory to execute steps of a method comprising:
establishing a spatial rectangular coordinate system by taking a first point of a contact surface of a capacitive touch screen as an origin, a Z axis of the spatial rectangular coordinate system being perpendicular to the contact surface;
acquiring an X-axis coordinate and a Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to a first sensor electrode, wherein the first sensor electrode is a sensor electrode of the capacitive touch screen that forms the coupling capacitance along with at least one operating body and has a greatest capacitance change signal increase;
acquiring a difference between first coupling capacitance and second coupling capacitance, and determining a Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to the difference, wherein the first coupling capacitance is coupling capacitance formed between the first sensor electrode and a thin film transistor (TFT) power signal control line of the capacitive touch screen when the Z-axis coordinate corresponding to the at least one operating body is beyond a preset interval, and the second coupling capacitance is coupling capacitance formed between the first sensor electrode and the TFT power signal control line when the Z-axis coordinate corresponding to the at least one operating body is within the preset interval;
generating a movement trajectory of the at least one operating body according to changes in spatial coordinates of the at least one operating body in the spatial rectangular coordinate system, wherein the spatial coordinates comprise the X-axis coordinate, the Y-axis coordinate and the Z-axis coordinate; and
obtaining a gesture recognition result by recognizing the movement trajectory;
wherein the acquiring the X-axis coordinate and the Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to the first sensor electrode comprises:
acquiring an output pin index of an integrated circuit of the capacitive touch screen corresponding to the first sensor electrode, and determining the output pin index as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system.
8. The electronic device according to claim 7 , wherein the determining the output pin index as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system comprises:
prestoring a correspondence between output pin indexes and coordinates in the spatial rectangular coordinate system; and
determining an X-axis coordinate and a Y-axis coordinate corresponding to a current output pin index in the spatial rectangular coordinate system according to the correspondence as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system.
9. The electronic device according to claim 7 , wherein the acquiring the difference between the first coupling capacitance and the second coupling capacitance comprises:
acquiring capacitance input to the first sensor electrode by a charging module of an integrated circuit of the capacitive touch screen, where the charging module is configured to input capacitance to a sensor electrode of which a capacitance change signal is increased in the capacitive touch screen; and
determining the capacitance input to the first sensor electrode as the difference between the first coupling capacitance and the second coupling capacitance.
10. The electronic device according to claim 9 , wherein the determining the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to the difference comprises:
determining the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to a first formula and the difference;
the first formula being:
d
=
ε
S
4
π
k
C
f
wherein d represents the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system, C f represents the difference, ε represents a relative dielectric constant, S represents an effective overlapping area between the at least one operating body and the first sensor electrode, and k represents an electrostatic force constant.
11. The electronic device according to claim 7 , wherein the generating the movement trajectory of the at least one operating body according to the changes in spatial coordinates of the at least one operating body in the spatial rectangular coordinate system comprises:
determining whether a Z-axis coordinate of any spatial coordinates of the at least one operating body in the spatial rectangular coordinate system is within the preset interval;
determining that the any spatial coordinates are valid spatial coordinates in response to the Z-axis coordinate of the any spatial coordinates of the at least one operating body in the spatial rectangular coordinate system being within the preset interval; and
generating the movement trajectory of the at least one operating body according to changes in the valid spatial coordinates.
12. The electronic device according to claim 7 , wherein the establishing the spatial rectangular coordinate system by taking the first point of the contact surface of the capacitive touch screen as the origin, the Z axis of the spatial rectangular coordinate system being perpendicular to the contact surface comprises:
establishing the spatial rectangular coordinate system by taking a center point of the contact surface of the capacitive touch screen as the origin, the Z axis of the spatial rectangular coordinate system being perpendicular to the contact surface.
13. A non-transitory storage medium, storing a computer-executable instruction, wherein the computer-executable instruction is configured to cause a computer to execute steps of a method comprising:
establishing a spatial rectangular coordinate system by taking a first point of a contact surface of a capacitive touch screen as an origin, a Z axis of the spatial rectangular coordinate system being perpendicular to the contact surface;
acquiring an X-axis coordinate and a Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to a first sensor electrode, wherein the first sensor electrode is a sensor electrode of the capacitive touch screen that forms the coupling capacitance along with at least one operating body and has a greatest capacitance change signal increase;
acquiring a difference between first coupling capacitance and second coupling capacitance, and determining a Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to the difference, wherein the first coupling capacitance is coupling capacitance formed between the first sensor electrode and a thin film transistor (TFT) power signal control line of the capacitive touch screen when the Z-axis coordinate corresponding to the at least one operating body is beyond a preset interval, and the second coupling capacitance is coupling capacitance formed between the first sensor electrode and the TFT power signal control line when the Z-axis coordinate corresponding to the at least one operating body is within the preset interval;
generating a movement trajectory of the at least one operating body according to changes in spatial coordinates of the at least one operating body in the spatial rectangular coordinate system, wherein the spatial coordinates comprise the X-axis coordinate, the Y-axis coordinate and the Z-axis coordinate; and
obtaining a gesture recognition result by recognizing the movement trajectory;
wherein the acquiring the X-axis coordinate and the Y-axis coordinate, in the spatial rectangular coordinate system, corresponding to the first sensor electrode comprises:
acquiring an output pin index of an integrated circuit of the capacitive touch screen corresponding to the first sensor electrode, and determining the output pin index as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system.
14. The non-transitory storage medium according to claim 13 , wherein the determining the output pin index as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system comprises:
prestoring a correspondence between output pin indexes and coordinates in the spatial rectangular coordinate system; and
determining an X-axis coordinate and a Y-axis coordinate corresponding to a current output pin index in the spatial rectangular coordinate system according to the correspondence as the X-axis coordinate and the Y-axis coordinate of the at least one operating body in the spatial rectangular coordinate system.
15. The non-transitory storage medium according to claim 13 , wherein the acquiring the difference between the first coupling capacitance and the second coupling capacitance comprises:
acquiring capacitance input to the first sensor electrode by a charging module of an integrated circuit of the capacitive touch screen, where the charging module is configured to input capacitance to a sensor electrode of which a capacitance change signal is increased in the capacitive touch screen; and
determining the capacitance input to the first sensor electrode as the difference between the first coupling capacitance and the second coupling capacitance.
16. The non-transitory storage medium according to claim 15 , wherein the determining the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to the difference comprises:
determining the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system according to a first formula and the difference;
the first formula being:
d
=
ε
S
4
π
k
C
f
wherein d represents the Z-axis coordinate of the at least one operating body in the spatial rectangular coordinate system, C f represents the difference, ε represents a relative dielectric constant, S represents an effective overlapping area between the at least one operating body and the first sensor electrode, and k represents an electrostatic force constant.