Method and system for identification of user maneuver intention when operating with touch surface controller
A human-machine interface device includes a touch receiver having a plurality of touch surfaces in distinctly different planes, an elastic strain sensing element having a base and a plurality of legs extending from the base and contacting an associated touch surface, a first linear strain gauge mounted on each leg to detect strain along a first direction and a second strain gauge mounted on each leg to detect strain along a second direction that is different from the first direction, and a processor configured to receive the signals from the strain gauges and determines a command operation intended by a user of the human-machine interface device.
1. A human-machine interface device, comprising:
a touch receiver having a plurality of touch surfaces, each touch surface arranged in a distinctly different plane from the other touch surfaces;
an elastic strain sensing element having a base and a plurality of legs extending from the base, each leg in contact with or attached to an associated overlying touch surface such that pressure applied to a touch surface causes strain in an associated leg;
a first linear strain gauge mounted on each leg to detect strain along a first direction and a second linear strain gauge mounted on each leg to detect strain along a second direction that is different from the first direction; and
a processor that is configured to receive a signal from each of the first linear strain gauge and the second linear strain gauge and determine a command intended by a user operation (maneuver) of the human-machine interface device.
2. The human-machine interface device of claim 1 , wherein the first direction and the second direction are approximately perpendicular.
3. The human-machine interface device of claim 1 , wherein each of the plurality of touch surfaces is arranged vertically.
4. The human-machine interface device of claim 1 , wherein the plurality of touch surfaces are arranged in approximately parallel pairs.
5. The human-machine interface device of claim 1 , wherein the plurality of touch surfaces include two pairs of approximately parallel touch surfaces.
6. The human-machine interface device of claim 1 , wherein the first linear strain gauge of each leg is mounted to detect strain in an approximately vertical direction and the second linear strain gauge of each leg is mounted to detect strain in an approximately horizontal direction.
7. The human-machine interface device of claim 6 , wherein the processor is configured to calculate a vector magnitude of strain on each leg, the vector magnitude being equal to a square root of a sum of squares of a vertical strain signal strength and a horizontal strain signal strength.
8. The human-machine interface device of claim 7 , wherein the processor is configured to calculate a vector direction of strain on each leg, the vector direction being equal to an arctangent of a quotient of a vertical strain signal strength divided by a horizontal strain signal strength.
9. The human-machine interface device of claim 8 , wherein the calculated vector magnitude and the calculated vector direction on each leg are grouped as strain signal patterns represented by a data set.
10. The human-machine interface device of claim 9 , wherein the data set is collected by the processor to create a data source of the strain signal patterns for each of a plurality of user operations (maneuvers) of the human-machine interface device.
11. The human-machine interface device of claim 10 , wherein the data source is used to train a neural network.
12. The human-machine interface device of claim 11 , wherein the trained neural network is utilized to identify the intended user command of the operation (maneuver) of the human-machine interface device, wherein the identified user command intention is an inference output of the trained neural network with an input of the strain signal patterns generated by the user operation (maneuver).
13. The human-machine interface device of claim 12 , wherein user operations (maneuvers) include pressing down at any location, pulling up at any location, pushing a side to left, pushing a side to right, pushing forward, pushing backward, turning clockwise, turning counterclockwise, pitching upward, pitching downward, rolling left, rolling right, and pinching.