Turbulence resistant touch system
Aspects herein describe a display system that moves at least a portion of a displayed GUI in response to turbulent motions in a vehicle. In one aspect, the GUI is displayed on a screen that includes an integrated touch sensing region that permits a user to interact with one or more elements in the GUI. However, turbulent motion may cause the user to miss the interactive element or inadvertently touch the wrong element in the GUI. To aid the user to touch the desired portion of the GUI, in one aspect, the display system tracks the movement of a hand or finger of the user to determine its position relative to a screen displaying the GUI and maintains the spatial relationship of the hand or the finger to the GUI during turbulent motions.
1. A method comprising:
displaying a graphical user interface (GUI) on a touch screen mounted in a vehicle;
detecting a turbulent event affecting the touch screen and a user in the vehicle;
tracking movement of a body part of the user before the turbulent event to identify a spatial relationship between the body part and an interactive element having a predefined location within the GUI displayed on the touch screen, wherein the location of the interactive element can be changed only after detecting the turbulent event;
identifying a change in location of the body part relative to the interactive element during the turbulent event;
determining, before the body part contacts the touch screen, whether the change in location of the body part was one of an intended motion made by the user during the turbulent event and an unintended motion caused by the turbulent event; and
moving, in response to determining that the change in location of the body part was due to the unintended motion and before the body part contacts the touch screen, the location of the interactive element within the touch screen to maintain the spatial relationship between the body part and the interactive element before the turbulent event.
2. The method of claim 1 , wherein the body part of the user does not contact the touch screen when identifying the spatial relationship and when moving the position of the GUI.
3. The method of claim 1 , wherein identifying the spatial relationship comprises:
tracking the body part of the user to identify the location of the body part relative to the interactive element before the user contacts the touch screen.
4. The method of claim 3 , wherein tracking the body part of the user comprises:
receiving sensor data from a wearable device on the body part of the user, wherein the sensor data is processed to identify the change in the location of the body part relative to the interactive element.
5. The method of claim 1 , further comprising:
determining whether the body part is within a threshold distance from the touch screen, wherein the location of the body part is tracked both when the body part is within the threshold distance and outside the threshold distance, wherein the position of the interactive element is moved to maintain the spatial relationship only when the body part is within the threshold distance.
6. The method of claim 1 , wherein the position of the interactive element is moved to maintain the spatial relationship only when the change in location of the body part was caused by the turbulent event.
7. The method of claim 1 , wherein moving the position of the interactive element to maintain the spatial relationship comprises:
shifting an entire portion of the GUI displayed within the touch screen to mirror movements of the body part of the user relative to the touch screen; and
back filling a portion of the touch screen that was previously occupied by the GUI.
8. The method of claim 1 , further comprising:
identifying a second change in location of the body part relative to the interactive element during a second turbulent event;
determining that the second change in location of the body part was an intended motion made by the user during the turbulent event; and
maintaining a position of the interactive element at a previous location before the second turbulent event.
9. A display system, comprising:
a touch screen configured to be mounted in a vehicle and to display a GUI; and
a turbulence detector configured to:
detect a turbulent event affecting the touch screen and a user in the vehicle;
track movement of a body part of the user before the turbulent event to identify a spatial relationship between the body part and an interactive element having a predefined location within the GUI displayed on the touch screen, wherein the location of the interactive element can be changed only after detecting the turbulent event;
identify a change in location of the body part relative to the interactive element during the turbulent event;
determine, before the body part contacts the touch screen, whether the change in location of the body part was one of an intended motion made by the user during the turbulent event and an unintended motion caused by the turbulent event; and
move, in response to determining that the change in location of the body part was due to the unintended motion and before the body part contacts the touch screen, the location of the interactive element within the touch screen to maintain the spatial relationship between the body part and the interactive element before the turbulent event.
10. The display system of claim 9 , wherein the body part of the user does not contact the touch screen when identifying the spatial relationship and when moving the position of the GUI.
11. The display system of claim 9 , wherein the turbulence detector is configured to:
track the body part of the user to identify the location of the body part relative to the interactive element before the user contacts the touch screen.
12. The display system of claim 11 , wherein the turbulence detector is configured to:
receive sensor data from a wearable device on the body part of the user to identify the change in the location of the body part relative to the interactive element.
13. The display system of claim 9 , wherein the turbulence detector is configured to:
determine whether the body part is within a threshold distance from the touch screen, wherein the position of the interactive element is moved to maintain the spatial relationship only when the body part is within the threshold distance.
14. The display system of claim 9 , wherein the position of the interactive element is moved to maintain the spatial relationship only when the change in location of the body part was caused by the turbulent event.
15. The display system of claim 9 , wherein the turbulence detector is configured to:
shift an entire portion of the GUI displayed within the touch screen to mirror movements of the body part of the user relative to the touch screen; and
back fill a portion of the display that was previously occupied by the GUI.
16. A computer readable storage medium comprising:
computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to:
display a GUI on a touch screen mounted in a vehicle;
detect a turbulent event affecting the touch screen and a user in the vehicle;
track movement of a body part of the user before the turbulent event of the vehicle to identify a spatial relationship between the body part and an interactive element having a predefined location within the GUI displayed on the touch screen, wherein the location of the interactive element can be changed only after detecting the turbulent event;
identify a change in location of the body part relative to the interactive element during the turbulent event;
determine, before the body part contacts the touch screen, whether the change in location of the body part was one of an intended motion made by the user during the turbulent event and an unintended motion caused by the turbulent event; and
move, in response to determining that the change in location of the body part was due to the unintended motion and before the body part contacts the touch screen, the location of the interactive element within the touch screen to maintain the spatial relationship between the user and the interactive element before the turbulent event.
17. The computer readable storage medium of claim 16 , wherein the body part of the user does not contact the touch screen when identifying the spatial relationship and when moving the position of the GUI.
18. The computer readable storage medium of claim 17 , wherein identifying the spatial relationship comprises computer-readable program code executable to:
track the body part of the user to identify the location of the body part relative to the interactive element before the user contacts the touch screen.
19. The computer readable storage medium of claim 18 , wherein tracking the body part of the user comprises computer-readable program code executable to:
receive sensor data from a wearable device on the body part of the user, wherein the sensor data is processed to identify the change in the location of the body part relative to the interactive element.
20. The computer readable storage medium of claim 17 , wherein the computer-readable program code is further executable to:
determine whether the body part is within a threshold distance from the touch screen, wherein the position of the interactive element is moved to maintain the spatial relationship only when the body part is within the threshold distance.