Modeless augmentations to a virtual trackpad on a multiple screen computing device
The disclosed technologies address various technical and user experience problems by augmenting the functionality provided by virtual on-screen trackpads without requiring users to switch between modes. In this way, users can access extended functionality without interfering with expected traditional trackpad functionality (e.g. moving a cursor, clicking, and scrolling). In particular, technologies are disclosed for modeless digital pen input to a virtual trackpad, modeless gestures for summoning user interfaces, modeless gestures utilizing position relative to adjacent user interfaces, and modeless cursor control and interaction with virtual touch targets.
1. A computing device, comprising:
a processor;
a first display device providing a first display region having an edge;
a touch-sensitive display device providing a second display region having an edge parallel with and adjacent to the edge of the first display region, wherein the touch-sensitive display device is physically attached to maintain physical alignment between the first display region and the second display region; and
a memory storing instructions executable by the processor to:
execute a first application configured to present a graphical user interface (GUI) in a first portion of the first display region, the first portion of the first display region being physically aligned with a first virtual trackpad portion of the second display region;
execute a second application configured to present a GUI in a second portion of the first display region concurrently with the presentation of the GUI of the first application in the first portion of the first display region, the second portion of the first display region being physically aligned with a second virtual trackpad portion of the second display region;
based on receiving first input in the first virtual trackpad portion of the second display region, process the first input by way of an operating system in a context of the first application or provide the first input to the first application; and
based on receiving second input in the second virtual trackpad portion of the second display region, process the second input by way of the operating system in a context of the second application or provide the second input to the second application.
2. The computing device of claim 1 , wherein the first input or second input comprise a multi-touch gesture.
3. The computing device of claim 1 , wherein the first input or second input comprise user input received from a digital pen.
4. The computing device of claim 1 , wherein the memory stores further instructions executable by the processor to:
detect a user input gesture originating at a location in a third portion of the second display region and terminating in the first virtual trackpad portion of the second display region or the second virtual trackpad portion of the second display region; and
responsive to detecting the user input gesture, perform a command, the command selected based, at least in part, upon the location in the third portion at which the user input gesture originated.
5. The computing device of claim 4 , wherein third portion displays a keyboard having a plurality of keys, and wherein the gesture originates at one of the plurality of keys.
6. The computing device of claim 1 , wherein the first virtual trackpad portion of the second display region defines a first input region that is configured to only provide input to the first application, and wherein the second virtual trackpad portion of the second display region defines a second input region that is configured to only provide input to the second application.
7. The computing device of claim 1 , wherein the first virtual trackpad portion of the second display region does not overlap with the second virtual trackpad portion of the second display region.
8. The computing device of claim 1 , wherein the first portion of the first display region does not overlap with the second portion of the first display region.
9. The computing device of claim 1 , wherein a width of the first portion of the first display region corresponds with a width of the first virtual trackpad portion of the second display region.
10. The computing device of claim 1 , wherein a width of the second portion of the first display region is based on a width of the second virtual trackpad portion of the second display region.
11. The computing device of claim 1 , wherein the first display device and the touch-sensitive display are mechanically attached by a hinge.
12. A computer-implemented method, comprising:
executing a first application configured to present a graphical user interface (GUI) in a first portion of a first display region of a first display device, the first portion of the first display region being spatially aligned with a first virtual trackpad portion of a second display region of a touch-sensitive display, wherein the first display device and the touch-sensitive display are physically attached to maintain a physical alignment between the first portion of the first display region and the first virtual trackpad portion of the second display region;
executing a second application configured to present a GUI in a second portion of the first display region concurrently with the presentation of the GUI of the first application in the first portion of the first display region, the second portion of the first display region being physically aligned with a second virtual trackpad portion of the second display region, wherein the first display device and the touch-sensitive display are physically attached to maintain a physical alignment between the second portion of the first display region and the second virtual trackpad portion of the second display region;
responsive to receiving first input in the first virtual trackpad portion of the second display region, processing the first input in a context of the first application or providing the first input to the first application; and
responsive to receiving second input in the second virtual trackpad portion of the second display region, processing the second input in a context of the second application or providing the second input to the second application.
13. The computer-implemented method of claim 12 , wherein the first input or second input comprise a multi-touch gesture.
14. The computer-implemented method of claim 12 , further comprising:
detecting a user input gesture originating at a location in a third portion of the second display region and terminating in the first virtual trackpad portion of the second display region or the second virtual trackpad portion of the second display region; and
responsive to detecting the user input gesture, performing a command, the command selected based, at least in part, upon the location in the third portion at which the user input gesture originated.
15. The computer-implemented method of claim 12 , wherein the first portion of the first display region and the first virtual trackpad portion of the second display region have a same width.
16. The computer-implemented method of claim 12 , wherein the second portion of the first display region and the second virtual trackpad portion of the second display region have a same width.
17. A computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by a computer, cause the computer to:
execute a first application configured to present a graphical user interface (GUI) in a first portion of a first display region, the first portion of the first display region being physically aligned with a first virtual trackpad portion of a second display region positioned concurrently with a second virtual trackpad portion of the second display region, wherein the GUI of the first application displayed in the first portion of the first display region is concurrently displayed with a GUI displayed in a second portion of the first display region, wherein a first display device comprising the first display region and a touch-sensitive display comprising the second display region are physically attached to maintain a physical alignment between the second portion of the first display region and the second virtual trackpad portion of the second display region; and
responsive to receiving first input in the first virtual trackpad portion of the second display region, process the first input in a context of the first application or provide the first input to the first application.
18. The computer-readable storage medium of claim 17 , having further computer-executable instructions stored thereupon to:
execute a second application configured to be presented in the UI displayed in the second portion of the first display region, the second portion of the first display region being spatially aligned with the second virtual trackpad portion of the second display region; and
responsive to receiving second input in the second virtual trackpad portion of the second display region, process the second input in a context of the second application or provide the second input to the second application.
19. The computer-readable storage medium of claim 18 , having further computer-executable instructions stored thereupon to:
detect a user input gesture originating at a location in a third portion of the second display region and terminating in the first virtual trackpad portion of the second display region or the second virtual trackpad portion of the second display region; and
responsive to detecting the user input gesture, perform a command, the command selected based, at least in part, upon the location in the third portion at which the user input gesture originated.
20. The computer-readable storage medium of claim 18 , wherein the first portion of the first display region and the first virtual trackpad portion of the second display region have a first width and wherein the second portion of the first display region and the second virtual trackpad portion of the second display region have a second width.