IP Library › Granted Patent US 11,809,702
Granted Patent B2
US 11,809,702 · App. 17/659,285 · Granted Nov 7, 2023

Modeless augmentations to a virtual trackpad on a multiple screen computing device

Inventors: Christian Klein (Duvall, WA); Andrew Stuart Glass (Seattle, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/04883G06F3/03545G06F3/03547G06F3/04886G06F2203/04808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,809,702
App. No.
17/659,285
Granted
Nov 7, 2023
Kind
B2
Abstract

The disclosed technologies address various technical and user experience problems by augmenting the functionality provided by virtual on-screen trackpads without requiring users to switch between modes. In this way, users can access extended functionality without interfering with expected traditional trackpad functionality (e.g. moving a cursor, clicking, and scrolling). In particular, technologies are disclosed for modeless digital pen input to a virtual trackpad, modeless gestures for summoning user interfaces, modeless gestures utilizing position relative to adjacent user interfaces, and modeless cursor control and interaction with virtual touch targets.

Claims (73)

1. A computing device, comprising:

a processor;

a first display device providing a first display region;

a second, touch-sensitive, display device providing a second display region; and

a memory storing instructions executable by the processor to:

execute a first application configured to present a graphical user interface (GUI) in the first display region;

display a user interface (UI) control and a virtual trackpad region in the second display region;

detect a first touch input in the second display region;

determine that the first touch input is located on the UI control;

determine that a duration of the first touch input is within a predetermined amount of time;

based on the duration of the first touch input ending within the predetermined amount of time, select the UI control;

detect a second touch input in the second display region;

determine that the second touch input originates on the UI control;

determine that a duration of the second touch input exceeds the predetermined amount of time;

determine that the second touch input ends within the virtual trackpad region; and

based on the duration of the second touch input exceeding the predetermined amount of time and on the second touch input ending within the virtual trackpad region, move a cursor in the first display region according to the second touch input.

2. The computing device of claim 1 , wherein the second display region includes a virtual keyboard.

3. The computing device of claim 1 , wherein the memory further stores instructions executable by the processor to:

detect a third touch input in the virtual trackpad region;

determine that the third touch input is not located on the UI control; and

based on the third touch input being within the virtual trackpad region and not located on the UI control, move the cursor in the first display region according to the third touch input.

4. The computing device of claim 1 , wherein the memory further stores instructions executable by the processor to:

detect a third touch input originating in the virtual trackpad region and ending on the UI control; and

based on the third touch input originating within the virtual trackpad region, move the cursor in the first display region according to the third touch input.

5. The computing device of claim 1 , wherein the memory further stores instructions executable by the processor to:

detect a third touch input originating on the UI control and ending in the virtual trackpad region; and

based on the third touch input originating on the UI control and ending in the virtual trackpad region, move the cursor in the first display region according to the third touch input.

6. The computing device of claim 1 , wherein the predetermined amount of time is less than or equal to 100 milliseconds.

7. The computing device of claim 1 , wherein at least the first touch input or the second touch input comprises a multi-touch gesture.

8. A computer-implemented method comprising:

displaying a first graphical user interface (GUI) in a first display region of a first display device;

displaying a user interface (UI) control and a virtual trackpad region in a second display region of a second display device;

detecting a first touch input in the second display region, the first touch input being located on the UI control and having a duration ending within a predetermined amount of time;

based on the duration of the first touch input ending within the predetermined amount of time, selecting the UI control;

detecting a second touch input in the second display region, the second touch input originating on the UI control, ending in the virtual trackpad region, and having a duration exceeding the predetermined amount of time; and

based on the duration of the second touch input exceeding the predetermined amount of time and ending in the virtual trackpad region, moving a cursor in the first display region according to the second touch input.

9. The computer-implemented method of claim 8 , wherein the second display region includes a virtual keyboard.

10. The computer-implemented method of claim 8 , further comprising:

detecting a third touch input in the virtual trackpad region;

determining that the third touch input is not located on the UI control; and

based on the third touch input being within the virtual trackpad region and not located on the UI control, moving the cursor in the first display region according to the third touch input.

11. The computer-implemented method of claim 8 , further comprising:

detecting a third touch input originating in the virtual trackpad region and ending on the UI control; and

based on the third touch input originating within the virtual trackpad region, moving the cursor in the first display region according to the third touch input.

12. The computer-implemented method of claim 8 , further comprising:

detecting a third touch input originating on the UI control and ending in the virtual trackpad region; and

based on the third touch input originating on the UI control and ending in the virtual trackpad region, moving the cursor in the first display region according to the third touch input.

13. The computer-implemented method of claim 8 , wherein the predetermined amount of time is less than or equal to 100 milliseconds.

14. The computer-implemented method of claim 8 , wherein at least the first touch input or the second touch input comprises a multi-touch gesture.

15. A computer-implemented method comprising:

executing a first application configured to present a graphical user interface (GUI) in a first display region of a first display device;

displaying a user interface (UI) control and a virtual trackpad region in a second display region of a second display device coupled to the first display device;

detecting a first touch input in the second display region;

determining that the first touch input is located on the UI control;

determining that a duration of the first touch input is within a predetermined amount of time;

based on the duration of the first touch input ending within the predetermined amount of time, selecting the UI control;

detecting a second touch input in the second display region;

determining that the second touch input originates on the UI control;

determining that a duration of the second touch input exceeds the predetermined amount of time;

determining that the second touch input ends within the virtual trackpad region; and

based on the duration of the second touch input exceeding the predetermined amount of time and on the second touch input ending within the virtual trackpad region, moving a cursor in the first display region according to the second touch input.

16. The computer-implemented method of claim 15 , wherein the second display region includes a virtual keyboard.

17. The computer-implemented method of claim 15 , further comprising:

detecting a third touch input in the virtual trackpad region;

determining that the third touch input is not located on the UI control; and

based on the third touch input being within the virtual trackpad region and not located on the UI control, moving the cursor in the first display region according to the third touch input.

18. The computer-implemented method of claim 15 , further comprising:

detecting a third touch input originating in the virtual trackpad region and ending on the UI control; and

based on the third touch input originating within the virtual trackpad region, moving the cursor in the first display region according to the third touch input.

19. The computer-implemented method of claim 15 , further comprising:

detecting a third touch input originating on the UI control and ending in the virtual trackpad region; and

based on the third touch input originating on the UI control and ending in the virtual trackpad region, moving the cursor in the first display region according to the third touch input.

20. The computer-implemented method of claim 15 , wherein second display device includes a keyboard.

Continuity (2)
Continuation 16207840 · Dec 3, 2018
Related Publication 20220382447A1 · Dec 1, 2022
Cited By (2)
US 12,216,899 US 12,353,708