IP Library › Granted Patent US 11,635,874

Granted Patent B2

US 11,635,874 · App. 17/346,162 · Granted Apr 25, 2023

Pen-specific user interface controls

Inventors: Sean Shiang-Ning Whelan (Seattle, WA); Scott David Schenone (Seattle, WA); Young Soo Kim (Bellevue, WA)

Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC

G06F3/0482 G06F3/03545 G06F3/04845 G06F3/04886 G06F3/1446 G06F9/451 G06F16/2455 G06F2203/04803 G06F2203/04807

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,635,874
App. No.: 17/346,162
Granted: Apr 25, 2023
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Methods for pen-specific user interface controls are performed by systems and devices. Users activate pen-specific menus at user devices by activating controls of a touch pen such as a tail button. A communication is received by a device, from a touch pen, that indicates an activation control of the touch pen has been physically activated. The user device selects a touch pen menu that includes selectable menu options for respective launching of separate pen applications from among available menus based at least on the received communication. The device determines menu presentation information specifying a location within a user interface (UI) from a state of the UI at a time associated with the communication. The touch pen menu is displayed via the UI according to the menu presentation information. A detection for selection of a selectable menu option causes the device to launch a pen application associated therewith.

Claims (109)

1. A system, comprising:

a memory that stores program code; and

a processing system, comprising one or more processors, configured to receive the program code from the memory and, in response to at least receiving the program code, to:

receive a communication from a touch pen that indicates that an activation control of the touch pen has been physically activated;

select a touch pen menu from among a plurality of menus based at least on the communication indicating that the activation control of the touch pen has been physically activated, the touch pen menu including one or more selectable menu options corresponding to a respective launching of one or more separate pen applications;

determine menu presentation information based at least on a state of a user interface (UI) at a time associated with the communication, the menu presentation information specifying at least a location within the UI;

display, via the UI, the touch pen menu according to the menu presentation information, the touch pen menu comprising an interactive handle;

detect a drag of the interactive handle across the UI; and

display, via the UI, an expansion of the touch pen menu as a drawer, the drawer including:

the one or more selectable menu options in a top row of the drawer, and

one or more selectable drawer options below the top row, the one or more selectable menu options in the top row of the drawer corresponding to:

a first set of options based at least on a first profile of a user, the first profile being selectable by a first profile UI option displayed in the drawer, or

a second set of options based at least on a second profile of the user, the second profile being selectable by a second profile UI option displayed in the drawer.

2. The system of claim 1 , wherein the activation control of the touch pen comprises a tail activator; and

wherein the processing system is configured, in response to the at least receiving the program code, to determine the location within the UI based at least on a handedness setting of the state of the UI.

3. The system of claim 1 , further comprising a first physical display and a second physical display configured to respectively display a first portion of the UI and a second portion of the UI; and

wherein the processing system is configured, in response to the at least receiving the program code, to determine the location within the UI as being within the first portion of the UI based at least on at least one of:

the first portion of the UI corresponding to a handedness setting of the state of the UI; or

the state of the UI indicating the first portion of the UI displays a home screen and the second portion of the UI displays an executing application that is in focus.

4. The system of claim 3 , wherein the processing system is configured, in response to the at least receiving the program code, to:

receive, based at least on an interaction of the touch pen with the touch pen menu, a selection indication of a selectable menu option of the one or more selectable menu options that designates a pen application of the one or more separate pen applications; and

launch the pen application in the first portion of the UI on the first physical display based at least on the location within the UI.

5. The system of claim 1 , further comprising a first physical display and a second physical display configured to respectively display, in a vertically-aligned orientation, a first portion of the UI beneath a second portion of the UI; and

wherein the processing system is configured, in response to the at least receiving the program code, to determine the menu presentation information based at least on the state of the UI indicating the first portion of the UI is beneath the second portion of the UI, the menu presentation information specifying at least:

that the location within the UI is within the first portion of the UI; and

an orientation of the touch pen menu that designates a vertical display thereof.

6. The system of claim 1 , wherein the one or more selectable menu options comprise a customization option; and

wherein the processing system is configured, in response to the at least receiving the program code, to:

receive, based at least on an interaction of the touch pen with the customization option, a menu customization indication; and

display a first sub-menu in the UI responsive to the menu customization indication, the first sub-menu comprising selectable customization options that include at least one of:

reordering of the one or more selectable menu options;

adding a selectable menu option to the one or more selectable menu options; or

removing one of the one or more selectable menu options.

7. A method performed by a computing device, the method comprising:

receiving a communication from a touch pen that indicates an activation control of the touch pen has been physically activated;

selecting a touch pen menu from among a plurality of menus based at least on the communication indicating that the activation control of the touch pen has been physically activated, the touch pen menu including one or more selectable menu options corresponding to a respective launching of one or more separate pen applications;

determining menu presentation information based at least on a state of a user interface (UI) at a time associated with the communication, the menu presentation information specifying at least a location within the UI;

displaying, via the UI, the touch pen menu according to the menu presentation information, the touch pen menu comprising an interactive handle;

detecting a drag of the interactive handle across the UI; and

displaying, via the UI, an expansion of the touch pen menu as a drawer, the drawer including:

the one or more selectable menu options in a top row of the drawer, and

one or more selectable drawer options below the top row, the one or more selectable menu options in the top row of the drawer corresponding to:

a first set of options based at least on a first profile of a user, the first profile being selectable by a first profile UI option displayed in the drawer; or

a second set of options based at least on a second profile of the user, the second profile being selectable by a second profile UI option displayed in the drawer.

8. The method of claim 7 , wherein the activation control of the touch pen comprises a tail activator; and

the method further comprises determining the location within the UI based at least on a handedness setting of the state of the UI.

9. The method of claim 7 , wherein the computing device comprises a first physical display and a second physical display configured to respectively display a first portion of the UI and a second portion of the UI; and

wherein the method further comprises determining the location within the UI as being within the first portion of the UI based at least on at least one of:

the first portion of the UI corresponding to a handedness setting of the state of the UI; or

the state of the UI indicating the first portion of the UI displays a home screen and the second portion of the UI displays an executing application that is in focus.

10. The method of claim 9 , comprising:

receiving, based at least on an interaction of the touch pen with the touch pen menu, a selection indication of a selectable menu option of the one or more selectable menu options that designates a pen application of the one or more separate pen applications; and

launching the pen application in the first portion of the UI on the first physical display based at least on the location within the UI.

11. The method of claim 7 , wherein the one or more selectable menu options comprise a customization option; and

wherein the method further comprises:

receiving, based at least on an interaction of the touch pen with the customization option, a menu customization indication; and

displaying a first sub-menu in the UI responsive to the menu customization indication, the first sub-menu comprising selectable customization options that include at least one of:

reordering of the one or more selectable menu options;

adding a selectable menu option to the one or more selectable menu options; or

removing one of the one or more selectable menu options.

12. The method of claim 7 , further comprising:

prior to said displaying, determining at least one of the one or more selectable menu options based at least on one or more of:

a pre-determined set of pen applications that are executable by the computing device; or

a usage metric associated with one or more pen applications that have been executed by the computing device; and

associating the one or more selectable menu options with the touch pen menu.

13. The method of claim 7 , further comprising:

detecting a drag gesture of the touch pen across the UI that is indicative of executing a search application;

executing the search application responsive to said detecting; and

displaying via the UI:

a search UI of the executed search application, and

the one or more selectable menu options in the search UI based at least on the drag gesture being performed with the touch pen.

14. A computer-readable storage medium having program code recorded thereon that, based at least on execution of the program code by a computing device, perform a method, the method comprising: