IP Library Granted Patent US 11,023,055
Granted Patent B2
US 11,023,055 · App. 16/417,214 · Granted Jun 1, 2021

Devices, methods, and graphical user interfaces for an electronic device interacting with a stylus

Inventors: Gemma A. Roper (San Francisco, CA); Stephen O. Lemay (Palo Alto, CA); Arian Behzadi (San Francisco, CA); Parthiban Mohanraj (Milpitas, CA); Tiffany S. Jon (Cupertino, CA); Robert Garcia, III (San Francisco, CA)
Assignee: APPLE INC.
G06F3/03545G06F3/038G06F3/03547G06F3/0482G06F3/04162G06F3/04883G06F3/14G06F9/453G06F2203/0381G06F2203/04807
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,023,055
App. No.
16/417,214
Granted
Jun 1, 2021
Kind
B2
Abstract

In accordance with some embodiments, a method is performed at an electronic device. The method includes in response to detecting that the stylus is proximate to the electronic device, pairing the electronic device with the stylus. The method includes in response to pairing the stylus with the electronic device: displaying, on the display, a first representation of a first gesture performed on the stylus; obtaining finger manipulation data from the stylus via the communication interface, wherein the finger manipulation data indicates a finger manipulation input received by the stylus; and in response to obtaining the finger manipulation data, displaying, on the display, a second representation of a second gesture performed on the stylus corresponding to the finger manipulation input received by the stylus.

Claims (54)

1. A method comprising:

at an electronic device with one or more processors, a non-transitory memory, a display, a touch-sensitive surface, and a communication interface provided to communicate with a stylus:

in response to detecting that the stylus is proximate to the electronic device, pairing the electronic device with the stylus; and

in response to pairing the stylus with the electronic device:

displaying, on the display, a first representation of a first gesture performed on the stylus, wherein the first representation of the first gesture includes a representation of a finger input displayed on a representation of the stylus that is displayed on the display;

obtaining finger manipulation data from the stylus via the communication interface, wherein the finger manipulation data indicates a finger manipulation input received by the stylus; and

in response to obtaining the finger manipulation data, displaying, on the display, a second representation of a second gesture performed on the stylus corresponding to the finger manipulation input received by the stylus, wherein the second representation of the second gesture includes a representation of a finger input displayed on a representation of the stylus that is displayed on the display.

2. The method of claim 1 , further comprising:

obtaining additional finger manipulation data from the stylus via the communication interface, wherein the additional finger manipulation data indicates a second finger manipulation input received by the stylus corresponding to a movement of a finger on the stylus; and

in response to obtaining the additional finger manipulation data, changing, on the display, the second representation of the second gesture performed on the stylus according to the second finger manipulation input.

3. The method of claim 1 , wherein the stylus being proximate to the electronic device corresponds to the stylus not being in contact with the electronic device.

4. The method of claim 1 , wherein the stylus being proximate to the electronic device corresponds to the stylus contacting the electronic device at a connection point on the electronic device.

5. The method of claim 1 , wherein the first representation of the first gesture is predetermined.

6. The method of claim 1 , further comprising detecting, on the touch-sensitive surface, one or more inputs corresponding to a request to select a particular tutorial, wherein the first representation of the first gesture is based on the particular tutorial.

7. The method of claim 1 , wherein the first representation of the first gesture is displayed without user intervention.

8. The method of claim 1 , further comprising:

obtaining, from the stylus via the communication interface, status information about one or more statuses of the stylus; and

in response to obtaining the status information, displaying, on the display, one or more status indicators indicating the one or more statuses of the stylus.

9. The method of claim 8 , wherein the one or more status indicators include a battery level indicator.

10. The method of claim 8 , wherein the one or more status indicators are displayed along a side of the display corresponding to a connection point on the electronic device at which the stylus is contacting.

11. The method of claim 8 , further comprising:

determining whether or not the status information is indicative of an alert condition associated with the stylus; and

in response to determining that the status information is indicative of the alert condition, displaying, on the display, an alert message indicative of the alert condition.

12. The method of claim 1 , wherein the first representation of the first gesture and the second representation of the second gesture are displayed within a tutorial interface that includes a canvas and a set of drawing tools.

13. The method of claim 12 , further comprising:

in accordance with a determination that the finger manipulation data corresponds to a first type, moving focus to a particular drawing tool of the set of drawing tools; and

in accordance with a determination that the finger manipulation data corresponds to a second type, changing a property of a drawing tool that currently has focus.

14. The method of claim 12 , further comprising, in response to detecting a drawing input corresponding to the canvas, displaying a corresponding mark within the canvas according to a particular drawing tool of the set of tools that has focus.

15. The method of claim 1 , wherein the second representation of the second gesture is displayed in response to determining that the finger manipulation input satisfies a gesture criterion.

16. An electronic device comprising:

a touch-sensitive surface;

a display;

one or more processors;

a non-transitory memory;

a communication interface provided to communicate with a stylus; and

one or more programs, wherein the one or more programs are stored in the non-transitory memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

in response to detecting that the stylus is proximate to the electronic device, pairing the electronic device with the stylus; and

in response to pairing the stylus with the electronic device:

displaying, on the display, a first representation of a first gesture performed on the stylus, wherein the first representation of the first gesture includes a representation of a finger input displayed on a representation of the stylus that is displayed on the display;

obtaining finger manipulation data from the stylus via the communication interface, wherein the finger manipulation data indicates a finger manipulation input received by the stylus; and

in response to obtaining the finger manipulation data, displaying, on the display, a second representation of a second gesture performed on the stylus corresponding to the finger manipulation input received by the stylus, wherein the second representation of the second gesture includes a representation of a finger input displayed on a representation of the stylus that is displayed on the display.

17. The electronic device of claim 16 , wherein the one or more programs include additional instructions for:

obtaining additional finger manipulation data from the stylus via the communication interface, wherein the additional finger manipulation data indicates a second finger manipulation input received by the stylus corresponding to a movement of a finger on the stylus; and

in response to obtaining the additional finger manipulation data, changing, on the display, the second representation of the second gesture performed on the stylus according to the second finger manipulation input.

18. The electronic device of claim 16 , wherein the one or more programs include additional instructions for:

obtaining, from the stylus via the communication interface, status information about one or more statuses of the stylus; and

in response to obtaining the status information, displaying, on the display, one or more status indicators indicating the one or more statuses of the stylus.

19. The electronic device of claim 16 , wherein the first representation of the first gesture and the second representation of the second gesture are displayed within a tutorial interface that includes a canvas and a set of drawing tools.

20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with one or more processors, a touch-sensitive surface, a display, and a communication interface provided to communicate with a stylus, cause the electronic device to:

in response to detecting that the stylus is proximate to the electronic device, pair the electronic device with the stylus; and

in response to pairing the stylus with the electronic device:

display, on the display, a first representation of a first gesture performed on the stylus, wherein the first representation of the first gesture includes a representation of a finger input displayed on a representation of the stylus that is displayed on the display;

obtain finger manipulation data from the stylus via the communication interface, wherein the finger manipulation data indicates a finger manipulation input received by the stylus; and

in response to obtaining the finger manipulation data, display, on the display, a second representation of a second gesture performed on the stylus corresponding to the finger manipulation input received by the stylus, wherein the second representation of the second gesture includes a representation of a finger input displayed on a representation of the stylus that is displayed on the display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2020
From: ROPER, GEMMA A.; LEMAY, STEPHEN O.; BEHZADI, ARIAN; MOHANRAJ, PARTHIBAN; JON, TIFFANY S.; GARCIA, ROBERT, III
To: APPLE INC.
Reel/Frame 052881/0777 →
Continuity (3)
Provisional Application 62679461 · Jun 1, 2018
Provisional Application 62729869 · Sep 11, 2018
Related Publication 20190369755A1 · Dec 5, 2019
Cited By (6)
US 1,088,015 US 1,098,177 US 1,102,475 US 1,112,279 US 1,120,947 US 1,130,444