IP Library › Granted Patent US 10,955,956
Granted Patent B2
US 10,955,956 · App. 16/403,329 · Granted Mar 23, 2021

Devices, methods, and graphical user interfaces for interaction with an intensity-sensitive input region

Inventors: Brian T. Gleeson (Mountain View, CA); Brigit E. Lamberson (San Francisco, CA); Camille Moussette (Los Gatos, CA); Madeleine S. Cordier (San Francisco, CA); Megan A. McClain (San Francisco, CA); Michael J. Beyhs (San Francisco, CA); Thayne M. Miller (San Jose, CA); Jacob L. Matlick (San Francisco, CA); Jean-Pierre M. Mouilleseaux (San Francisco, CA); Peter C. Tsoi (San Jose, CA); David H. Bloom (San Francisco, CA); Miao He (Sunnyvale, CA)
Assignee: APPLE INC.
G06F3/0414G06F3/016G06F2203/04101G06F2203/04105
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,955,956
App. No.
16/403,329
Granted
Mar 23, 2021
Kind
B2
Abstract

An electronic device includes a display and an input region separate from the display. The device detects a first portion of a first input on the input region. In response to detecting the first portion of the first input: if the first portion of the first input meets first criteria that do not require a characteristic intensity of the first input to increase above a first intensity threshold in order to be met, the device displays a precursor object of a user interface object that includes one or more selectable options. While displaying the precursor object, a second portion of the first input is detected on the input region, wherein an intensity of the first input increases above the first intensity threshold. In response to detecting the increase in intensity, the device reveals the user interface object by an amount that varies with a current intensity of the first input.

Claims (162)

1. A method, comprising:

at an electronic device with a display, and a first input region that is separate from the display:

detecting a first portion of a first input on the first input region that is near an edge portion of the display;

in response to detecting the first portion of the first input on the first input region:

in accordance with a determination that the first portion of the first input meets first criteria, wherein the first criteria include a set of criteria that are met when the first input is detected on the first input region without a characteristic intensity of the first input increasing above a first intensity threshold, displaying, on the display, a precursor object corresponding to a user interface object that includes one or more selectable options on the edge portion of the display that is near the first input region;

while displaying the precursor object on the display, detecting a second portion of the first input on the first input region, including detecting an increase in intensity of the first input above the first intensity threshold; and

in response to detecting the increase in intensity of the first input during the second portion of the first input, revealing the user interface object on the display by an amount that varies in accordance with a current intensity of the first input, including expanding the user interface object from the edge portion of the display that is near the first input region toward an opposite edge of the display by an amount that varies in accordance with a current intensity of the first input.

2. The method of claim 1 , including:

after detecting the second portion of the first input, detecting a third portion of the first input on the first input region, including detecting a continued increase in intensity of the first input;

in response to detecting the continued increase in intensity of the first input:

in accordance with a determination that the third portion of the first input meets second criteria, wherein the second criteria include a set of criteria that are met when a characteristic intensity of the first input increases above a second intensity threshold that is greater than the first intensity threshold before an end of the first input is detected: displaying the user interface object that includes the one or more selectable options on the display.

3. The method of claim 2 , including:

after detecting the third portion of the first input, detecting a fourth portion of the first input on the first input region, including detecting a decrease in intensity of the first input:

in accordance with a determination that the second criteria were met before detecting the fourth portion of the first input, maintaining display of the user interface object without altering an amount by which the user interface object is currently displayed; and

in accordance with a determination that the second criteria were not met before detecting the fourth portion of the first input, decreasing an amount by which the user interface object is revealed on the display in accordance with a current intensity of the first input.

4. The method of claim 2 , including:

in response to detecting the continued increase in intensity of the first input:

in accordance with a determination that the third portion of the first input meets the second criteria: generating a first tactile output.

5. The method of claim 4 , wherein the device includes a first tactile output generator that resides locally at the first input region and that provides localized tactile outputs, including the first tactile output, at the first input region.

6. The method of claim 4 , wherein the generation of the first tactile output is synchronized with satisfaction of the second criteria by the first input.

7. The method of claim 4 , wherein the generation of the first tactile output is synchronized with initial full-display of the user interface object on the display.

8. The method of claim 2 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the method includes:

while displaying the user interface object including the one or more selectable options on the display, detecting a second input on the touch-sensitive surface at a location that corresponds to a first selectable option of the one or more selectable options in the user interface object; and

in response to detecting the second input:

in accordance with a determination that the second input meets selection criteria, selecting the first selectable option.

9. The method of claim 8 , including:

in response to detecting the second input:

in accordance with a determination that the second input meets selection-confirmation criteria, performing a first operation that corresponds to the first selectable option.

10. The method of claim 8 , including:

in response to detecting the second input:

in accordance with a determination that the second input meets drag criteria, displaying a representation of the first selectable option outside of the user interface object.

11. The method of claim 10 , including:

in response to detecting the second input:

in accordance with a determination that the second input meets drop criteria, displaying a copy of the first selectable option outside of the user interface object.

12. The method of claim 8 , wherein the second input is detected while the user interface object is partially revealed on the display, without the second criteria being met by the first input.

13. The method of claim 2 , including:

while displaying the user interface object including the one or more selectable options on the display, detecting a third input on the first input region, wherein the third input includes movement of a contact across the first input region; and

in response to detecting the third input, scrolling a selection indicator through the one or more selectable options on the display in accordance with the movement of the contact in the third input.

14. The method of claim 13 , including:

while the selection indicator is moved to a first selectable option of the one or more selectable options on the display in accordance with the movement of the contact in the third input on the first input region, detecting a fourth input on the first input region that meets selection-confirmation criteria; and

in response detecting the fourth input that meets the selection-confirmation criteria, performing an operation corresponding to the first selectable options.

15. The method of claim 2 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the method includes:

while displaying the user interface object including the one or more selectable options on the display, detecting a fifth input on the touch-sensitive surface, including:

detecting touch-down of a contact on the touch-sensitive surface at a location that corresponds to a second user interface object that is displayed outside of the user interface object,

detecting movement of the contact across the touch-sensitive surface to a location within the user interface object, and

detecting lift-off of the contact from the touch-sensitive surface while the second user interface object is within the user interface object; and

in response to detecting the fifth input, adding the second user interface object as a new selectable option in the user interface object.

16. The method of claim 2 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the method includes:

while displaying the user interface object including the one or more selectable options on the display, detecting a sixth input on the touch-sensitive surface, including:

detecting touch-down of a contact on the touch-sensitive surface at a location that corresponds to a respective selectable option that is displayed within the user interface object,

detecting movement of the contact across the touch-sensitive surface to a location outside of the user interface object, and

detecting lift-off of the contact from the touch-sensitive surface while the respective selectable option is dragged outside of the user interface object; and

in response to detecting the sixth input, removing the respective selectable option from the user interface object.

17. An electronic device, comprising:

a display;

a first input region that is separate from the display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

detecting a first portion of a first input on the first input region that is near an edge portion of the display;

in response to detecting the first portion of the first input on the first input region:

in accordance with a determination that the first portion of the first input meets first criteria, wherein the first criteria include a set of criteria that are met when the first input is detected on the first input region without a characteristic intensity of the first input increasing above a first intensity threshold, displaying, on the display, a precursor object corresponding to a user interface object that includes one or more selectable options on the edge portion of the display that is near the first input region;

while displaying the precursor object on the display, detecting a second portion of the first input on the first input region, including detecting an increase in intensity of the first input above the first intensity threshold; and

in response to detecting the increase in intensity of the first input during the second portion of the first input, revealing the user interface object on the display by an amount that varies in accordance with a current intensity of the first input, including expanding the user interface object from the edge portion of the display that is near the first input region toward an opposite edge of the display by an amount that varies in accordance with a current intensity of the first input.

18. The electronic device of claim 17 , wherein the one or more programs include instructions for:

after detecting the second portion of the first input, detecting a third portion of the first input on the first input region, including detecting a continued increase in intensity of the first input;

in response to detecting the continued increase in intensity of the first input:

in accordance with a determination that the third portion of the first input meets second criteria, wherein the second criteria include a set of criteria that are met when a characteristic intensity of the first input increases above a second intensity threshold that is greater than the first intensity threshold before an end of the first input is detected: displaying the user interface object that includes the one or more selectable options on the display.

19. The electronic device of claim 18 , wherein the one or more programs include instructions for:

after detecting the third portion of the first input, detecting a fourth portion of the first input on the first input region, including detecting a decrease in intensity of the first input:

in accordance with a determination that the second criteria were met before detecting the fourth portion of the first input, maintaining display of the user interface object without altering an amount by which the user interface object is currently displayed; and

in accordance with a determination that the second criteria were not met before detecting the fourth portion of the first input, decreasing an amount by which the user interface object is revealed on the display in accordance with a current intensity of the first input.

20. The electronic device of claim 18 , wherein the one or more programs include instructions for:

in response to detecting the continued increase in intensity of the first input:

in accordance with a determination that the third portion of the first input meets the second criteria: generating a first tactile output.

21. The electronic device of claim 20 , wherein the device includes a first tactile output generator that resides locally at the first input region and that provides localized tactile outputs, including the first tactile output, at the first input region.

22. The electronic device of claim 20 , wherein the generation of the first tactile output is synchronized with satisfaction of the second criteria by the first input.

23. The electronic device of claim 20 , wherein the generation of the first tactile output is synchronized with initial full-display of the user interface object on the display.

24. The electronic device of claim 18 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the one or more programs include instructions for:

while displaying the user interface object including the one or more selectable options on the display, detecting a second input on the touch-sensitive surface at a location that corresponds to a first selectable option of the one or more selectable options in the user interface object; and

in response to detecting the second input:

in accordance with a determination that the second input meets selection criteria, selecting the first selectable option.

25. The electronic device of claim 24 , wherein the one or more programs include instructions for:

in response to detecting the second input:

in accordance with a determination that the second input meets selection-confirmation criteria, performing a first operation that corresponds to the first selectable option.

26. The electronic device of claim 24 , wherein the one or more programs include instructions for:

in response to detecting the second input:

in accordance with a determination that the second input meets drag criteria, displaying a representation of the first selectable option outside of the user interface object.

27. The electronic device of claim 26 , wherein the one or more programs include instructions for:

in response to detecting the second input:

in accordance with a determination that the second input meets drop criteria, displaying a copy of the first selectable option outside of the user interface object.

28. The electronic device of claim 24 , wherein the second input is detected while the user interface object is partially revealed on the display, without the second criteria being met by the first input.

29. The electronic device of claim 18 , wherein the one or more programs include instructions for:

while displaying the user interface object including the one or more selectable options on the display, detecting a third input on the first input region, wherein the third input includes movement of a contact across the first input region; and

in response to detecting the third input, scrolling a selection indicator through the one or more selectable options on the display in accordance with the movement of the contact in the third input.

30. The electronic device of claim 29 , wherein the one or more programs include instructions for:

while the selection indicator is moved to a first selectable option of the one or more selectable options on the display in accordance with the movement of the contact in the third input on the first input region, detecting a fourth input on the first input region that meets selection-confirmation criteria; and

in response detecting the fourth input that meets the selection-confirmation criteria, performing an operation corresponding to the first selectable options.

31. The electronic device of claim 18 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the one or more programs include instructions for:

while displaying the user interface object including the one or more selectable options on the display, detecting a fifth input on the touch-sensitive surface, including:

detecting touch-down of a contact on the touch-sensitive surface at a location that corresponds to a second user interface object that is displayed outside of the user interface object,

detecting movement of the contact across the touch-sensitive surface to a location within the user interface object, and

detecting lift-off of the contact from the touch-sensitive surface while the second user interface object is within the user interface object; and

in response to detecting the fifth input, adding the second user interface object as a new selectable option in the user interface object.

32. The electronic device of claim 18 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the one or more programs include instructions for:

while displaying the user interface object including the one or more selectable options on the display, detecting a sixth input on the touch-sensitive surface, including:

detecting touch-down of a contact on the touch-sensitive surface at a location that corresponds to a respective selectable option that is displayed within the user interface object,

detecting movement of the contact across the touch-sensitive surface to a location outside of the user interface object, and

detecting lift-off of the contact from the touch-sensitive surface while the respective selectable option is dragged outside of the user interface object; and

in response to detecting the sixth input, removing the respective selectable option from the user interface object.

33. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a first input region that is separate from the display, one or more processors, and memory, cause the device to:

detect a first portion of a first input on the first input region that is near an edge portion of the display;

in response to detecting the first portion of the first input on the first input region:

in accordance with a determination that the first portion of the first input meets first criteria, wherein the first criteria include a set of criteria that are met when the first input is detected on the first input region without a characteristic intensity of the first input increasing above a first intensity threshold, display, on the display, a precursor object corresponding to a user interface object that includes one or more selectable options on the edge portion of the display that is near the first input region;

while displaying the precursor object on the display, detect a second portion of the first input on the first input region, including detecting an increase in intensity of the first input above the first intensity threshold; and

in response to detecting the increase in intensity of the first input during the second portion of the first input, reveal the user interface object on the display by an amount that varies in accordance with a current intensity of the first input, including expanding the user interface object from the edge portion of the display that is near the first input region toward an opposite edge of the display by an amount that varies in accordance with a current intensity of the first input.

34. The non-transitory computer readable storage medium of claim 33 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

after detecting the second portion of the first input, detect a third portion of the first input on the first input region, including detecting a continued increase in intensity of the first input;

in response to detecting the continued increase in intensity of the first input:

in accordance with a determination that the third portion of the first input meets second criteria, wherein the second criteria include a set of criteria that are met when a characteristic intensity of the first input increases above a second intensity threshold that is greater than the first intensity threshold before an end of the first input is detected: display the user interface object that includes the one or more selectable options on the display.

35. The non-transitory computer readable storage medium of claim 34 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

after detecting the third portion of the first input, detect a fourth portion of the first input on the first input region, including detecting a decrease in intensity of the first input:

in accordance with a determination that the second criteria were met before detecting the fourth portion of the first input, maintain display of the user interface object without altering an amount by which the user interface object is currently displayed; and

in accordance with a determination that the second criteria were not met before detecting the fourth portion of the first input, decrease an amount by which the user interface object is revealed on the display in accordance with a current intensity of the first input.

36. The non-transitory computer readable storage medium of claim 34 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to detecting the continued increase in intensity of the first input:

in accordance with a determination that the third portion of the first input meets the second criteria: generate a first tactile output.

37. The non-transitory computer readable storage medium of claim 36 , wherein the device includes a first tactile output generator that resides locally at the first input region and that provides localized tactile outputs, including the first tactile output, at the first input region.

38. The non-transitory computer readable storage medium of claim 36 , wherein the generation of the first tactile output is synchronized with satisfaction of the second criteria by the first input.

39. The non-transitory computer readable storage medium of claim 36 , wherein the generation of the first tactile output is synchronized with initial full-display of the user interface object on the display.

40. The non-transitory computer readable storage medium of claim 34 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

while displaying the user interface object including the one or more selectable options on the display, detect a second input on the touch-sensitive surface at a location that corresponds to a first selectable option of the one or more selectable options in the user interface object; and

in response to detecting the second input:

in accordance with a determination that the second input meets selection criteria, select the first selectable option.

41. The non-transitory computer readable storage medium of claim 40 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to detecting the second input:

in accordance with a determination that the second input meets selection-confirmation criteria, perform a first operation that corresponds to the first selectable option.

42. The non-transitory computer readable storage medium of claim 40 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to detecting the second input:

in accordance with a determination that the second input meets drag criteria, display a representation of the first selectable option outside of the user interface object.

43. The non-transitory computer readable storage medium of claim 42 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

in response to detecting the second input:

in accordance with a determination that the second input meets drop criteria, display a copy of the first selectable option outside of the user interface object.

44. The non-transitory computer readable storage medium of claim 40 , wherein the second input is detected while the user interface object is partially revealed on the display, without the second criteria being met by the first input.

45. The non-transitory computer readable storage medium of claim 34 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

while displaying the user interface object including the one or more selectable options on the display, detect a third input on the first input region, wherein the third input includes movement of a contact across the first input region; and

in response to detecting the third input, scroll a selection indicator through the one or more selectable options on the display in accordance with the movement of the contact in the third input.

46. The non-transitory computer readable storage medium of claim 45 , wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

while the selection indicator is moved to a first selectable option of the one or more selectable options on the display in accordance with the movement of the contact in the third input on the first input region, detect a fourth input on the first input region that meets selection-confirmation criteria; and

in response detecting the fourth input that meets the selection-confirmation criteria, perform an operation corresponding to the first selectable options.

47. The non-transitory computer readable storage medium of claim 34 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

while displaying the user interface object including the one or more selectable options on the display, detect a fifth input on the touch-sensitive surface, including:

detecting touch-down of a contact on the touch-sensitive surface at a location that corresponds to a second user interface object that is displayed outside of the user interface object,

detecting movement of the contact across the touch-sensitive surface to a location within the user interface object, and

detecting lift-off of the contact from the touch-sensitive surface while the second user interface object is within the user interface object; and

in response to detecting the fifth input, add the second user interface object as a new selectable option in the user interface object.

48. The non-transitory computer readable storage medium of claim 34 , wherein the device includes a touch-sensitive surface that is distinct from the first input region, and wherein the instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

while displaying the user interface object including the one or more selectable options on the display, detect a sixth input on the touch-sensitive surface, including:

detecting touch-down of a contact on the touch-sensitive surface at a location that corresponds to a respective selectable option that is displayed within the user interface object,

detecting movement of the contact across the touch-sensitive surface to a location outside of the user interface object, and

detecting lift-off of the contact from the touch-sensitive surface while the respective selectable option is dragged outside of the user interface object; and

in response to detecting the sixth input, remove the respective selectable option from the user interface object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2025
From: MCCARTHY, MAX L.L.
To: APPLE INC.
Reel/Frame 072319/0305 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2019
From: GLEESON, BRIAN T.; LAMBERSON, BRIGIT E.; MOUSSETTE, CAMILLE; CORDIER, MADELEINE S.; MCCLAIN, MEGAN A.; BEYHS, MICHAEL J.; MILLER, THAYNE M.; MATLICK, JACOB L.; MOUILLESEAUX, JEAN-PIERRE M.; TSOI, PETER C.; BLOOM, DAVID H.; HE, MIAO
To: APPLE INC.
Reel/Frame 050508/0145 →
Continuity (2)
Provisional Application 62668187 · May 7, 2018
Related Publication 20190339804A1 · Nov 7, 2019
Cited By (8)
US 12,602,154 US 12,619,303 US 12,666,132 US 12,671,891 US 12,676,927 US 12,732,665 US 12,737,107 US 12,744,990