IP Library Granted Patent US 10,908,797
Granted Patent B2
US 10,908,797 · App. 16/869,489 · Granted Feb 2, 2021

Systems and methods for enabling low-vision users to interact with a touch-sensitive secondary display

Inventors: Eric T. Seymour (San Jose, CA); Gregory F. Hughes (Cupertino, CA); James P. Craig (San Francisco, CA); Susumu Harada (San Francisco, CA)
Assignee: APPLE INC.
G06F3/04845G06F1/1692G06F3/0236G06F3/0238G06F3/04847G06F3/04883G06F3/04886G09B21/008G06F2203/04806
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,908,797
App. No.
16/869,489
Granted
Feb 2, 2021
Kind
B2
Abstract

Disclosed herein are systems and methods that enable low-vision users to interact with touch-sensitive secondary displays. An example method includes, while operating a touch-sensitive secondary display in an accessibility mode: displaying, on the primary display, a first user interface for an application, and displaying, on the touch-sensitive secondary display, a second user interface that includes: (i) application-specific affordances, and (ii) a system-level affordance, where each application-specific affordance and the system-level affordance are displayed with a first display size. The method includes detecting an input at the application-specific affordance. In response to detecting the input, and while the input remains in contact: continuing to display the first user interface for the application; and displaying, on the primary display, a zoomed-in representation of the at least one application-specific affordance, where the zoomed-in representation of the application-specific affordance is displayed with a second display size that is larger than the first display size.

Claims (89)

1. A method, comprising:

at a computing system comprising one or more processors, a first housing that includes a primary display, memory, and a second housing at least partially containing a touch-sensitive secondary display that is distinct from the primary display:

operating the touch-sensitive secondary display in an accessibility mode;

while operating the touch-sensitive secondary display in the accessibility mode:

displaying, on the primary display, a first user interface for an application;

displaying, on the touch-sensitive secondary display, a second user interface that includes: (i) a plurality of application-specific affordances that control functions available within the application and (ii) at least one system-level affordance that controls a system-level function, wherein each of the plurality of application-specific affordances and the at least one system-level affordance are displayed with a first display size;

detecting, via the touch-sensitive secondary display, an input that contacts at least one application-specific affordance of the plurality of application-specific affordances; and

in response to the detecting the input and while the input remains in contact with the touch-sensitive secondary display:

continuing to display, on the primary display, the first user interface for the application;

displaying, on the primary display, a zoomed-in representation of the at least one application-specific affordance, wherein the zoomed-in representation of the at least one application-specific affordance is displayed with a second display size that is larger than the first display size.

2. The method of claim 1 , wherein displaying the zoomed-in representation of the at least one application-specific affordance includes displaying the zoomed-in representation of the at least one application-specific affordance within a zoomed-in representation of the second user interface.

3. The method of claim 2 , wherein displaying the zoomed-in representation of the second user interface includes displaying a focus indicator within the zoomed-in representation of the second user interface that is positioned based at least in part on a position on the touch-sensitive secondary display at which the input contacted the touch-sensitive secondary display.

4. The method of claim 3 , wherein the focus indicator includes a representation of a countdown timer and the method includes:

in accordance with a determination that the input has remained in contact with the at least one application-specific affordance for more than a predetermined amount of time, updating the representation of the countdown timer to indicate that the countdown timer is active; and

in accordance with a determination that the countdown timer has expired, activating the at least one application-specific affordance.

5. The method of claim 4 , wherein:

the at least one application-specific affordance is associated with a slider, and

activating the at least one application-specific affordance includes updating the zoomed-in representation of the at least one application-specific affordance in accordance with movement of the at least one application-specific affordance along the slider.

6. The method of claim 1 , wherein the touch-sensitive secondary display includes a first area comprising the at least one application-specific affordance and a second area comprising other affordances distinct from the at least one application-specific affordance in the plurality of application-specific affordances, and the method further comprises:

while the input remains in contact with at least one application-specific affordance at the first area of the touch-sensitive secondary display, detecting a tap gesture at the second area of the touch-sensitive secondary display; and

in response to detecting the tap gesture, activating the at least one application-specific affordance.

7. The method of claim 1 , further comprising:

detecting, at the touch-sensitive secondary display, a predefined gesture that manipulates a zoom level that is used to display the zoomed-in representation of the at least one application-specific affordance at the primary display; and

in response to detecting the predefined gesture, updating the zoomed-in representation at the primary display as the zoom level is manipulated using the predefined gesture.

8. The method of claim 1 , wherein the zoomed-in representation of the at least one application-specific affordance is displayed on the primary display in accordance with a determination that the input has remained in continuous contact with the touch-sensitive secondary display for more than a predetermined amount of time.

9. The method of claim 1 , wherein each of the plurality of application-specific affordances and the at least one system-level affordance are selectable via one or more inputs at the touch-sensitive secondary display.

10. The method of claim 1 , wherein the second housing also at least partially contains a physical keyboard.

11. The method of claim 1 , wherein the second housing is not connected to the first housing.

12. The method of claim 1 , wherein the second housing is part of a wearable computing device.

13. A non-transitory computer-readable storage medium storing executable instructions that, when executed by a computing system with one or more processors, a first housing that includes a primary display, and a second housing at least partially containing a touch-sensitive secondary display that is distinct from the primary display, cause the computing system to:

operate the touch-sensitive secondary display in an accessibility mode;

while operating the touch-sensitive secondary display in the accessibility mode:

display, on the primary display, a first user interface for an application;

display, on the touch-sensitive secondary display, a second user interface that includes: (i) a plurality of application-specific affordances that control functions available within the application and (ii) at least one system-level affordance that controls a system-level function, wherein each of the plurality of application-specific affordances and the at least one system-level affordance are displayed with a first display size;

detect, via the touch-sensitive secondary display, an input that contacts at least one application-specific affordance of the plurality of application-specific affordances; and

in response to the detecting the input and while the input remains in contact with the touch-sensitive secondary display:

continue to display, on the primary display, the first user interface for the application;

display, on the primary display, a zoomed-in representation of the at least one application-specific affordance, wherein the zoomed-in representation of the at least one application-specific affordance is displayed with a second display size that is larger than the first display size.

14. The non-transitory computer-readable storage medium of claim 13 , wherein displaying the zoomed-in representation of the at least one application-specific affordance includes displaying the zoomed-in representation of the at least one application-specific affordance within a zoomed-in representation of the second user interface.

15. The non-transitory computer-readable storage medium of claim 14 , wherein displaying the zoomed-in representation of the second user interface includes displaying a focus indicator within the zoomed-in representation of the second user interface that is positioned based at least in part on a position on the touch-sensitive secondary display at which the input contacted the touch-sensitive secondary display.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the focus indicator includes a representation of a countdown timer and the executable instructions also cause the computing system to:

in accordance with a determination that the input has remained in contact with the at least one application-specific affordance for more than a predetermined amount of time, update the representation of the countdown timer to indicate that the countdown timer is active; and

in accordance with a determination that the countdown timer has expired, activate the at least one application-specific affordance.

17. The non-transitory computer-readable storage medium of claim 16 , wherein:

the at least one application-specific affordance is associated with a slider, and

activating the at least one application-specific affordance includes updating the zoomed-in representation of the at least one application-specific affordance in accordance with movement of the at least one application-specific affordance along the slider.

18. The non-transitory computer-readable storage medium of claim 13 , wherein the touch-sensitive secondary display includes a first area comprising the at least one application-specific affordance and a second area comprising other affordances distinct from the at least one application-specific affordance in the plurality of application-specific affordances, and the executable instructions also cause the computing system to:

while the input remains in contact with at least one application-specific affordance at the first area of the touch-sensitive secondary display, detect a tap gesture at the second area of the touch-sensitive secondary display; and

in response to detecting the tap gesture, activate the at least one application-specific affordance.

19. The non-transitory computer-readable storage medium of claim 13 , wherein the executable instructions also cause the computing system to:

detect, at the touch-sensitive secondary display, a predefined gesture that manipulates a zoom level that is used to display the zoomed-in representation of the at least one application-specific affordance at the primary display; and

in response to detecting the predefined gesture, update the zoomed-in representation at the primary display as the zoom level is manipulated using the predefined gesture.

20. The non-transitory computer-readable storage medium of claim 13 , wherein the zoomed-in representation of the at least one application-specific affordance is displayed on the primary display in accordance with a determination that the input has remained in continuous contact with the touch-sensitive secondary display for more than a predetermined amount of time.

21. The non-transitory computer-readable storage medium of claim 13 , wherein each of the plurality of application-specific affordances and the at least one system-level affordance are selectable via one or more inputs at the touch-sensitive secondary display.

22. The non-transitory computer-readable storage medium of claim 13 , wherein the second housing also at least partially contains a physical keyboard.

23. The non-transitory computer-readable storage medium of claim 13 , wherein the second housing is not connected to the first housing.

24. The non-transitory computer-readable storage medium of claim 13 , wherein the second housing is part of a wearable computing device.

25. A computing system, comprising:

one or more processors;

a first housing that includes a primary display;

a second housing at least partially containing a touch-sensitive secondary display that is distinct from the primary display; and

memory storing one or more programs that are configured for execution by the one or more processors, the one or more programs including instructions for:

operating the touch-sensitive secondary display in an accessibility mode;

while operating the touch-sensitive secondary display in the accessibility mode:

displaying, on the primary display, a first user interface for an application;

displaying, on the touch-sensitive secondary display, a second user interface that includes: (i) a plurality of application-specific affordances that control functions available within the application and (ii) at least one system-level affordance that controls a system-level function, wherein each of the plurality of application-specific affordances and the at least one system-level affordance are displayed with a first display size;

detecting, via the touch-sensitive secondary display, an input that contacts at least one application-specific affordance of the plurality of application-specific affordances; and

in response to the detecting the input and while the input remains in contact with the touch-sensitive secondary display:

continuing to display, on the primary display, the first user interface for the application;

displaying, on the primary display, a zoomed-in representation of the at least one application-specific affordance, wherein the zoomed-in representation of the at least one application-specific affordance is displayed with a second display size that is larger than the first display size.

26. The computing system of claim 25 , wherein displaying the zoomed-in representation of the at least one application-specific affordance includes displaying the zoomed-in representation of the at least one application-specific affordance within a zoomed-in representation of the second user interface.

27. The computing system of claim 26 , wherein displaying the zoomed-in representation of the second user interface includes displaying a focus indicator within the zoomed-in representation of the second user interface that is positioned based at least in part on a position on the touch-sensitive secondary display at which the input contacted the touch-sensitive secondary display.

28. The computing system of claim 27 , wherein the focus indicator includes a representation of a countdown timer and the one or more programs also include instructions for:

in accordance with a determination that the input has remained in contact with the at least one application-specific affordance for more than a predetermined amount of time, updating the representation of the countdown timer to indicate that the countdown timer is active; and

in accordance with a determination that the countdown timer has expired, activating the at least one application-specific affordance.

29. The computing system of claim 28 , wherein:

the at least one application-specific affordance is associated with a slider, and

activating the at least one application-specific affordance includes updating the zoomed-in representation of the at least one application-specific affordance in accordance with movement of the at least one application-specific affordance along the slider.

30. The computing system of claim 25 , wherein the touch-sensitive secondary display includes a first area comprising the at least one application-specific affordance and a second area comprising other affordances distinct from the at least one application-specific affordance in the plurality of application-specific affordances, and the one or more programs also include instructions for:

while the input remains in contact with at least one application-specific affordance at the first area of the touch-sensitive secondary display, detecting a tap gesture at the second area of the touch-sensitive secondary display; and

in response to detecting the tap gesture, activating the at least one application-specific affordance.

31. The computing system of claim 25 , wherein the one or more programs also include instructions for:

detecting, at the touch-sensitive secondary display, a predefined gesture that manipulates a zoom level that is used to display the zoomed-in representation of the at least one application-specific affordance at the primary display; and

in response to detecting the predefined gesture, updating the zoomed-in representation at the primary display as the zoom level is manipulated using the predefined gesture.

32. The computing system of claim 25 , wherein the zoomed-in representation of the at least one application-specific affordance is displayed on the primary display in accordance with a determination that the input has remained in continuous contact with the touch-sensitive secondary display for more than a predetermined amount of time.

33. The computing system of claim 25 , wherein each of the plurality of application-specific affordances and the at least one system-level affordance are selectable via one or more inputs at the touch-sensitive secondary display.

34. The computing system of claim 25 , wherein the second housing also at least partially contains a physical keyboard.

35. The computing system of claim 25 , wherein the second housing is not connected to the first housing.

36. The computing system of claim 25 , wherein the second housing is part of a wearable computing device.

Continuity (3)
Continuation 15791251 · Oct 23, 2017
Provisional Application 62412752 · Oct 25, 2016
Related Publication 20200264764A1 · Aug 20, 2020