Spoken interfaces
View Patent ↗A spoken interface is described for assisting a visually impaired user to obtain audible information and interact with elements displayed on a display screen. The spoken interface also enables access and control of other elements that are hidden by other windows. The interface receives user input data representing user inputs received by an input device and uses a movable selector to select an element of an application. The element selected by the selector may be either an editing type element or non-editing type element. The interface provides audio information regarding the selected editing or non-editing element and enables interaction with the selected element.
1. A method, comprising:
at a computing device with a display:
providing a plurality of user interface objects on a desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;
providing a pointer cursor and an accessibility cursor that is distinct from the pointer cursor;
while the first user interface object is completely visually obscured by the active application window, detecting a user input accessing the first user interface object with the accessibility cursor, independently of the pointer cursor; and
while the accessibility cursor is accessing the first user interface object, visually revealing the first user interface element from behind the active application window.
2. The method of claim 1 , wherein visually revealing the first user interface element from behind the active application window is temporary.
3. The method of claim 2 , wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window lasts for a duration that a predetermined keyboard input is maintained by a user.
4. The method of claim 2 , wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window includes temporarily presenting a magnified view of the first user interface element over the active application window.
5. The method of claim 1 , further comprising:
while the accessibility cursor is accessing the first user interface object, providing an audible description of the first user interface element.
6. The method of claim 1 , wherein the user input accessing the first user interface object with the accessibility cursor is a user input that moves the accessibility cursor within one or more background applications.
7. A computing device, comprising:
a display;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
providing a plurality of user interface objects on a desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;
providing a pointer cursor and an accessibility cursor that is distinct from the pointer cursor;
while the first user interface object is completely visually obscured by the active application window, detecting a user input accessing the first user interface object with the accessibility cursor, independently of the pointer cursor; and
while the accessibility cursor is accessing the first user interface object, visually revealing the first user interface element from behind the active application window.
8. The device of claim 7 , wherein visually revealing the first user interface element from behind the active application window is temporary.
9. The device of claim 8 , wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window lasts for a duration that a predetermined keyboard input is maintained by a user.
10. The device of claim 8 , wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window includes temporarily presenting a magnified view of the first user interface element over the active application window.
11. The device of claim 7 , wherein the one or more programs further include instructions for:
while the accessibility cursor is accessing the first user interface object, providing an audible description of the first user interface element.
12. The device of claim 7 , wherein the user input accessing the first user interface object with the accessibility cursor is a user input that moves the accessibility cursor within one or more background applications.
13. A non-transitory computer readable medium having stored therein instructions, which when executed by a device with a touch screen display, cause the device to:
provide a plurality of user interface objects on a desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;
provide a pointer cursor and an accessibility cursor that is distinct from the pointer cursor;
while the first user interface object is completely visually obscured by the active application window, detect a user input accessing the first user interface object with the accessibility cursor, independently of the pointer cursor; and
while the accessibility cursor is accessing the first user interface object, visually reveal the first user interface element from behind the active application window.
14. The non-transitory computer readable medium of claim 13 , wherein visually revealing the first user interface element from behind the active application window is temporary.
15. The non-transitory computer readable medium of claim 14 , wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window lasts for a duration that a predetermined keyboard input is maintained by a user.
16. The non-transitory computer readable medium of claim 14 , wherein temporarily revealing the visual appearance of the first user interface element that is hidden behind the active application window includes temporarily presenting a magnified view of the first user interface element over the active application window.
17. The non-transitory computer readable medium of claim 13 , wherein the instructions further cause the device to:
while the accessibility cursor is accessing the first user interface object, provide an audible description of the first user interface element.
18. The non-transitory computer readable medium of claim 13 , wherein the user input accessing the first user interface object with the accessibility cursor is a user input that moves the accessibility cursor within one or more background applications.
19. A graphical user interface on a computing device with a touch screen display, comprising:
a desktop;
a plurality of user interface objects provided on the desktop, the plurality of user interface objects including an active application window and a first user interface object that is completely visually obscured by the active application window;
a pointer cursor; and
an accessibility cursor that is distinct from the pointer cursor, wherein:
while the first user interface object is completely visually obscured by the active application window, a user input accessing the first user interface object with the accessibility cursor independently of the pointer cursor is detected; and
while the accessibility cursor is accessing the first user interface object, the first user interface element is visually revealed from behind the active application window.