Systems and methods for interacting with displayed items
Disclosed herein includes a system, a method, and a device for interacting with displayed items. A contact point can be established with a surface of a contact panel and the contact panel can be operated in a navigation mode during which a selection element, for selecting one or more items of a user interface (UI) in a display of a second device, is maintained at a determined location in the display. The UI can be moved in the display relative to the selection element as the selection element is maintained at the determined location, by moving the contact point on the surface of the contact panel in the navigation mode. At least one item of the UI that is moved within a selection threshold of the selection element can be selected by removing the contact point with the contact panel.
1 . A method comprising:
maintaining a selection element at a predetermined location on a user interface output in a display of a wearable display device;
maintaining a plurality of items displayable on the user interface in a non-visible state;
establishing contact with a contact panel of an additional device that is different from the wearable display;
displaying for view, responsive to the establishing of the contact, the plurality of elements on the display;
performing, while maintaining the contact with the contact panel, a sliding motion;
moving the user interface, responsive to the sliding motion, from a first position on the display to a second position on the display, the user interface including a first item of the plurality of items, the first item being at a selection threshold of the selection element responsive to the moving of the user interface to the second position;
generating a haptic response upon the first item being at the selection threshold of the selection element, the haptic response indicative of activation of a selection mode in which the first item is selectable using the selection element;
discontinuing the contact with the contact panel; and
initiating the selection of the first item if a duration from the establishing of the contact to the discontinuing of the contact meets a threshold value.
2 . The method of claim 1 , comprising:
determining, via the contact panel, a first direction of movement of the sliding motion on the contact panel; and
transmitting, by the contact panel, a signal to a processor of the display to render an image of the user interface including the first item moving in a direction in accordance with the first direction of movement of the sliding motion.
3 . The method of claim 1 , wherein:
the moving of the user interface including the first item is at a speed that is relative to a speed of movement of the sliding motion.
4 . The method of claim 1 , further comprising:
the moving of the user interface including the first item is by a spatial displacement that is relative to that of the sliding motion.
5 . The method of claim 1 , wherein the first item includes at least one of an icon, a symbol, a text element, a keypad element, an image, a file or folder, or an artificial reality object.
6 . A system comprising:
a contact panel;
a wearable display device including a display; and
one or more processors configured to:
maintain a selection element at a predetermined location on a user interface output in the display;
maintain a plurality of items displayable on the user interface in a non-visible state;
establish contact with the contact panel of an additional device that is different from the display of the wearable display device;
display for view, responsive to the establishing of the contact, the plurality of elements on the display;
perform, while maintaining the contact with the contact panel, a sliding motion;
move the user interface, responsive to the sliding motion, from a first position on the display to a second position on the display, the user interface including a first item of a plurality of items, the first item being at a selection threshold of the selection element responsive to the moving of the user interface to the second position;
generate a haptic response upon the first item being at the selection threshold of the selection element, the haptic response indicative of activation of a selection mode in which the first item is selectable using the selection element;
discontinue the contact with the contact panel; and
initiate the selection of the first item if a duration from the establishing of the contact to the discontinuing of the contact meets a threshold value.
7 . The system of claim 6 , wherein the one or more processors are further configured to:
determine a first direction of movement of the sliding motion on the contact panel; and
transmit a signal to a processor of the display to render an image of the user interface moving in a direction in accordance with the first direction of movement of the sliding motion.
8 . The system of claim 6 , wherein the moving of the user interface
by the one or more processors is at a speed that is relative to a speed of movement of the sliding motion.
9 . The system of claim 6 , wherein the moving of the user interface by the one or more processors is by a spatial displacement that is relative to that of the sliding motion.
10 . The system of claim 6 , wherein the first item includes at least one of an icon, a symbol, a text element, a keypad element, an image, a file or folder, or an artificial reality object.
11 . A non-transitory computer readable medium storing instructions when executed by one or more processors cause the one or more processors to:
maintain a selection element at a predetermined location on a user interface output in a display of a wearable display device;
maintain a plurality of items displayable on the user interface in a non-visible state;
establish contact with a contact panel of an additional device that is different from the wearable display;
display for view, responsive to the establishing of the contact, the plurality of elements on the display;
perform, while maintaining the contact with the contact panel, a sliding motion;
move the user interface, responsive to the sliding motion, from a first position on the display to a second position on the display, the user interface including a first item of the plurality of items, the first item being at a selection threshold of the selection element responsive to the moving of the user interface to the second position;
generate a haptic response upon the first item being at the selection threshold of the selection element, the haptic response indicative of activation of a selection mode in which the first item is selectable using the selection element;
discontinue the contact with the contact panel; and
initiate the selection of the first item if a duration from the establishing of the contact to the discontinuing of the contact meets a threshold value.
12 . The non-transitory computer readable medium of claim 11 , further storing instructions when executed by the one or more processors cause the one or more processors to:
determine a first direction of movement of the sliding motion on the contact panel; and
transmit a signal to a processor of the display to render an image of the user interface moving in a direction in accordance with the first direction of movement of the sliding motion.
13 . The non-transitory computer readable medium of claim 11 , wherein the moving of the user interface based on the execution of the stored instructions by the one or more processors is at a speed that is relative to a speed of movement of the sliding motion.
14 . The non-transitory computer readable medium of claim 11 , wherein the first item includes at least one of an icon, a symbol, a text element, a keypad element, an image, a file or folder, or an artificial reality object.