Customizing user interface controls around a cursor
Systems and methods are provided for customizing user interface controls around a cursor. One example method includes receiving, at a computing device, a request to display an indicator menu and identifying at least one user interface element of a program being executed at the computing device. An interaction frequency for each identified user interface element is generated. In response to the request and for each identified user interface element, a spatial relationship between an indicator of the computing device and the identified user interface element is determined. Based on the interaction frequency value and the determined spatial relationship, an element set comprising one or more of the identified user interface elements is generated. The indicator menu comprising at least a portion of the element set is generated for display. The indicator menu is displayed proximate the indicator on a display of the computing device.
1. A method for displaying an indicator menu proximate an indicator, the method comprising:
receiving, at a computing device, a request to display the indicator menu;
identifying at least one user interface (UI) element;
determining an interaction frequency value for each identified UI element;
determining, based at least in part on the request and for each identified UI element, a spatial relationship between the indicator of the computing device and the identified UI element by determining a distance between the indicator and the identified UI element;
generating, based at least in part on the interaction frequency value and the determined spatial relationship, a UI element set comprising one or more of the identified UI elements, wherein generating the UI element set comprises:
determining, for each identified UI element, whether the distance exceeds a threshold distance and, where the distance exceeds the threshold distance, adding the identified UI element to the UI element set;
determining whether the number of UI elements in the UI element set exceeds a threshold element value; and
removing from the UI element set, based at least in part on the interaction frequency value for each identified UI element, UI elements until the number of UI elements no longer exceeds the threshold element value;
generating, for display, the indicator menu comprising at least a portion of the UI element set; and
displaying, proximate the indicator, the indicator menu on a display of the computing device.
2. The method of claim 1 , wherein:
the indicator is an augmented reality indicator displayed in an augmented reality environment generated by the computing device;
identifying at least one UI element further comprises identifying each UI element that has a location that is independent of a real-world object;
determining the spatial relationship for each identified UI element further comprises determining a distance between the augmented reality indicator and the identified UI element; and
generating the UI element set further comprises determining, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, adding the identified UI element to the UI element set.
3. The method of claim 1 , wherein:
the indicator is an augmented reality indicator displayed in an augmented reality environment generated by the computing device, the augmented reality indicator having a notional world position;
identifying at least one UI element further comprises identifying each UI element that has a location that is associated with a real-world object;
determining the spatial relationship for each identified UI element further comprises determining a world distance between the notional world position of the augmented reality indicator and the real-world object associated with the UI element; and
generating the UI element set further comprises determining, for each identified UI element, whether the world distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, adding the identified UI element to the UI element set.
4. The method of claim 1 , wherein:
the indicator is a cursor displayed on the display of the computing device;
determining the spatial relationship for each identified UI element further comprises determining a distance between the cursor and each identified UI element; and
generating the UI element set further comprises determining, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, adding the identified UI element to the UI element set.
5. The method of claim 1 , wherein:
the indicator is a touch event at the display of the computing device;
determining the spatial relationship for each identified UI element further comprises determining a distance between the touch event and each identified UI element; and
generating the UI element set further comprises determining, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, adding the identified UI element to the UI element set.
6. The method of claim 1 , wherein:
the indicator is a virtual reality indicator displayed in a virtual reality environment generated by the computing device;
identifying at least one UI element further comprises identifying each UI element that has a location that is independent of a virtual reality object;
determining the spatial relationship for each identified UI element further comprises determining a distance between the virtual reality indicator and the identified UI element; and
generating the UI element set further comprises determining, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, adding the identified UI element to the UI element set.
7. The method of claim 1 , wherein:
the indicator is a virtual reality indicator displayed in a virtual reality environment generated by the computing device, the virtual reality indicator having a virtual reality environment position;
identifying at least one UI element further comprises identifying each UI element that has a location that is associated with a virtual reality environment object;
determining the spatial relationship for each identified UI element further comprises determining a virtual reality environment distance between the virtual reality environment position of the virtual reality indicator and the virtual reality environment object associated with the UI element; and
generating the UI element set further comprises determining, for each identified UI element, whether the virtual reality environment distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, adding the identified UI element to the UI element set.
8. The method of claim 1 , wherein the identified UI element is of a media player and comprises at least one of X-ray, subtitles, volume, expand, close, rewind or fast-forward.
9. The method of claim 1 , wherein:
determining the spatial relationship further comprises determining the distance between the indicator and the identified UI element; and
generating the UI element set further comprises determining whether the distance exceeds 25% of a diagonal length of the display and, where the distance exceeds 25% of the diagonal length of the display, adding the identified UI element to the UI element set.
10. A system for displaying an indicator menu proximate an indicator, the system comprising:
a communication port; and
control circuitry configured to:
receive, at a computing device, a request to display the indicator menu;
identify at least one user interface (UI) element;
generate an interaction frequency value for each identified UI element;
determine, based at least in part on the request and for each identified UI element, a spatial relationship between the indicator of the computing device and the identified UI element by determining a distance between the indicator and the identified UI element;
generate, based at least in part on the interaction frequency value and the determined spatial relationship, an element set comprising one or more of the identified UI elements, wherein generating the element set comprises:
determining, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, adding the identified UI element to the element set;
determining whether the number of UI elements in the element set exceeds a threshold element value; and
removing from the element set, based at least in part on the interaction frequency value for each identified UI element, UI elements until the number of UI elements no longer exceeds the threshold element value;
generate, for display, the indicator menu comprising at least a portion of the element set; and
display, proximate the indicator, the indicator menu on a display of the computing device.
11. The system of claim 10 , wherein:
the indicator is an augmented reality indicator displayed in an augmented reality environment generated by the computing device;
the control circuitry configured to identify at least one UI element is further configured to identify each UI element that has a location that is independent of a real-world object;
the control circuitry configured to determine the spatial relationship for each identified UI element is further configured to determine a distance between the augmented reality indicator and the identified UI element; and
the control circuitry configured to generate the element set is further configured to determine, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, add the identified UI element to the element set.
12. The system of claim 10 , wherein:
the indicator is an augmented reality indicator displayed in an augmented reality environment generated by the computing device, the augmented reality indicator having a notional world position;
the control circuitry configured to identify at least one UI element is further configured to identify each UI element that has a location that is associated with a real-world object;
the control circuitry configured to determine the spatial relationship for each identified UI element is further configured to determine a world distance between the notional world position of the augmented reality indicator and the real-world object associated with the UI element; and
the control circuitry configured to generate the element set is further configured to determine, for each identified UI element, whether the world distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, add the identified UI element to the element set.
13. The system of claim 10 , wherein:
the indicator is a cursor displayed on the display of the computing device;
the control circuitry configured to determine the spatial relationship for each identified UI element is further configured to determine a distance between the cursor and each identified UI element; and
the control circuitry configured to generate the element set is further configured to determine, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, add the identified UI element to the element set.
14. The system of claim 10 , wherein:
the indicator is a touch event at the display of the computing device;
the control circuitry configured to determine the spatial relationship for each identified UI element is further configured to determine a distance between the touch event and each identified UI element; and
the control circuitry configured to generate the element set is further configured to determine, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, add the identified UI element to the element set.
15. The system of claim 10 , wherein:
the indicator is a virtual reality indicator displayed in a virtual reality environment generated by the computing device;
the control circuitry configured to identify at least one UI element is further configured to identify each UI element that has a location that is independent of a virtual reality object;
the control circuitry configured to determine the spatial relationship for each identified UI element is further configured to determine a distance between the virtual reality indicator and the identified UI element; and
the control circuitry configured to generate the element set is further configured to determine, for each identified UI element, whether the distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, add the identified UI element to the element set.
16. The system of claim 10 , wherein:
the indicator is a virtual reality indicator displayed in a virtual reality environment generated by the computing device, the virtual reality indicator having a virtual reality environment position;
the control circuitry configured to identify at least one UI element is further configured to identify each UI element that has a location that is associated with a virtual reality environment object;
the control circuitry configured to determine the spatial relationship for each identified UI element is further configured to determine a virtual reality environment distance between the virtual reality environment position of the virtual reality indicator and the virtual reality environment object associated with the UI element; and
the control circuitry configured to generate the element set is further configured to determine, for each identified UI element, whether the virtual reality environment distance exceeds a threshold distance value and, where the distance exceeds the threshold distance value, add the identified UI element to the element set.
17. The system of claim 10 , wherein the identified UI element is of a media player and comprises at least one of X-ray, subtitles, volume, expand, close, rewind or fast-forward.
18. The system of claim 10 , wherein:
the control circuitry configured to determine the spatial relationship is further the indicator and the identified configured to determine the distance between UI element; and
the control circuitry configured to generate the element set is further configured to determine whether the distance exceeds 25% of a diagonal length of the display and, where the distance exceeds 25% of the diagonal length of the display, add the identified UI element to the element set.