Context-sensitive customization of remote-control unit
A method of customizing contextual controls of a remote-control unit (RCU) having a plurality of user interface elements is disclosed. A processor within the RCU receives context information from an integrated output device that includes an output mechanism, the context information being related to an active application being run on the integrated output device and an active object being presented by the active application. The processor determines a set of actions that can be performed on the active object within the active application. The processor dynamically maps actions to user interface elements of the RCU based on the context information. The processor receives a selection of a user interface element and sends a request from the RCU to the integrated output device specifying an action mapped to the user interface element to be performed on the active object and the active application.
1. A computer-implemented method of customizing contextual controls of a remote-control unit having a plurality of user interface elements, comprising:
receiving, by a processor within the remote-control unit, context information from an integrated output device that includes an output mechanism, the context information being related to an active application being run on the integrated output device and an active object being presented by the active application to the output mechanism;
determining, by the processor, a set of actions that can be performed on the active object within the active application;
dynamically mapping, by the processor, one or more actions of the set of actions to one or more user interface elements of the plurality of user interface elements of the remote-control unit based on the context information, comprising:
determining a most frequently performed action within the set of actions based on a usage history of a user or group of users;
determining a most frequently selected user interface element within the plurality of user interface elements based on the usage history; and
mapping the most frequently performed action to the most frequently selected user interface element;
receiving, after the mapping, a selection of a user interface element of the one or more user interface elements; and
sending a request from the remote-control unit to the integrated output device specifying an action mapped to the user interface element to be performed on the active object and the active application.
2. The method of claim 1 , wherein the plurality of user interface elements comprises one or more physical control elements comprising at least one of a button, a scroll wheel, a dial, or a rocker switch.
3. The method of claim 1 , wherein the remote-control unit comprises a touchscreen and wherein the plurality of user interface elements comprise a plurality of predetermined touchscreen gestures in a predetermined layout.
4. The method of claim 1 , wherein the remote-control unit comprises a plurality of motion sensors and a plurality of angular rate sensors and wherein the plurality of user interface elements comprises a plurality of motion gestures that indicate motion of the remote-control unit.
5. The method of claim 1 , wherein the remote-control unit comprises a microphone and wherein dynamically mapping the one or more actions to the one or more user interface elements comprises determining that the remote-control unit is in a voice input mode, wherein the one or more user interface elements are predetermined utterances spoken at predetermined volume ranges.
6. The method of claim 1 , wherein the active application is configured with an extension or plugin that is configured to provide the context information to the remote-control unit.
7. The method of claim 1 , wherein the context information includes a list of applications installed on the integrated output device and a set of actions that can be performed by each of the applications in the list.
8. The method of claim 1 , wherein the context information comprises a current position within the active object and the one or more actions comprise at least one action for navigating within the active object based on the current position.
9. The method of claim 1 , wherein:
the active application presents a complex object having a hierarchy,
the active object is at a particular level of the hierarchy, and
the method further comprises mapping at least one action of navigating to a different level of the hierarchy to at least one user interface elements of the plurality of user interface elements of the remote-control unit.
10. The method of claim 1 , wherein:
the active application presents a layered object having a plurality of layers of content being presented at a same position on the integrated output device,
the active object is a first layer of content within the plurality of layers of content,
the method further comprises mapping a set of layer manipulation actions to a set of user interface elements of the remote-control unit, and
the set of layer manipulation actions comprise at least one of turning off display of the first layer of content, turning on display of the first layer of content, navigating to a second layer of content within the plurality of layers of content, rearranging an order of the plurality of layers of content.
11. The method of claim 1 , wherein receiving the context information comprises periodically querying the integrated output device for the context information.
12. The method of claim 1 , wherein:
the active object is a multi-media object comprising a set of embedded objects,
the one or more actions includes a specific action of navigating to a selected embedded object within the set of embedded objects, and
the method further comprises determining a new set of actions that can be performed on the selected embedded object in response to selection of a user interface element mapped to the specific action and dynamically mapping the new set of actions to the one or more user interface elements.
13. The method of claim 12 , wherein:
the active object is a web page or presentation document,
the selected embedded object is a video object or audio object, and
the one or more actions include at least one of a play control, a pause control, a rewind control, a fast forward control, a zoom-in or a volume-up, or a zoom-out or a volume-down.
14. The method of claim 12 , wherein the plurality of user interface elements comprises a control for navigating from the selected embedded object back to the active object.
15. The method of claim 1 , wherein receiving the context information from the integrated output device comprises receiving the context information from a dongle coupled to the integrated output device and wherein sending the request from the remote-control unit to the integrated output device comprises sending the request to the dongle.
16. A remote-control unit, comprising:
a processor; and
a memory storing instructions which, when executed by the processor, cause performance of a method of managing human-computer interaction, the method comprising:
receiving context information from an integrated output device that includes an output mechanism, the context information being related to an active application being run on the integrated output device and an active object being presented by the active application to the output mechanism;
determining, by the processor, a set of actions that can be performed on the active object within the active application;
dynamically mapping, by the processor, one or more actions of the set of actions to one or more user interface elements of a plurality of user interface elements of the remote-control unit based on the context information, comprising:
determining a most frequently performed action within the set of actions based on a usage history of a user or group of users;
determining a most frequently selected user interface element within the plurality of user interface elements based on the usage history; and
mapping the most frequently performed action to the most frequently selected user interface element;
receiving, after the mapping, a selection of a user interface element of the one or more user interface elements; and
sending a request from the remote-control unit to the integrated output device specifying an action mapped to the user interface element to be performed on the active object and the active application.
17. The remote-control unit of claim 16 , wherein:
the active object is a multi-media object comprising a set of embedded objects,
the one or more actions includes a specific action of navigating to a selected embedded object within the set of embedded objects, and
the method further comprises determining a new set of actions that can be performed on the selected embedded object in response to selection of a user interface element mapped to the specific action and dynamically mapping the new set of actions to the one or more user interface elements.
18. The remote-control unit of claim 16 , wherein:
the active application presents a complex object having a hierarchy,
the active object is at a particular level of the hierarchy, and
the method further comprises mapping at least one action of navigating to a different level of the hierarchy to at least one user interface elements of the plurality of user interface elements of the remote-control unit.
19. One or more non-transitory storage media storing instructions which, when executed by one or more computing devices, cause performance of a method of customizing contextual controls of a remote-control unit having a plurality of user interface elements, the method comprising:
receiving, by a processor within the remote-control unit, context information from an integrated output device that includes an output mechanism, the context information being related to an active application being run on the integrated output device and an active object being presented by the active application to the output mechanism,
the active object being a multi-media object comprising a set of embedded objects;
determining, by the processor, a set of actions that can be performed on the active object within the active application;
dynamically mapping, by the processor, one or more actions of the set of actions to one or more user interface elements of the plurality of user interface elements of the remote-control unit based on the context information,
the one or more actions including a specific action of navigating to a selected embedded object within the set of embedded objects;
receiving, after the mapping, a selection of a user interface element of the one or more user interface elements, the user interface element being mapped to the specific action;
sending a request from the remote-control unit to the integrated output device specifying the specific action to be performed on the active object and the active application;
determining a new set of actions that can be performed on the selected embedded object in response to the selection;
dynamically mapping the new set of actions to the one or more user interface elements.