GENERATING COMPOUND ACTION LINKS IN A MULTI-MODAL NETWORKED ENVIRONMENT
A method comprises determining a threshold based on a shape or size of a graphical user interface (GUI); selecting one or more sequences of digital actions (actions) as one or more compound actions from a list of sequences of actions, the one sequence of actions being performed by multiple computer devices of a plurality of computer devices, including at least one input device and at least one output device, the one or more sequences of actions having a total number of sequences that is no more than the threshold and satisfying a set of criteria related to a number of actions in each sequence of actions; creating a deep link as a shortcut representing a specific compound action, the shortcut when invoked causing performing the specific compound action and producing a specific result; causing presenting the shortcut as an UI element in the GUI.
1 . A computer-implemented method of improving user operation with multiple computer devices, comprising:
determining a threshold based on a shape or size of a graphical user interface (GUI);
selecting, by a processor, one or more sequences of digital actions (actions) as one or more compound actions from a list of sequences of actions,
the one sequence of actions of the one or more sequences of actions being performed by multiple computer devices of a plurality of computer devices, including at least one input device and at least one output device,
the one or more sequences of actions having a total number of sequences that is no more than the threshold and satisfying a set of criteria related to a number of actions in each sequence of actions;
creating, by the processor, a deep link as a shortcut representing a specific compound action of the one or more compound actions,
the shortcut when invoked causing performing the specific compound action and producing a specific result;
causing presenting the shortcut as an UI element in the GUI.
2 . The computer-implemented method of claim 1 , further comprising
receiving, from the plurality of computer devices, tracked action data including, for each action of a plurality of actions, a device identifier identifying a computer device which performed the action, a timestamp indicating when the action was performed, a user identifier identifying a user who issued a user command to perform the action, or an action identifier identifying the action performed,
the one or more sequences of actions being extracted from the tracked action data.
3 . The computer-implemented method of claim 2 , further comprising:
extracting, from the tracked action data, a certain series of actions resulting from user commands issued sequentially by one user;
using the timestamp associated with each action of the certain series of actions, grouping the certain series of actions into a plurality of sequences of actions;
calculating a frequency of occurrence for each sequence of actions of the plurality of sequences of actions as a normalized frequency with respect to other sequences of actions that occur in a common duration.
4 . The computer-implemented method of claim 2 , further comprising
generating a generalized action associated with one or more users from the tracked action data,
the generalized action incorporating parameters to be given values at run time, which represent a computer device, a computer application, or a parameter of the computer application.
5 . The computer-implemented method of claim 1 , the one sequence of actions including an action corresponding to a user interaction with an input device of the at least one input device or an output device of the at least one output device.
6 . The computer-implemented method of claim 1 , the set of criteria being further related to a frequency of occurrence of each sequence of actions.
7 . The computer-implemented method of claim 1 , the specific compound action leading to the specific result, including performance of an input operation by a specific input device of the at least one input device or performance of an output operation by a specific output device of the at least one output device.
8 . The computer-implemented method of claim 1 , the shortcut being invoked via a single gesture or utterance or an automatic conditional trigger.
9 . The computer-implemented method of claim 1 , the shortcut being presented via a specific output device of the at least one output device.
10 . The computer-implemented method of claim 1 , the one or more sequences of actions maximizing a sum of, for each sequence, a product of the number of actions in the sequence raised to a power related to the number of actions in the sequence and a frequency of occurrence of the sequence.
11 . The computer-implemented method of claim 1 , the UI element indicating multiple input modes, including a first mode to accept a physical interaction with the UI element as a selection of the UI element and a second mode to accept a specific utterance as a voice command associated with the specific compound action as the selection of the UI element.
12 . The computer-implemented method of claim 1 , further comprising causing replacing the UI element with a second UI element in the GUI representing a second deep link associated with a second compound action based on a frequency of invocation of the second deep link by one or more users during a recent period of time.
13 . One or more computer-readable non-transitory storage media storing instructions which, when executed by one or more processors, cause performance of a method of improving user operation with multiple computer devices, the method comprising:
determining a threshold based on a shape or size of a graphical user interface (GUI);
selecting one or more sequences of digital actions (actions) as one or more compound actions from a list of sequences of actions,
the one sequence of actions of the one or more sequences of actions being performed by multiple computer devices of a plurality of computer devices, including at least one input device and at least one output device,
the one or more sequences of actions having a total number of sequences that is no more than the threshold and satisfying a set of criteria related to a number of actions in each sequence of actions;
creating a deep link as a shortcut representing a specific compound action of the one or more compound actions, the shortcut when invoked causing performing the specific compound action and producing a specific result;
causing presenting the shortcut as an UI element in the GUI.
14 . The one or more computer-readable non-transitory storage media of claim 13 , the method further comprising
receiving, from the plurality of computer devices, tracked action data including, for each action of a plurality of actions, a device identifier identifying a computer device which performed the action, a timestamp indicating when the action was performed, a user identifier identifying a user who issued a user command to perform the action, or an action identifier identifying the action performed,
the one or more sequences of actions being extracted from the tracked action data.
15 . The one or more computer-readable non-transitory storage media of claim 14 , the method further comprising
generating a generalized action associated with one or more users from the tracked action data,
the generalized action incorporating parameters to be given values at run time, which represent a computer device, a computer application, or a parameter of the computer application.
16 . The one or more computer-readable non-transitory storage media of claim 13 , the one sequence of actions including an action corresponding to a user interaction with an input device of the at least one input device or an output device of the at least one output device.
17 . The one or more computer-readable non-transitory storage media of claim 13 , the set of criteria being further related to a frequency of occurrence of each sequence of actions.
18 . The one or more computer-readable non-transitory storage media of claim 13 , the specific compound action leading to the specific result, including performance of an input operation by a specific input device of the at least one input device or performance of an output operation by a specific output device of the at least one output device.
19 . The one or more computer-readable non-transitory storage media of claim 13 , the UI element indicating multiple input modes, including a first mode to accept a physical interaction with the UI element as a selection of the UI element and a second mode to accept a specific utterance as a voice command associated with the specific compound action as the selection of the UI element.
20 . The one or more computer-readable non-transitory storage media of claim 13 , the method further comprising causing replacing the UI element with a second UI element in the GUI representing a second deep link associated with a second compound action based on a frequency of invocation of the second deep link by one or more users during a recent period of time.