Screen interface for a mobile device apparatus
A system, method, and computer program product are provided to: display, utilizing a display, a plurality of triggers including: a time, a location, an application, a network connectivity, a connectivity with at least one other device, and a vocal input; detect, utilizing a touch surface, a touch on at least one of the plurality of triggers; display, utilizing the display, a plurality of actions including: a first application action including a first action of a first application, a second application action including a second action of a second application, and a third application action including third action of a third application; detect, utilizing the touch surface, a touch on at least one of the plurality of actions; based on the detection of the touch on the at least one trigger and the touch on the at least one action: store, utilizing memory, an instruction that includes the at least one trigger and the at least one action; detect whether the at least one trigger has been triggered; and in response to the detection that the at least one trigger has been triggered, perform the at least one action based on the instruction, utilizing the device.
1. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by a device including a display, a microphone, a speaker, and a touch surface, cause the device to:
display, utilizing the display, a plurality of triggers including: a time, a location, an application, a network connectivity, at least one aspect of at least one other device, and a user input via a vocal input;
detect, utilizing the touch surface, a touch on at least one of the plurality of triggers;
display, utilizing the display, a plurality of actions including: a first application action including a first action of a first application, a second application action including a second action of a second application, and a third application action including a third action of a third application;
detect, utilizing the touch surface, a touch on at least one of the plurality of actions;
based on the detection of the touch on the at least one trigger and the touch on the at least one action: store an instruction that includes the at least one trigger and the at least one action;
detect whether the at least one trigger has been triggered; and
in response to the detection that the at least one trigger has been triggered, perform the at least one action based on the instruction, utilizing the device.
2. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that one selected from the group of:
the display and the touch surface are components of a touch screen;
the plurality of triggers are displayed utilizing the same user interface;
the plurality of triggers are not displayed utilizing the same user interface;
all of the plurality of triggers are displayed so that they are capable of being selected, even though only a portion of the plurality of triggers are selected;
the user input via the vocal input, includes user voice input;
the instruction is not one of the instructions, when executed by the device, cause the device to operate;
the time is explicitly customized;
the time is triggered upon the time arriving;
the time is triggered upon the time passing;
the location is explicitly customized;
the location is triggered upon arriving at the location;
the location is triggered upon departing from the location;
the location is triggered upon arriving within a predetermined distance from the location;
the application is explicitly customized;
the application is triggered upon opening the application;
the application is triggered upon performing a function using the application;
the network connectivity is explicitly customized;
the network connectivity is triggered upon connecting to a particular network;
the connectivity with at least one other device is explicitly customized;
the connectivity with at least one other device is triggered upon connecting to the at least one other device;
the connectivity with at least one other device is triggered upon performing a function using the at least one other device;
the vocal input is explicitly customized;
the vocal input is triggered by detecting the vocal input using the microphone;
the plurality of triggers are displayed using representative indicia such that the touch on at least one of the plurality of triggers is detected via the respective representative indicia;
the first action is capable of being performed utilizing the first application;
the first action is capable of being performed utilizing the first application under user control;
the first action is capable of being automatically performed utilizing the first application;
the plurality of actions are displayed using representative indicia such that the touch on at least one of the plurality of actions is detected via the respective representative indicia;
the instruction is stored based on the detection of the touch on the at least one trigger and the touch on the at least one action, by being stored in response to the detection of the touch on the at least one trigger and the touch on the at least one action;
the instruction is stored based on the detection of the touch on the at least one trigger and the touch on the at least one action, by being stored in response to detection of a particular one or more user inputs after the detection of the touch on the at least one trigger and the touch on the at least one action;
it is detected whether the at least one trigger has been triggered using software of the device;
it is detected whether the at least one trigger has been triggered using hardware of the device;
it is detected whether the at least one trigger has been triggered using at least one other device;
the at least one action is performed in response to the detection that the at least one trigger has been triggered, by being performed in immediate response to the detection that the at least one trigger has been triggered;
the at least one action is performed in response to the detection that the at least one trigger has been triggered, by being performed after at least one intermediate operation that is performed in response to the detection that the at least one trigger has been triggered;
the at least one action is performed based on the instruction, by using the instruction;
the at least one action is performed based on the instruction, by being performed under control of the instruction;
the at least one action is performed utilizing the device, by using at least one component of the device; or
the at least one action is performed utilizing the device, by being at least partially performed by the device and being at least partially performed by at least one other device;
and
wherein the device is configured for determining a location associated with the device;
determining a presence of at least one other person at the location; and automatically displaying a graphical user interface associated with the determined location and the determined presence of the at least one other person, wherein the device is further configured for determining that the location is proximate to a previously identified item of interest; and
displaying another graphical user interface associated with the determined location and the previously identified item of interest.
3. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that the plurality of triggers further include: opening of a predetermined application, receipt of a short message service (SMS) message, receipt of a notification, a battery level reaching a predetermined threshold, utilization of a gaming application, a calendar-based trigger, and receipt of a call from a predetermined caller, where the time includes a time range and a specific time.
4. The non-transitory computer readable storage medium of claim 3 , wherein the instructions, when executed by the device, cause the device to operate such that the plurality of triggers further include: receipt of an SMS message from a predetermined contact, receipt of a notification with a predetermined keyword, and receipt of a notification associated with a predetermined application.
5. The non-transitory computer readable storage medium of claim 3 , wherein the instructions, when executed by the device, cause the device to operate such that multiple of the plurality of triggers are included with the instruction, and all of the multiple of the plurality of triggers are required to be triggered for the at least one action to be performed.
6. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that the plurality of actions further include a data synchronization, a mute action, a volume increase action, a color control action, a Bluetooth-enabled content sharing action, a lockscreen action, a music play action, a start application action, a navigate to a website action, a record action, an action involving multiple different applications, and a call rejection action.
7. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that the plurality of actions further include a display of actions that, in response to a selection thereof, a selected action is performed.
8. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that the device learns a sequence of triggers and, based on the learned sequence of triggers, recommends at least one recommended instruction, and, based on a receipt of a selection of the at least one recommended instruction to be saved and in response to detection that the sequence of triggers has been triggered, utilizes the at least one recommended instruction for performing an associated action, utilizing the device.
9. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that the device learns a sequence of one or more triggers and a subsequent action, recommends at least one recommended instruction, and, based on a receipt of a selection of the at least one recommended instruction to be saved and in response to detection that the sequence of triggers has been triggered, utilizes the at least one recommended instruction for automatically performing the subsequent action.
10. The non-transitory computer readable storage medium of claim 9 , wherein the instructions, when executed by the device, cause the device to operate such that the one or more recommended instructions are recommended via a notification that provides access to information relating to the sequence of one or more triggers and the subsequent action.
11. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that one or more predetermined instructions are displayed, and based on detection of a touch on at least one of the one or more predetermined instructions, display the at least one predetermined instruction including a predetermined trigger and a predetermined action, and, based on a receipt of a selection of the at least one predetermined instruction to be saved and in response to detection that the predetermined trigger has been triggered, utilize the at least one predetermined instruction for performing the predetermined action, utilizing the device.
12. The non-transitory computer readable storage medium of claim 11 , wherein the instructions, when executed by the device, cause the device to operate such that the predetermined trigger and the predetermined action are capable of being modified after being displayed, before the receipt of the selection of the at least one predetermined instruction to be saved.
13. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that the plurality of actions further include a display of an action description, where, in response to user confirmation input after the display of the action description, an action that is a subject of the action description, is performed.
14. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that the instruction is capable of being shared with another device for use by another user of the another device.
15. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to:
display, utilizing the display, a plurality of mode triggers;
detect, utilizing the touch surface, a touch on at least one of the plurality of mode triggers;
display, utilizing the display, a plurality of modes;
detect, utilizing the touch surface, a touch on at least one of the plurality of modes;
based on the detection of the touch on the at least one mode trigger and the touch on the at least one mode: store a mode instruction that includes the at least one mode trigger and the at least one mode;
detect whether the at least one mode trigger has been triggered; and
in response to the detection that the at least one mode trigger has been triggered, operate the device in the at least one mode based on the mode instruction.
16. The non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed by the device, cause the device to operate such that the at least one mode trigger includes multiple of the plurality of mode triggers that are included with the mode instruction, such that only a subset of the multiple of the plurality of mode triggers is required to be triggered for the device to operate in the at least one mode based on the mode instruction.
17. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that at least five ( 5 ) of:
(a) the plurality of triggers further include at least nine (9) of: opening of a predetermined application, receipt of a short message service (SMS) message, receipt of a notification, a battery level reaching a predetermined threshold, utilization of a gaming application, a calendar-based trigger, receipt of a call from a predetermined caller, receipt of an SMS message from a predetermined contact, receipt of a notification with a predetermined keyword, and receipt of a notification associated with a predetermined application;
(b) the plurality of actions further include at least eleven (11) of: a data synchronization action, a mute action, a volume increase action, a color control action, a Bluetooth-enabled content sharing action, a lockscreen action, a music play action, a start application action, a navigate to a website action, a record action, a call rejection action, an action involving multiple different applications, a display of actions that in response to a selection thereof a selected action is performed;
(c) the device learns a sequence of one or more triggers and a subsequent action, recommends at least one recommended instruction, and, based on a receipt of a selection of the at least one recommended instruction to be saved and in response to detection that the sequence of triggers has been triggered, utilizes the at least one recommended instruction for automatically performing the subsequent action;
(d) one or more predetermined instructions are displayed, and based on detection of a touch on at least one of the one or more predetermined instructions, identify the at least one predetermined instruction including a predetermined trigger and a predetermined action, and, based on a receipt of a selection of the at least one predetermined instruction to be saved and in response to detection that the predetermined trigger has been triggered, utilize the at least one predetermined instruction for performing the predetermined action, utilizing the device, where the predetermined trigger and the predetermined action are capable of being modified after being displayed, before the receipt of the selection of the at least one predetermined instruction;
(e) the at least one action includes multiple of the plurality of actions that are included with the instruction, for performing different actions using different applications in response to the detection that the at least one trigger has been triggered; and
(f) wherein the instructions, when executed by the device, cause the device to: display, utilizing the display, a plurality of mode triggers; detect, utilizing the touch surface, a touch on at least one of the plurality of mode triggers; display, utilizing the display, a plurality of modes; detect, utilizing the touch surface, a touch on at least one of the plurality of modes; based on the detection of the touch on the at least one mode trigger and the touch on the at least one mode: store a mode instruction that includes the at least one mode trigger and the at least one mode; detect whether the at least one mode trigger has been triggered; and in response to the detection that the at least one mode trigger has been triggered, operate the device in the at least one mode based on the mode instruction, where the at least one mode trigger includes multiple of the plurality of mode triggers that are included with the mode instruction, such that only a subset of the multiple of the plurality of mode triggers is required to be triggered for the device to operate in the at least one mode based on the mode instruction.
18. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that:
the plurality of triggers further include at least nine (9) of: opening of a predetermined application, receipt of a short message service (SMS) message, receipt of a notification, a battery level reaching a predetermined threshold, utilization of a gaming application, a calendar-based trigger, receipt of a call from a predetermined caller, receipt of an SMS message from a predetermined contact, receipt of a notification with a predetermined keyword, and receipt of a notification associated with a predetermined application;
the plurality of actions further include at least eleven (11) of: a data synchronization action, a mute action, a volume increase action, a color control action, a Bluetooth-enabled content sharing action, a lockscreen action, a music play action, a start application action, a navigate to a website action, a record action, a call rejection action, an action involving multiple different applications, a display of actions that in response to a selection thereof a selected action is performed;
the device learns a sequence of one or more triggers and a subsequent action, recommends at least one recommended instruction, and, based on a receipt of a selection of the at least one recommended instruction to be saved and in response to detection that the sequence of triggers has been triggered, utilizes the at least one recommended instruction for automatically performing the subsequent action;
one or more predetermined instructions are displayed, and based on detection of a touch on at least one of the one or more predetermined instructions, identify the at least one predetermined instruction including a predetermined trigger and a predetermined action, and, based on a receipt of a selection of the at least one predetermined instruction to be saved and in response to detection that the predetermined trigger has been triggered, utilize the at least one predetermined instruction for performing the predetermined action, utilizing the device, where the predetermined trigger and the predetermined action are capable of being modified after being displayed, before the receipt of the selection of the at least one predetermined instruction;
the at least one action includes multiple of the plurality of actions that are included with the instruction, for performing different actions using different applications in response to the detection that the at least one trigger has been triggered;
wherein the instructions, when executed by the device, cause the device to:
display, utilizing the display, a plurality of mode triggers;
detect, utilizing the touch surface, a touch on at least one of the plurality of mode triggers;
display, utilizing the display, a plurality of modes;
detect, utilizing the touch surface, a touch on at least one of the plurality of modes;
based on the detection of the touch on the at least one mode trigger and the touch on the at least one mode: store a mode instruction that includes the at least one mode trigger and the at least one mode;
detect whether the at least one mode trigger has been triggered; and
in response to the detection that the at least one mode trigger has been triggered, operate the device in the at least one mode based on the mode instruction, where the at least one mode trigger includes multiple of the plurality of mode triggers that are included with the mode instruction, such that only a subset of the multiple of the plurality of mode triggers is required to be triggered for the device to operate in the at least one mode based on the mode instruction.
19. The non-transitory computer readable storage medium of claim 1 , wherein the instructions, when executed by the device, cause the device to operate such that:
the plurality of triggers further include: opening of a predetermined application, receipt of a short message service (SMS) message, receipt of a notification, a battery level reaching a predetermined threshold, utilization of a gaming application, a calendar-based trigger, receipt of a call from a predetermined caller, receipt of an SMS message from a predetermined contact, receipt of a notification with a predetermined keyword, and receipt of a notification associated with a predetermined application;
the plurality of actions further include: a data synchronization action, a mute action, a volume increase action, a color control action, a Bluetooth-enabled content sharing action, a lockscreen action, a music play action, a start application action, a navigate to a website action, a record action, a call rejection action, an action involving multiple different applications, a display of actions that in response to a selection thereof a selected action is performed;
the device learns a sequence of one or more triggers and a subsequent action, recommends at least one recommended instruction, and, based on a receipt of a selection of the at least one recommended instruction to be saved and in response to detection that the sequence of triggers has been triggered, utilizes the at least one recommended instruction for automatically performing the subsequent action;
one or more predetermined instructions are displayed, and based on detection of a touch on at least one of the one or more predetermined instructions, identify the at least one predetermined instruction including a predetermined trigger and a predetermined action, and, based on a receipt of a selection of the at least one predetermined instruction to be saved and in response to detection that the predetermined trigger has been triggered, utilize the at least one predetermined instruction for performing the predetermined action, utilizing the device, where the predetermined trigger and the predetermined action are capable of being modified after being displayed, before the receipt of the selection of the at least one predetermined instruction;
the at least one action includes multiple of the plurality of actions that are included with the instruction, for performing different actions using different applications in response to the detection that the at least one trigger has been triggered;
wherein the instructions, when executed by the device, cause the device to:
display, utilizing the display, a plurality of mode triggers;
detect, utilizing the touch surface, a touch on at least one of the plurality of mode triggers;
display, utilizing the display, a plurality of modes;
detect, utilizing the touch surface, a touch on at least one of the plurality of modes;
based on the detection of the touch on the at least one mode trigger and the touch on the at least one mode: store a mode instruction that includes the at least one mode trigger and the at least one mode;
detect whether the at least one mode trigger has been triggered; and
in response to the detection that the at least one mode trigger has been triggered, operate the device in the at least one mode based on the mode instruction, where the at least one mode trigger includes multiple of the plurality of mode triggers that are included with the mode instruction, such that only a subset of the multiple of the plurality of mode triggers is required to be triggered for the device to operate in the at least one mode based on the mode instruction.
20. A method, comprising:
at a device including a display, memory, a microphone, a speaker, and a touch surface:
displaying, utilizing the display, a plurality of triggers including: a time, a location, an application, a network connectivity, at least one aspect of at least one other device, and a user input via a vocal input;
detecting, utilizing the touch surface, a touch on at least one of the plurality of triggers;
displaying, utilizing the display, a plurality of actions including: a first application action including a first action of a first application, a second application action including a second action of a second application, and a third application action including a third action of a third application;
detecting, utilizing the touch surface, a touch on at least one of the plurality of actions;
based on the detection of the touch on the at least one trigger and the touch on the at least one action: storing, utilizing the memory, an instruction that includes the at least one trigger and the at least one action;
detecting whether the at least one trigger has been triggered; and
in response to the detection that the at least one trigger has been triggered, performing the at least one action based on the instruction, utilizing the device.
21. A device, comprising:
a display;
memory;
a microphone;
a speaker,
a touch surface; and
one or more processors in communication with the display, the memory, the microphone, the speaker, and the touch surface, wherein the one or more processors execute instructions stored by the memory, to cause the device to:
display, utilizing the display, a plurality of triggers including: a time, a location, an application, a network connectivity, at least one aspect of at least one other device, and a user input via a vocal input;
detect, utilizing the touch surface, a touch on at least one of the plurality of triggers;
display, utilizing the display, a plurality of actions including: a first application action including a first action of a first application, a second application action including a second action of a second application, and a third application action including a third action of a third application;
detect, utilizing the touch surface, a touch on at least one of the plurality of actions;
based on the detection of the touch on the at least one trigger and the touch on the at least one action: store, utilizing the memory, an instruction that includes the at least one trigger and the at least one action;
detect whether the at least one trigger has been triggered; and
in response to the detection that the at least one trigger has been triggered, perform the at least one action based on the instruction, utilizing the device.