Sharing screen content in a mobile environment
Systems and methods are provided for sharing a screen from a mobile device. For example, a method includes receiving, at a second mobile device, an image of a screen captured from a first mobile device and determining whether to trigger an automated action. The method may also include displaying, responsive to not triggering the automated action, annotation data generated for the image with the image on a display of the second mobile device, the annotation data including at least one visual cue corresponding to content in the image relevant to a user of the second mobile device. The method may further include, responsive to triggering the automated action, determining that a mobile application associated with the image is installed on the second mobile device and replaying user input actions received with the image on the second mobile device starting from a reference screen associated with the mobile application.
1. A method performed by one or more processors, the method comprising:
receiving an identifier for a recipient and an image from a first mobile device, the image representing a captured screen of the first mobile device;
copying the image to an image repository associated with the recipient;
performing, using a recognition engine, recognition on the image to identify an entity referenced in the image;
generating annotation data for the image based on the recognition, the annotation data including a visual cue that corresponds to an area of actionable content for the entity identified based on the recognition,
wherein generating the visual cue that corresponds to the area of actionable content for the entity is based on the entity being determined, based on historical activity, to be relevant to the recipient indicated by the received identifier, and
wherein the visual cue is selectable to initiate an action associated with the entity; and
providing the image and the annotation data to a second mobile device, the second mobile device being associated with the recipient.
2. The method of claim 1 , wherein the image represents less than the entire image as displayed on the first mobile device.
3. The method of claim 1 , wherein the area of actionable content represents content that maps to a document that is associated with the entity and available via the Internet and wherein selection of the area causes the mobile device to navigate to the document.
4. The method of claim 1 , wherein the visual cue corresponds with a structure element having the entity relevant to the recipient.
5. The method of claim 1 , further comprising:
notifying the recipient after the annotation data has been generated; and
providing the image and the annotation data in response to a request for the image from the recipient.
6. The method of claim 1 , further comprising:
receiving, at the second mobile device, the image of the screen captured from the display of the first mobile device, and the annotation data;
determining whether to trigger an automated action; and
displaying, responsive to not triggering the automated action, the annotation data generated for the image with the image on a display of the second mobile device, the annotation data including the visual cue.
7. The method of claim 6 , wherein a set of user input actions is received with the image and the method further comprises, responsive to triggering the automated action:
determining that a mobile application associated with the image is installed on the second mobile device; and
replaying the user input actions on the second mobile device starting from a reference screen associated with the mobile application.
8. A system comprising:
at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the at least one processor to:
receive an identifier for a recipient and an image from a first mobile device, the image representing a captured screen of the first mobile device;
copy the image to an image repository associated with the recipient;
perform, using a recognition engine, recognition on the image to identify an entity referenced in the image;
generate annotation data for the image based on the recognition, the annotation data including a visual cue that corresponds to an area of actionable content for the entity identified based on the recognition,
wherein generating the visual cue that corresponds to the area of actionable content for the entity is based on the entity being determined, based on historical activity, to be relevant to the recipient indicated by the received identifier, and
wherein the visual cue is selectable to initiate an action associated with the entity; and
provide the image and the annotation data to a second mobile device, the second mobile device being associated with the recipient.
9. The system of claim 8 , wherein the image represents less than the entire image as displayed on the first mobile device.
10. The system of claim 8 , wherein the area of actionable content represents content that maps to a document that is associated with the entity and available via the Internet, and wherein selection of the area causes the mobile device to navigate to the document.
11. The system of claim 8 , wherein the visual cue corresponds with a structure element having the entity relevant to the recipient.
12. The system of claim 8 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:
notify the recipient after the annotation data has been generated; and
provide the image and the annotation data in response to a request for the image from the recipient.