Cross-platform remote user experience accessibility
In non-limiting examples of the present disclosure, systems, methods and devices for assisting with cross-platform user experience accessibility are provided. A real-time connection between a remote device and a host device may be established. The remote device may apply a plurality of rules to event metadata that it generates. The filtered event metadata corresponding to a plurality of user experience events occurring on the remote device may be received by the host device. One or more transforms may be applied to the filtered event metadata on the host device. A native accessibility experience corresponding to each of the plurality of user experience events may be provided by the host device based on the transformed event metadata.
1. A method for assisting with cross-platform user experience accessibility, the method comprising:
establishing, by a first device, a connection with a second device;
monitoring event metadata generated by the first device;
filtering out background event metadata from the event metadata;
tagging metadata from the event metadata that is accessibility related, wherein text metadata associated with text displayed by the first device is tagged from the event metadata;
sending the tagged event metadata to the second device in a first form compatible with a first platform executed by the first device for accessibility translation into a second form compatible with a second platform executed by the second device;
receiving, by the second device, the tagged event metadata;
translating, by the second device, the tagged event metadata to a form readable by an accessibility engine operating on the second device; and
providing, by the second device, a native accessibility experience corresponding to the translated event metadata, wherein the providing comprises producing one of: an audio output corresponding to the text metadata; a braille output corresponding to the text metadata; and a haptic output corresponding to the text metadata.
2. The method of claim 1 , wherein the connection between the first device and the second device is established via a device mirroring application for mirroring the first device on the second device.
3. The method of claim 1 , wherein the event metadata is monitored by a device mirroring application executed on the first device.
4. A computer-readable storage media comprising executable instructions that, when executed by one or more processors, assist with user experience accessibility, the computer-readable storage media including instructions executable by the one or more processors for:
establishing, by a first device, a connection with a second device;
monitoring event metadata generated by the first device;
filtering out background event metadata from the event metadata;
tagging metadata from the event metadata that is accessibility related, wherein text metadata associated with text displayed by the first device is tagged from the event metadata;
sending the tagged event metadata to the second device in a first form compatible with a first platform executed by the first device for accessibility translation into a second form compatible with a second platform executed by the second device;
receiving, by the second device, the tagged event metadata;
translating, by the second device, the tagged event metadata to a form readable by an accessibility engine operating on the second device; and
providing, by the second device, a native accessibility experience corresponding to the translated event metadata, wherein the providing comprises producing one of: an audio output corresponding to the text metadata; a braille output corresponding to the text metadata; and a haptic output corresponding to the text metadata.