Context-aware task processing for multiple devices
The present disclosure relates to processing tasks offloaded from one or more user devices to a cloud service. An example method generally includes receiving a command to be processed by the cloud service from a first device of a group of user devices. The cloud service generates a response based on the command. The cloud service determines weighting scores for each device in the group of user devices for each of audio output, video output, and haptic feedback based on context information about the group of user devices. The cloud service selects a plurality of user devices to receive at least part of the response based on the determined weighting scores, partitions the response into portions corresponding to the selected plurality of user devices, and instructs each of the selected plurality of user devices to output the one or more portions corresponding to the selected plurality of user devices.
1. A method for processing commands offloaded from a user device to a cloud service, comprising:
receiving a command to be processed by the cloud service from a first device of a group of user devices;
generating a response based on the command;
determining weighting scores for each device in the group of user devices for each of audio output, video output, and haptic feedback, the weighting scores being based on context information about the group of user devices, wherein:
the context information comprises information about capabilities of the user device and information about whether a user is interacting with the user device,
the capabilities of the user device comprises one or more of information about a device display size, an ability to play back audio via a connected audio output device, or an ability to output haptic feedback,
the weighting score for audio output is based at least on a connection to an audio output device and audio quality of the device,
the weighting score for video output is based at least on screen size and information about whether the user is looking at or actively manipulating the device, and
the weighting score for haptic feedback is based at least on whether the device is a wearable device and information about whether the user is actively manipulating the device;
selecting a plurality of user devices from the group of user devices to receive at least part of the response based on the determined weighting scores for each device in the group of devices, wherein the selected plurality of devices correspond to devices having a highest weighting score for audio output, video output, and haptic feedback;
partitioning the response into a plurality of portions corresponding to each of the selected plurality of user devices, wherein the plurality of portions comprises at least a first portion corresponding to audio data in the response, a second portion corresponding to video data in the response, and a third portion corresponding to haptic feedback data in the response; and
instructing each of the selected plurality of user devices to output the one or more portions corresponding to the selected plurality of user devices by transmitting the plurality of portions to the corresponding selected plurality of user devices.
2. The method of claim 1 , wherein the selecting the plurality of user devices comprises:
for a type of output, generating a score for each device in the group of user devices based on the context information associated with each device; and
identifying a device with a highest score as the selected user device for the type of output.
3. The method of claim 1 , wherein the plurality of selected user devices comprises a designated master device of the one or more user devices.
4. The method of claim 3 , wherein the partitioned response comprises routing information identifying one or more user devices to receive each partition of the partitioned response.
5. The method of claim 1 , wherein the context information comprises differences from previously transmitted context information stored at the cloud service.
6. The method of claim 1 , wherein the context information includes data from one or more sensors at a user device indicating that a user is actively manipulating the user device.