User interface extendability over wireless protocol
Generating unified content includes receiving, at a first device, first media content comprising a media stream from one or more source devices, and receiving, at the first device, user interface overlay instructions. The first device generates unified content having the first media content and a user interface overlay, and provides the unified content for display on a display device.
1 . A method for processing content, comprising:
receiving, at a first device, a playback request for a first media content comprising a media stream;
in response to the playback request:
transmitting an instruction to a receiver device to retrieve the media stream from a media server over a first data pipeline,
determining one or more user interface (UI) overlay elements for the media stream based on a local media application on the first device;
generating user interface overlay instructions for drawing the one or more UI overlay elements, and for retrieving sensor data from an accessory device; and
transmitting a UI overlay stream over a second data pipeline comprising the user interface overlay instructions to the receiver device,
wherein the user interface overlay instructions comprise instructions to render the one or more UI overlay elements over the media stream in accordance with the user interface overlay instructions, and instructions to populate
the one or more UI overlay elements with the sensor data retrieved from the accessory device.
2 . The method of claim 1 , wherein the receiver device comprises a display device.
3 . The method of claim 1 , further comprising:
rendering unified content based on the user interface overlay instructions, and
transmitting the unified content to a display device for display.
4 . The method of claim 1 , wherein the first media content is received via a first data pipeline and the user interface overlay instructions are received via a second data pipeline.
5 . The method of claim 1 , wherein the user interface overlay instructions comprise instructions to draw a graphical representation of the sensor data.
6 . A non-transitory computer readable medium comprising computer readable code for processing content, executable by one or more processors to:
receive, at a first device, a playback request for a first media content comprising a media stream;
in response to the playback request:
transmit an instruction to a receiver device to retrieve the media stream from a media server over a first data pipeline,
determine one or more user interface (UI) overlay elements for the media stream based on a local media application on the first device;
generate user interface overlay instructions for drawing the one or more UI overlay elements, and for retrieving sensor data from an accessory device; and
transmit a UI overlay stream over a second data pipeline comprising the user interface overlay instructions to the receiver device,
wherein the user interface overlay instructions comprise instructions to render the one or more UI overlay elements over the media stream in accordance with the user interface overlay instructions, and instructions to populate
the one or more UI overlay elements with the sensor data retrieved from the accessory device.
7 . The non-transitory computer readable medium of claim 6 , wherein the receiver device comprises a display device.
8 . The non-transitory computer readable medium of claim 6 , further comprising computer readable code executable by the one or more processors to:
render unified content based on the user interface overlay instructions, and
transmit the unified content to a display device for display.
9 . The non-transitory computer readable medium of claim 6 , wherein the first media content is received via a first data pipeline and the user interface overlay instructions are received via a second data pipeline.
10 . The non-transitory computer readable medium of claim 6 , wherein the user interface overlay instructions comprise instructions to draw a graphical representation of the sensor data.
11 . A system comprising:
one or more processors; and
one or more computer readable media comprising computer readable code executable by the one or more processors to:
receive, at a first device, a playback request for a first media content comprising a media stream;
in response to the playback request:
transmit an instruction to a receiver device to retrieve the media stream from a media server over a first data pipeline,
determine one or more user interface (UI) overlay elements for the media stream based on a local media application on the first device;
generate user interface overlay instructions for drawing the one or more UI overlay elements, and for retrieving sensor data from an accessory device; and
transmit a UI overlay stream over a second data pipeline comprising the user interface overlay instructions to the receiver device,
wherein the user interface overlay instructions comprise instructions to render the one or more UI overlay elements over the media stream in accordance with the user interface overlay instructions, and instructions to populate
the one or more UI overlay elements with the sensor data retrieved from the accessory device.
12 . The system of claim 11 , wherein the receiver device comprises a display device.
13 . The system of claim 11 , further comprising computer readable code executable by the one or more processors to:
render unified content based on the user interface overlay instructions, and
transmit the unified content to a display device for display.
14 . The system of claim 11 , wherein the first media content is received via a first data pipeline and the user interface overlay instructions are received via a second data pipeline.