Systems and methods for receive-side customization of presentation of mixed media data
Systems and methods for receive-side customization of presentation of mixed media data. Systems and methods focus on the receive path so that each participant in a video conference or other mixed media application can, as a receiver of mixed media data signals, customize the individual incoming mixed media data signals for display on the receiver's user device. User customization options include blocking video or avatars, converting (to avatars), and filtering distracting behavior. Embodiments enable all participating users (not just a host user) to respectively receive-side customize the presentation/display of the mixed media data. Additionally, systems and methods can be implemented in an existing server.
1 . A system, comprising:
a demultiplexing module configured to receive a combined media stream including mixed media data input provided by a plurality of external devices, and output a plurality of constituent data streams corresponding to the plurality of external devices, respectively; and
a control circuit to be communicatively coupled to a reference device configured to receive media streams for display, wherein, when communicatively coupled to the reference device, the control circuit is to:
receive the plurality of constituent data streams from the demultiplexing module;
receive a user preference to customize at least a first constituent data stream of the plurality of constituent data streams;
convert the first constituent data stream of the plurality of constituent data streams into a customized data stream based on the user preference, wherein to convert the first constituent data stream is to include converting at least a portion of a video signal of the first constituent data stream; and
cause the customized data stream and at least one other constituent data stream of the plurality of constituent data streams to be combined into a combined output media stream to be displayed on the reference device.
2 . The system of claim 1 , wherein the control circuit is further to:
generate a prompt to be displayed on the reference device responsive to receiving the plurality of constituent data streams for a user to select block, pass, convert, or filter, wherein a user selection responsive to the prompt is the user preference to customize the first constituent data stream.
3 . The system of claim 2 , wherein, based on the user selection being convert, the control circuit is further to create the customized data stream by converting the first constituent data stream to an avatar data stream.
4 . The system of claim 2 , wherein, based on the user selection being filter, the control circuit is further to create the customized data stream by processing the first constituent data stream with an algorithm to remove distracting behavior from the video signal.
5 . The system of claim 1 , wherein the control circuit is further to:
create the customized data stream on a cloud server; and
transmit the combined output media stream to the reference device via a network.
6 . The system of claim 1 , wherein the control circuit is further to create the customized data stream on the reference device.
7 . The system of claim 1 , wherein the first constituent data stream further comprises an audio signal, and the control circuit is further to:
determine, based on the user preferences to convert the audio signal into an audio avatar data stream; and
create an audio avatar data stream from the audio signal, wherein the customized data stream includes the audio avatar data stream.
8 . The system of claim 1 , wherein the control circuit is further to:
receive, for the plurality of constituent data streams, respective user preferences to customize the plurality of constituent data streams for display on the reference device; and
create a respective plurality of customized data streams based on the respective user preferences, wherein the respective plurality of customized data streams are to be combined into the combined output media stream and displayed concurrently on the reference device.
9 . A non-transitory computer-readable media comprising instructions that when executed by processing circuitry, cause the processing circuitry to:
receive mixed media data signals including at least a first constituent data stream corresponding to a first external device and a second constituent data stream corresponding to a second external device, respectively, wherein the first constituent data stream includes at least a first video signal and the second constituent data stream includes at least a second video signal;
receive a first user preference of a user of a reference device to customize at least the first constituent data stream;
receive a second user preference of the user to customize the second constituent data stream;
convert the first constituent data stream into a first customized data stream based on the first user preference, wherein to convert the first constituent data stream is to include converting the first video signal;
convert the second constituent data stream into a second customized data stream based on the second user preference, wherein to convert the second constituent data stream is to include converting the second video signal; and
cause the first customized data stream and the second customized data stream to be combined into a combined output media stream to be displayed on the reference device configured to receive media streams for display.
10 . The non-transitory computer-readable media of claim 9 , wherein the instructions, when executed by the processing circuitry, cause the processing circuitry further to:
generate a prompt to be displayed on the reference device responsive to receiving the mixed media data signals for a user to select block, pass, convert, or filter, wherein a first user selection responsive to the prompt is the first user preference to customize the first constituent data stream, wherein a second user selection responsive to the prompt is the second user preference to customize the second constituent data stream.
11 . The non-transitory computer-readable media of claim 10 , wherein the instructions, when executed by the processing circuitry, cause the processing circuitry further to:
determine that the first user selection is convert; and
create the first customized data stream by converting the first constituent data stream to an avatar data stream, responsive to determining that the first user selection is convert.
12 . The non-transitory computer-readable media of claim 10 , wherein the instructions, when executed by the processing circuitry, cause the processing circuitry further to:
determine that the second user selection is filter; and
create the second customized data stream by processing the second constituent data stream with an algorithm to remove distracting behavior, responsive to determining that the second user selection is filter.
13 . The non-transitory computer-readable media of claim 9 , wherein the instructions, when executed by the processing circuitry, cause the processing circuitry further to:
create the first customized data stream and the second customized data stream on a cloud server; and
transmit the combined output media stream to the reference device via a network.
14 . The non-transitory computer-readable media of claim 9 , wherein the instructions are further to create the first customized data stream and the second customized data stream on the reference device.
15 . The non-transitory computer-readable media of claim 9 , wherein a third constituent data stream of the mixed media data signals comprises an audio signal, and the instructions, when executed by the processing circuitry, cause the processing circuitry further to:
determine that a third user preference is to convert the audio signal into an audio avatar data stream; and
create a third customized data stream as an audio avatar data stream, wherein the third customized data stream is to be combined into the combined output media stream.
16 . A system, comprising:
a first means for sorting a combined media stream into a plurality of constituent data streams corresponding to a plurality of external devices, respectively, wherein the combined media stream includes mixed media data input Provided by the plurality of external devices; and
a second means for receive-side customization, communicatively coupled to a reference device configured to receive media streams for display, wherein the second means is to:
receive the plurality of constituent data streams from the first means;
receive a user preference to customize at least one constituent data stream of the plurality of constituent data streams, for display on the reference device;
convert a first constituent data stream of the plurality of constituent data streams into an avatar data stream based on the user preference, wherein the avatar data stream includes an avatar, wherein to convert the first constituent data stream includes converting at least a portion of a video signal of the first constituent data stream; and
cause the avatar data stream and at least one other constituent data stream of the plurality of constituent data streams to be combined into a combined output media stream to be displayed on the reference device.
17 . The system of claim 16 , wherein the second means for receive-side customization is further to:
generate a prompt on the reference device responsive to receiving the plurality of constituent data streams, for a user to select block, pass, convert, or filter, wherein a user selection responsive to the prompt is the user preference to customize the first constituent data stream.
18 . The system of claim 17 , wherein the second means for receive-side customization is further to:
determine that a second user selection is filter; and
create a customized data stream to be displayed on the reference device concurrently with the avatar data stream, wherein the customized data stream is to be created by processing a second constituent data stream of the plurality of constituent data streams with an algorithm to remove distracting behavior.
19 . The system of claim 16 , wherein to convert the first constituent data stream into the avatar data stream is to include generating the avatar from the video signal or from an audio signal of the first constituent data stream.
20 . The system of claim 1 , wherein the at least one other constituent data stream is a second customized data stream to be combined into the combined output media stream.