Environmentally adaptive and segregated media pipeline architecture for multiple streaming sessions
Systems and methods monitor a system including a remote desktop, a trusted mobile instance, and a delivery handler. The delivery handler can determine if the system is overloaded and to take the appropriate measures to maintain a negotiated minimal QoS and adapt as necessary when the conditions vary. Additionally, the systems and method can address security issues by separating privileges that are typically bundled together in conventional systems, and by applying isolation mechanisms to exposed areas of the system.
1. A method for providing an adaptive media pipeline, the method comprising:
receiving, by a computing device, a connection request from an endpoint device;
in response to receiving the connection request, establishing, by the computing device, a remote desktop, a trusted mobile instance, and a delivery handler, wherein the trusted mobile instance is established within an isolation layer of the computing device and the delivery handler is established within a media pipeline service of the computing device, wherein the isolation layer is comprised of a group of one or more processes segregated from at least one process of the delivery handler, and wherein the group of processes of the isolation layer shares at least one computing resource of the computing device with the at least one process of the delivery handler;
retrieving, by the trusted mobile instance, media content of the remote desktop;
sharing, by the trusted mobile instance, the retrieved media content with the delivery handler using a shared memory buffer interconnected between the trusted mobile instance and the delivery handler;
determining, by the delivery handler, quality of service parameters, wherein said quality of service parameters comprise at least one of an encoding rate, an encoding format, a rendering or frame rate, and a screen resolution; and
providing, by the computing device via the delivery handler, the media content to the endpoint device in accordance with the quality of service parameters.
2. The method of claim 1 , wherein said retrieving media content comprises retrieving image data.
3. The method of claim 1 , wherein said retrieving media content comprises retrieving audio data.
4. The method of claim 1 , wherein said sharing the retrieved media content with the delivery handler comprising passing data packets or messages containing the media content from the trusted mobile instance to the delivery handler.
5. The method of claim 1 , further comprising adapting said quality of service parameters based on a current load of a system employing the method or a network employed by the method.
6. A non-transitory computer readable storage medium comprising a set of instructions for enabling an adaptive media pipeline, the non-transitory computer readable storage medium comprising:
instructions for receiving a connection request from an endpoint device;
instructions for, in response to receiving the connection request, establishing a remote desktop, a trusted mobile instance, and a delivery handler, wherein the trusted mobile instance is established within an isolation layer and the delivery handler is established within a media pipeline service, wherein the isolation layer is comprised of a group of one or more processes segregated from at least one process of the delivery handler, and wherein the group of processes of the isolation layer shares at least one computing resource with the at least one process of the delivery handler;
instructions for retrieving, by the trusted mobile instance, media content of the remote desktop;
instructions for sharing, by the trusted mobile instance, the retrieved media content with the delivery handler, including instructions that enable a shared memory buffer interconnected between the trusted mobile instance and the delivery handler;
instructions for determining, by the delivery handler, quality of service parameters, wherein said quality of service parameters comprise at least one of an encoding rate, an encoding format, a rendering or frame rate, and a screen resolution; and
instructions for providing, via the delivery handler, the media content to the endpoint device in accordance with the quality of service parameters.
7. The non-transitory computer readable storage medium of claim 6 , wherein said instructions for retrieving media content comprises instructions for retrieving image data.
8. The non-transitory computer readable storage medium of claim 6 , wherein said instructions for retrieving media content comprises instructions for retrieving audio data.
9. The non-transitory computer readable storage medium of claim 6 , wherein said instructions for sharing the retrieved media content with the delivery handler comprises instructions for passing data packets or messages containing the media content from the trusted mobile instance to the delivery handler.
10. The non-transitory computer readable storage medium of claim 6 , further comprising instructions for adapting said quality of service parameters based on a current load of a system or a network.
11. A system for providing an adaptive media pipeline, the system comprising:
at least one electronic processor, wherein said system:
receives a connection request from an endpoint device;
in response to receiving the connection request, establishes a remote desktop, a trusted mobile instance, and a delivery handler, wherein the trusted mobile instance is established within an isolation layer and the delivery handler is established within a media pipeline service, wherein the isolation layer is comprised of a group of one or more processes segregated from at least one process of the delivery handler, and wherein the group of processes of the isolation layer shares at least one computing resource with the at least one process of the delivery handler;
retrieves, by the trusted mobile instance, media content of the remote desktop;
shares, by the trusted mobile instance, the retrieved media content with the delivery handler;
determines, by the delivery handler, quality of service parameters, wherein said quality of service parameters comprise at least one of an encoding rate, an encoding format, a rendering or frame rate, and a screen resolution; and
provides the media content to the endpoint device in accordance with the quality of service parameters; and
a shared memory buffer interconnected between the trusted mobile instance and the delivery handler, wherein said system uses said shared memory buffer to perform said sharing of the media content with the delivery handler.
12. The system of claim 11 , wherein said retrieval of media content comprises retrieval of image data.
13. The system of claim 11 , wherein said retrieval of media content comprises retrieval of audio data.
14. The system of claim 11 , wherein said system shares the retrieved media content with the delivery handler by passing data packets or messages containing the media content from the trusted mobile instance to the delivery handler.
15. The system of claim 11 , wherein said system adapts said quality of service parameters based on a current load of said system or a network employed by said system.