Virtual serialization/deserialization display sharing
A system may receive information from a system under test, such as an automotive system under test, and capture multiple display streams from the system under test. The display streams may be processed and composited using virtual serializer/deserializer (virtual SerDes) operations that combine the multiple streams into a single super-frame format. The composited stream is then encoded and broadcast. The system may enable multiple users to simultaneously access and interact with the display streams remotely, with the virtual SerDes operations supporting numerous logical displays for software development and validation. The system may provide synchronized display viewing and allows dynamic switching between multi-display tiled views and single display views while preserving spatial and interleaved super-frame formats.
1 . At least one non-transitory computer-readable medium storing instructions that, when executed by at least one processor of an Internet Protocol-based Keyboard Video Mouse (IP-KVM) device, cause the at least one processor to:
receive information from an automotive system under test;
capture multiple display streams from the automotive system under test;
process the multiple display streams from the automotive system under test;
composite, using virtual serializer/deserializer (virtual SerDes) operations, the multiple display streams into a single stream by combining the multiple display streams into a single super-frame format; and
encode and transmit the composited stream.
2 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
enable multiple users to simultaneously access and interact with the multiple display streams remotely, via the virtual SerDes operations that support at least sixteen logical displays for automotive software development and validation.
3 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
provide synchronized display viewing, allowing multiple users to view identical display stream outputs simultaneously.
4 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
dynamically change display compositing modes in real-time, enabling switching between a multi-display tiled view and a single display view, wherein the compositing preserves spatial and interleaved super-frame formats used in automotive applications, wherein the spatial super-frame format combines multiple displays by arranging the multiple displays in a grid layout within a single output frame, and wherein the interleaved super-frame format combines multiple displays by alternating scan lines from each display sequentially into a single output frame.
5 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
allow multiple users to interact with multiple logical displays simultaneously, enabling parallel testing and debugging of automotive software validation components.
6 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
at least one of transmit the received information from the automotive system under test or record the received information from the automotive system under test to a network location.
7 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
detect anomalies in the received information and place markers in a recording at points where the anomalies are detected.
8 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
record the received information at a native resolution.
9 . The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the at least one processor to:
convert received keyboard and mouse events to logical display coordinates based on an active display layout.
10 . An automotive video composite control system, comprising:
an interface to receive multiple display streams from an automotive system; and
an Internet Protocol-based Keyboard Video Mouse (IP-KVM) device configured to:
receive information from the automotive system;
capture the multiple display streams from the automotive system;
process the multiple display streams from the automotive system;
composite, using virtual serializer/deserializer (virtual SerDes) operations, the multiple display streams into a single stream, wherein to composite the multiple display streams includes combining the multiple display streams into a single super-frame format; and
encode and transmit the composited stream.
11 . The system of claim 10 , wherein the IP-KVM device is further configured to:
receive data from multiple logical displays from the automotive system;
process the captured display streams prior to scaling and composition;
combine the multiple logical displays into a single physical display output; and
manage keyboard, mouse, and touch input types across the multiple logical displays.
12 . The system of claim 11 , wherein the IP-KVM device is further configured to allow multiple users to simultaneously access and interact with the multiple display streams remotely, wherein the IP-KVM uses the virtual SerDes operations to support at least sixteen logical displays for automotive software development and validation.
13 . The system of claim 11 , wherein the IP-KVM device is further configured to allow multiple users to interact with different ones of the multiple logical displays simultaneously, enabling parallel testing and debugging of automotive software validation components.
14 . The system of claim 10 , wherein the IP-KVM device is further configured to provide synchronized display viewing, allowing multiple users to view identical display stream outputs simultaneously, wherein the display stream outputs are compatible with automotive SerDes protocols.
15 . The system of claim 10 , wherein the IP-KVM device is further configured to dynamically change display compositing modes in real-time, enabling switching between a multi-display tiled view and a single display view, and wherein the compositing modes preserve spatial and interleaved super-frame formats used in automotive applications, wherein the spatial super-frame format combines multiple displays by arranging the multiple displays in a grid layout within a single output frame, and wherein the interleaved super-frame format combines multiple displays by alternating scan lines from each display sequentially into a single output frame.
16 . The system of claim 10 , wherein the IP-KVM device is further configured to at least one of transmit the received information from the automotive system or record the received information from the automotive system to a network location.
17 . The system of claim 10 , wherein the IP-KVM device is further configured to detect anomalies in the received information and place markers in a recording at points where the anomalies are detected.
18 . The system of claim 10 , wherein the IP-KVM device is configured to record the received information at a native resolution.
19 . The system of claim 10 , wherein the IP-KVM device is configured to receive display configuration events and update a current display state based on the received display configuration events.
20 . The system of claim 10 , wherein the IP-KVM device is configured to convert received keyboard and mouse events to logical display coordinates based on an active display layout.