System and method for seviceability during execution of a video conferencing application using intelligent contextual session management
An information handling system executing a multimedia multi-user collaboration application (MMCA) including a memory; a power management unit; a camera to capture video of a user participating in a video conference session; a processor configured to execute code instructions of a trained intelligent collaboration contextual session management system (ICCSMS) neural network to receive as input: computations from an execution of a blur AV detection processing instruction module by the processor descriptive of a blur in an image frame received at a multimedia framework pipeline and infrastructure platform (MFPIP); computations from an execution of a compression artifact AV detection processing instruction module by the processor descriptive of compression artifacts present in the image frame received at the MFPIP; and computations from an execution of a color vector AV detection processing instruction module by the processor descriptive of color vector artifacts present in the image frame received at the MFPIP; the trained ICCSMS to provide, as output, processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in subsequently-received image frames.
1. An information handling system executing a multimedia multi-user collaboration application (MMCA), comprising:
a memory;
a power management unit;
a camera to capture video of a user participating in a video conference session;
a processor configured to execute code instructions of a trained intelligent collaboration contextual session management system (ICCSMS) neural network to receive as input:
computations from an execution of a blur AV detection processing instruction module by the processor descriptive of a blur in an image frame received at a multimedia framework pipeline and infrastructure platform (MFPIP);
computations from an execution of a compression artifact AV detection processing instruction module by the processor descriptive of compression artifacts present in the image frame received at the MFPIP; and
computations from an execution of a color vector AV detection processing instruction module by the processor descriptive of color vector artifacts present in the image frame received at the MFPIP;
the trained ICCSMS to provide, as output, processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in one or more image frames; and
the trained ICCSMS to provide, as output, processing instructions to create a service ticket to be sent to an information technology (IT) coordinating server when a threshold number of video conference sessions engaged in by the information handling system experience the occurrence of blur, compression, and color vector artifacts.
2. The information handling system of claim 1 further comprising:
a network interface device configured to transmit the blur in the image frame, the compression artifacts present in the image frame, or the color vector artifacts present in the image frame to a backend server via an out-of-band communication to aggregate detected artifacts for the videoconferencing session.
3. The information handling system of claim 1 further comprising:
a color sensor to detect color vector data in the video frame and provide the color vector data to the color vector AV detection processing instruction module to compute color vector artifacts present in the image frame received at the MFPIP.
4. The information handling system of claim 1 further comprising:
a fast Fourier transform of the blur AV detection processing instruction module to determine a threshold level of blur present in the video frame.
5. The information handling system of claim 1 further comprising:
an AV processing instruction manager to chain together the blur AV detection processing instruction module, the compression artifact AV detection processing instruction module, and the color vector AV detection processing instruction module to successively apply and reapply the blur AV detection processing instruction module, the compression artifact AV detection processing instruction module, and the color vector AV detection processing instruction module to the video frame.
6. The information handling system of claim 1 further comprising:
the processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in the one or more image frames including processing instructions to adjust an image resolution captured by the camera.
7. The information handling system of claim 1 , further comprising:
the processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in the one or more image frames including processing instructions to adjust encryption/decryption parameters used to encrypt/decrypt the video frame.
8. The information handling system of claim 1 ,
the trained ICCSMS neural network being executed on a backend server remote from the information handling system.
9. A method of monitoring and remediating for AV artifacts at an information handling system, comprising:
with a processor, executing a multimedia multi-user collaboration application (MMCA), initiating a videoconferencing session;
determining whether a video frame received at a multimedia framework pipeline and infrastructure platform (MFPIP) is received at or to be sent from the information handling system during the video conferencing session;
executing code instructions of a trained intelligent collaboration contextual session management system (ICCSMS) neural network to receive as input:
computations from an execution of a blur AV detection processing instruction module by the processor descriptive of a blur in an image frame received at a multimedia framework pipeline and infrastructure platform (MFPIP);
computations from an execution of a compression artifact AV detection processing instruction module by the processor descriptive of compression artifacts present in the image frame received at the MFPIP; and
computations from an execution of a color vector AV detection processing instruction module by the processor descriptive of color vector artifacts present in the image frame received at the MFPIP;
providing processing instructions, as output from the trained ICCSMS, to remediate the occurrence of blur, compression, and color vector artifacts in one or more image frames; and
providing, as output from the trained ICCSMS, processing instructions to create a service ticket to be sent to an information technology (IT) coordinating server when a threshold number of video conference sessions engaged in by the information handling system experience the occurrence of blur, compression, and color vector artifacts.
10. The method of claim 9 , further comprising:
transmitting, via a network interface device, the blur in the image frame, the compression artifacts present in the image frame, or the color vector artifacts present in the image frame to a backend server via an out-of-band communication to aggregate detected artifacts by a participant identification in the videoconferencing session.
11. The method of claim 9 , further comprising:
detecting, with a color sensor, color vector data in the video frame and provide the color vector data to the color vector AV detection processing instruction module to compute color vector artifacts present in the image frame received at the MFPIP.
12. The method of claim 9 , further comprising:
with a fast Fourier transform of the blur AV detection processing instruction module, determining a threshold level of blur present in the video frame.
13. The method of claim 9 further comprising:
with an AV processing instruction manager, chaining together the blur AV detection processing instruction module, the compression artifact AV detection processing instruction module, and the color vector AV detection processing instruction module to successively apply and reapply the blur AV detection processing instruction module, the compression artifact AV detection processing instruction module, and the color vector AV detection processing instruction module to the video frame.
14. The method of claim 9 further comprising:
the processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in the one or more image frames including processing instructions to adjust an image resolution captured by the camera.
15. An information handling system executing an intelligent collaboration contextual session management system (ICCSMS), comprising:
a memory;
a power management unit;
a camera to capture video of a user participating in a video conference session;
a processor to execute a multimedia multi-user collaboration application (MMCA) to engage a user in a videoconferencing session;
a multimedia framework pipeline and infrastructure platform (MFPIP) to provide, as input to the ICCSMS:
computations from an execution of a blur AV detection processing instruction module by the processor descriptive of a blur in an image frame received at a multimedia framework pipeline and infrastructure platform (MFPIP);
computations from an execution of a compression artifact AV detection processing instruction module by the processor descriptive of compression artifacts present in the image frame received at the MFPIP; and
computations from an execution of a color vector AV detection processing instruction module by the processor descriptive of color vector artifacts present in the image frame received at the MFPIP;
the trained ICCSMS to provide, as output, processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in one or more image frames; and
an AV processing instruction manager to chain together the blur AV detection processing instruction module, the compression artifact AV detection processing instruction module, and the color vector AV detection processing instruction module to successively apply and reapply the blur AV detection processing instruction module, the compression artifact AV detection processing instruction module, and the color vector AV detection processing instruction module to the video frame.
16. The information handling system of claim 15 further comprising:
the trained ICCSMS to provide, as output, processing instructions to create a service ticket to be sent to an information technology (IT) coordinating server;
the processing instructions to create a service ticket to be sent to the IT coordinating server when a threshold number of video conference sessions engaged in by the information handling system experience the occurrence of blur, compression, and color vector artifacts.
17. The information handling system of claim 15 further comprising:
a network interface device to transmit the blur in the image frame, the compression artifacts present in the image frame, or the color vector artifacts present in the image frame to a backend server via an out-of-band communication to aggregate detected artifacts by a participant identification in the videoconferencing session.
18. The information handling system of claim 15 further comprising:
the processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in the one or more image frames including processing instructions to adjust an image resolution captured by the camera.
19. The information handling system of claim 15 further comprising:
the processing instructions to remediate the occurrence of blur, compression, and color vector artifacts in the one or more image frames including processing instructions to adjust encryption/decryption parameters used to encrypt/decrypt the video frame.
20. The information handling system of claim 15 , further comprising:
a color sensor to detect color vector data in the video frame and provide the color vector data to the color vector AV detection processing instruction module to compute color vector artifacts present in the image frame received at the MFPIP.