Systems and methods for offloading processing-intensive video conferencing task to edge computing device

1. A computer-implanted method comprising:

determining that a mobile computing device is participating in a video conference via a conferencing server, wherein the mobile computing device is located at a first geographic location and is in communication with the conferencing server via a communication network, and wherein during the video conference, a virtual background is being provided for display at the mobile computing device based at least in part on virtual background processing being performed at the mobile computing device;

monitoring a parameter of the mobile computing device during the video conference; and

determining, based on the monitored parameter, whether at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to an edge computing device located at a second geographic location remote from the first geographic location of the mobile computing device; and

in response to determining that at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device, offloading the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device by:

causing the mobile computing device to transmit, to the edge computing device and via the communication network, a video feed captured by the mobile computing device;

causing the edge computing device to modify the video feed by performing the at least a portion of the virtual background processing; and

receiving, at the conferencing server from the edge computing device via the communication network, the modified video feed.

2. The method of claim 1 , further comprising:

prior to the offloading of the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device, causing the mobile computing device to transmit a full video feed comprising a depiction of a human figure and the virtual background; and

subsequent to determining that the at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device, causing the mobile computing device to transmit a partial video feed that comprises the depiction of a human figure and that does not comprise the virtual background.

3. The method of claim 2 , wherein the partial video feed transmitted by the mobile computing device comprises a polygonal portion of the full video feed that comprises the depiction of the human figure and approximates boundaries of the human figure.

4. The method of claim 1 , further comprising:

prior to the offloading of the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device, causing the mobile computing device to transmit a full video feed comprising a depiction of a human figure and a particular portion of the virtual background; and

subsequent to determining that the at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device, causing the mobile computing device to transmit a partial video feed that comprises the depiction of a human figure and that that comprises a portion of the virtual background that is less than the particular portion.

5. The method of claim 1 , wherein:

monitoring the parameter of the mobile computing device during the video conference comprises:

determining a current battery level of a battery of the mobile computing device; and

determining whether the current battery level exceeds a threshold battery level; and

determining, based on the monitored parameter, whether the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device comprises determining whether the current battery level exceeds the threshold battery level.

6. The method of claim 1 , wherein:

monitoring the parameter of the mobile computing device during the video conference comprises:

determining a current battery level of a battery of the mobile computing device;

determining an amount of time before the video conference concludes; and

determining a rate of battery consumption of the battery of the mobile computing device based on one or more video conferencing processing tasks being performing by the mobile computing device; and

determining, based on the monitored parameter, whether the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device comprises:

determining, based on the current battery level, the rate of battery consumption, and the amount of time before the video conference concludes, whether the battery of the mobile computing device will fall below a threshold level of charge before the conclusion of the video conference if the one or more video conferencing processing tasks continue to be performed by the mobile computing device; and

determining that the at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device based on determining that the battery of the mobile computing device will fall below the threshold level of charge before the conclusion of the video conference if the one or more video conferencing processing tasks continue to be performed by the mobile computing device.

7. The method of claim 1 , wherein:

the mobile computing device is a first conferencing device, and a second conferencing device is participating in the video conference via the conferencing server; and

the conferencing server is further configured to cause the edge computing device to:

receive, from the second conferencing device, a video feed intended for the mobile computing device;

process the video feed intended for the mobile computing device; and

transmit the processed video feed to the mobile computing device.

8. The method of claim 1 , wherein:

monitoring the parameter of the mobile computing device during the video conference comprises determining, based on sensor data received from the mobile computing device, that a video frame captured by the mobile computing device during the video conference is unstable, wherein the sensor data is indicative of movement of the mobile computing device; and

offloading the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device comprises causing the unstable video frame to be transmitted to the edge computing device, wherein the edge computing device stabilizes the video frame based at least in part on the sensor data.

9. The method of claim 8 , further comprising:

causing the edge computing device to identify one or more salient portions of the virtual background and stabilize the video frame further based on the identified one or more salient portions of the virtual background.

10. The method of claim 1 , wherein the mobile computing device is a smartphone, and the edge computing device is a mobile edge computing device.

11. A system comprising:

computer memory;

control circuitry configured to:

determine that a mobile computing device is participating in a video conference via a conferencing server, wherein the mobile computing device is located at a first geographic location and is in communication with the conferencing server via a communication network, and wherein during the video conference, a virtual background is being provided for display at the mobile computing device based at least in part on virtual background processing being performed at the mobile computing device;

monitor a parameter of the mobile computing device during the video conference; and

determine, based on the monitored parameter, whether at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to an edge computing device located at a second geographic location remote from the first geographic location of the mobile computing device; and

in response to determining that at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device, offload the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device by:

causing the mobile computing device to transmit, to the edge computing device and via the communication network, a video feed captured by the mobile computing device;

causing the edge computing device to modify the video feed by performing the at least a portion of the virtual background processing; and

receiving, at the conferencing server from the edge computing device via the communication network, the modified video feed.

12. The system of claim 11 , wherein the control circuitry is further configured to:

prior to the offloading of the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device, cause the mobile computing device to transmit a full video feed comprising a depiction of a human figure and the virtual background; and

subsequent to determining that the at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device, cause the mobile computing device to transmit a partial video feed that comprises the depiction of a human figure and that does not comprise the virtual background.

13. The system of claim 12 , wherein the partial video feed transmitted by the mobile computing device comprises a polygonal portion of the full video feed that comprises the depiction of the human figure and approximates boundaries of the human figure.

14. The system of claim 11 , wherein the control circuitry is further configured to:

prior to the offloading of the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device, cause the mobile computing device to transmit a full video feed comprising a depiction of a human figure and a particular portion of the virtual background; and

subsequent to determining that the at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device, cause the mobile computing device to transmit a partial video feed that comprises the depiction of a human figure and that that comprises a portion of the virtual background that is less than the particular portion.

15. The system of claim 11 , wherein the control circuitry is further configured to:

monitor the parameter of the mobile computing device during the video conference by:

determining a current battery level of a battery of the mobile computing device; and

determining whether the current battery level exceeds a threshold battery level; and

determining, based on the monitored parameter, whether the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device comprises determining whether the current battery level exceeds the threshold battery level.

16. The system of claim 11 , wherein the control circuitry is further configured to:

monitor the parameter of the mobile computing device during the video conference by:

determining a current battery level of a battery of the mobile computing device;

determining an amount of time before the video conference concludes; and

determining a rate of battery consumption of the battery of the mobile computing device based on one or more video conferencing processing tasks being performing by the mobile computing device; and

determining, based on the monitored parameter, whether the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device comprises:

determining, based on the current battery level, the rate of battery consumption, and the amount of time before the video conference concludes, whether the battery of the mobile computing device will fall below a threshold level of charge before the conclusion of the video conference if the one or more video conferencing processing tasks continue to be performed by the mobile computing device; and

determining that the at least a portion of the virtual background processing being performed by the mobile computing device should be offloaded to the edge computing device based on determining that the battery of the mobile computing device will fall below the threshold level of charge before the conclusion of the video conference if the one or more video conferencing processing tasks continue to be performed by the mobile computing device.

17. The system of claim 11 , wherein:

the mobile computing device is a first conferencing device, and a second conferencing device is participating in the video conference via the conferencing server; and

the control circuitry is further configured to cause the edge computing device to:

receive, from the second conferencing device, a video feed intended for the mobile computing device;

process the video feed intended for the mobile computing device; and

transmit the processed video feed to the mobile computing device.

18. The system of claim 11 , wherein the control circuitry is further configured to:

monitor the parameter of the mobile computing device during the video conference by determining, based on sensor data received from the mobile computing device, that a video frame captured by the mobile computing device during the video conference is unstable, wherein the sensor data is indicative of movement of the mobile computing device; and

offload the at least a portion of the virtual background processing being performed by the mobile computing device to the edge computing device by causing the unstable video frame to be transmitted to the edge computing device, wherein the edge computing device stabilizes the video frame based at least in part on the sensor data.

19. The system of claim 18 , wherein the control circuitry is further configured to:

cause the edge computing device to identify one or more salient portions of the virtual background and stabilize the video frame further based on the identified one or more salient portions of the virtual background.

20. The system of claim 11 , wherein the mobile computing device is a smartphone, and the edge computing device is a mobile edge computing device.