Systems and methods for processing a video stream during live video sharing

1. A method of processing a video stream, comprising the steps of:

receiving, at a receiving electronic computing device from an electronic image capturing device:

first data representing a first full video frame of the video stream in which an object of interest and a first background portion exclusive of the object of interest are depicted; and

first metadata associated with the first full video frame, the first metadata comprising:

a first identifier of the object of interest within an object of interest portion of the first full video frame; and

a first movement profile for the electronic image capturing device comprising an indication of a current speed at which the electronic image capturing device is moving;

displaying, at a display coupled to the receiving electronic computing device, the first full video frame;

extracting, by the receiving electronic device and dependent on the first identifier of the object of interest, the first background portion from the first full video frame;

receiving, from the electronic image capturing device, second data representing an object of interest portion of a second full video frame in which the object of interest is depicted, the second data excluding data representing a second background portion of the second full video frame;

applying, by the receiving electronic device and dependent on the first movement profile, a transformation to the extracted first background portion to create a transformed first background portion; and

displaying, at the display, a representation of the second full video frame comprising the object of interest portion of the second full video frame and the transformed first background portion.

2. The method of claim 1 , wherein applying the transformation comprises applying, dependent on the current speed at which the electronic image capturing device is moving, a zooming effect in which at least a portion of the first background portion is enlarged.

3. The method of claim 2 , wherein:

the first movement profile further comprises an indication of an acceleration of the electronic image capturing device; and

applying the zooming effect is further dependent on the acceleration of the electronic image capturing device.

4. The method of claim 1 , wherein:

the first movement profile further comprises an indication of a direction in which the electronic image capturing device is moving or an indication of a change in altitude for electronic image capturing device; and

applying the transformation comprises applying, to the first background portion dependent on the direction in which the electronic image capturing device is moving or the change in altitude, at least one of a panning effect and a rotation effect.

5. The method of claim 1 , further comprising:

receiving, from the electronic image capturing device, third data representing an object of interest portion of a third full video frame in which the object of interest is depicted, the third data excluding data representing a third background portion of the third full video frame;

applying, by the receiving electronic device and dependent on the first movement profile, a further transformation to the transformed first background portion to create a further transformed first background portion; and

displaying, at the display, a representation of the third full video frame comprising the object of interest portion of the third video frame and the further transformed first background portion.

6. The method of claim 1 , further comprising:

receiving, from the electronic image capturing device:

third data representing a third full video frame in which the object of interest and a third background portion exclusive of the object of interest are depicted; and

second metadata associated with the third full video frame, the second metadata comprising:

a second identifier of the object of interest within an object of interest portion of the third full video frame; and

a second movement profile for the electronic image capturing device comprising an indication of a current speed at which the electronic image capturing device is moving;

displaying, at the display, the third full video frame;

extracting, by the receiving electronic device and dependent on the second identifier of the object of interest, the third background portion from the third full video frame;

receiving, from the electronic image capturing device, fourth data representing an object of interest portion of a fourth full video frame in which the object of interest is depicted, the fourth data excluding data representing a fourth background portion of the fourth full video frame;

applying, by the receiving electronic device and dependent on the second movement profile, a transformation to the extracted third background portion to create a transformed third background portion; and

displaying, at the display, a representation of the fourth full video frame comprising the object of interest portion of the third full video frame and the transformed third background portion.

7. The method of claim 6 , wherein the metadata associated with the first full video frame further comprises an indication of a number of video frames for which data representing a respective object of interest portion of the video frame and excluding data representing a respective background portion of the video frame expected to be received prior to receiving the third data.

8. The method of claim 6 , further comprising, subsequent to receiving the second data and prior to receiving the third data, providing a request to the electronic image capturing device for data representing a full video frame in which the object of interest and a respective background portion exclusive of the object of interest are depicted at a specified resolution.

9. The method of claim 6 , further comprising:

determining, by the electronic image capturing device subsequent to sending the second data, that a trigger condition for providing data representing a full video frame in which the object of interest and a respective background portion exclusive of the object of interest are depicted is met; and

sending, by the electronic image capturing device in response to determining that the trigger condition has been met, the third data.

10. The method of claim 1 , further comprising, prior to displaying the representation of the second full video frame:

determining a first amount or rate of change between the object of interest portions of the first and second full video frames;

determining a second amount or rate of change between the first background portion and the transformed first background portion;

comparing the first amount or rate of change and the second amount or rate of change; and

in response to determining that a difference between the first amount or rate of change and the second amount or rate of change exceeds a predetermined threshold difference:

applying, by the receiving electronic device, a modified transformation to the extracted first background portion to create a modified transformed first background portion; and

updating the representation of the second full video frame to replace the transformed first background portion with the modified transformed first background portion.

11. An electronic image processing device, comprising:

a display;

input interface circuitry operable to receive a video stream from an electronic image capturing device; and

a video stream processing unit operable to:

receive, from the electronic image capturing device via the input interface circuitry:

first data representing a first full video frame of the video stream in which an object of interest and a first background portion exclusive of the object of interest are depicted; and

first metadata associated with the first full video frame, the first metadata comprising:

a first identifier of the object of interest within an object of interest portion of the first full video frame; and

a first movement profile for the electronic image capturing device comprising an indication of a current speed at which the electronic image capturing device is moving;

display, on the display, the first full video frame;

extract, dependent on the first identifier of the object of interest, the first background portion from the first full video frame;

receive, from the electronic image capturing device, second data representing an object of interest portion of a second full video frame in which the object of interest is depicted, the second data excluding data representing a second background portion of the second full video frame;

apply, dependent on the first movement profile, a transformation to the extracted first background portion to create a transformed first background portion; and

display, on the display, a representation of the second full video frame comprising the object of interest portion of the second full video frame and the transformed first background portion.

12. The electronic image processing device of claim 11 , wherein to apply the transformation, the video stream processing unit is further operable to apply, to the extracted first background portion and dependent on the current speed at which the electronic image capturing device is moving, a zooming effect in which at least a portion of the extracted first background portion is enlarged.

13. The electronic image processing device of claim 11 , wherein:

the first movement profile further comprises an indication of a direction in which the electronic image capturing device is moving or an indication of a change in altitude for electronic image capturing device; and

to apply the transformation, the video stream processing unit is further operable to apply, to the extracted first background portion and dependent on the direction in which the electronic image capturing device is moving or the change in altitude, at least one of a panning effect and a rotation effect.

14. The electronic image processing device of claim 11 , wherein the video stream processing unit is further operable to:

receive, from the electronic image capturing device, third data representing an object of interest portion of a third full video frame in which the object of interest is depicted, the third data excluding data representing a third background portion of the third full video frame;

apply, dependent on the first movement profile, a further transformation to the transformed first background portion to create a further transformed first background portion; and

display, on the display, a representation of the third full video frame comprising the object of interest portion of the third full video frame and the further transformed first background portion.

15. The electronic image processing device of claim 11 , wherein the video stream processing unit is further operable to:

receive, from the electronic image capturing device:

third data representing a third full video frame in which the object of interest and a third background portion exclusive of the object of interest are depicted; and

second metadata associated with the third full video frame, the second metadata comprising:

a second identifier of the object of interest within an object of interest portion of the third full video frame; and

a second movement profile for the electronic image capturing device comprising an indication of a current speed at which the electronic image capturing device is moving;

display, on the display, the third full video frame;

extract, dependent on the second identifier of the object of interest, the third background portion from the third full video frame;

receive, from the electronic image capturing device, fourth data representing an object of interest portion of a fourth full video frame in which the object of interest is depicted, the fourth data excluding data representing a fourth background portion of the fourth full video frame;

apply, dependent on the second movement profile, a transformation to the extracted third background portion to create a transformed third background portion; and

display, on the display, a representation of the fourth full video frame comprising the object of interest portion of the third full video frame and the transformed third background portion.

16. The electronic image processing device of claim 11 , wherein, prior to displaying the representation of the second full video frame, the video stream processing unit is further operable to:

determine a first amount or rate of change between the object of interest portions of the first and second full video frames;

determine a second amount or rate of change between the first background portion and the transformed first background portion;

compare the first amount or rate of change and the second amount or rate of change; and

in response to a determination that a difference between the first amount or rate of change and the second amount or rate of change exceeds a predetermined threshold difference:

apply a modified transformation to the extracted first background portion to create a modified transformed first background portion; and

update the representation of the second full video frame to replace the transformed first background portion with the modified transformed first background portion.

17. A non-transitory, computer-readable storage medium having program instructions stored thereon that when executed by an electronic processor cause the electronic processor to perform:

receiving, from an electronic image capturing device:

first data representing a first full video frame of a video stream in which an object of interest and a first background portion exclusive of the object of interest are depicted; and

first metadata associated with the first full video frame, the first metadata comprising:

a first identifier of the object of interest within an object of interest portion of the first full video frame; and

a first movement profile for the electronic image capturing device comprising an indication of a current speed at which the electronic image capturing device is moving;

displaying, on a display device, the first full video frame;

extracting, dependent on the first identifier of the object of interest, the first background portion from the first full video frame;

receiving, from the electronic image capturing device, second data representing an object of interest portion of a second full video frame in which the object of interest is depicted, the second data excluding data representing a second background portion of the second full video frame;

applying, dependent on the first movement profile, a transformation to the extracted first background portion to create a transformed first background portion; and

displaying, on the display device, a representation of the second full video frame comprising the object of interest portion of the second full video frame and the transformed first background portion.

18. The non-transitory, computer-readable storage medium of claim 17 , wherein:

the first movement profile further comprises one or more of:

an indication of an acceleration of the electronic image capturing device; and

an indication of a direction in which the electronic image capturing device is moving; and

an indication of a change in altitude for electronic image capturing device; and

applying the transformation comprises one or more of:

applying, to the extracted first background portion and dependent on the current speed at which the electronic image capturing device is moving or the acceleration of the electronic image capturing device, a zooming effect in which at least a portion of the extracted first background portion is enlarged; and

applying, to the extracted first background portion and dependent on the direction in which the electronic image capturing device is moving or the change in altitude, at least one of a panning effect and a rotation effect.

19. The non-transitory, computer-readable storage medium of claim 17 , wherein, when executed by the electronic processor, the program instructions further cause the electronic processor to perform:

receiving, from the electronic image capturing device:

third data representing a third full video frame in which the object of interest and a third background portion exclusive of the object of interest are depicted; and

second metadata associated with the third full video frame, the second metadata comprising:

a second identifier of the object of interest within an object of interest portion of the third full video frame; and

a second movement profile for the electronic image capturing device comprising an indication of a current speed at which the electronic image capturing device is moving;

displaying, on the display device, the third full video frame;

extracting, dependent on the second identifier of the object of interest, the third background portion from the third full video frame;

receiving, from the electronic image capturing device, fourth data representing an object of interest portion of a fourth full video frame in which the object of interest is depicted, the fourth data excluding data representing a fourth background portion of the fourth full video frame;

applying, dependent on the second movement profile, a transformation to the extracted third background portion to create a transformed third background portion; and

displaying, on the display device, a representation of the fourth full video frame comprising the object of interest portion of the third full video frame and the transformed third background portion.

20. The non-transitory, computer-readable storage medium of claim 17 , wherein, when executed by the electronic processor, the program instructions further cause the electronic processor to perform, prior to displaying the representation of the second full video frame:

determining a first amount or rate of change between the object of interest portions of the first and second full video frames;

determining a second amount or rate of change between the first background portion and the transformed first background portion;

comparing the first amount or rate of change and the second amount or rate of change; and

in response to determining that a difference between the first amount or rate of change and the second amount or rate of change exceeds a predetermined threshold difference:

applying a modified transformation to the extracted first background portion to create a modified transformed first background portion; and

updating the representation of the second full video frame to replace the transformed first background portion with the modified transformed first background portion.