Systems and methods for stabilizing views of videos
A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.
1. A method of stabilized viewing of spherical video content, comprising:
obtaining a spherical video having a progress length;
obtaining a user-defined trajectory of viewing direction for the spherical video, the user-defined trajectory of viewing direction including viewing directions for moments within the progress length of the spherical video, wherein the viewing directions are defined based on rotation about multiple axes;
generating a stabilized trajectory of viewing direction for the spherical video based on a margin constraint that limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction, the margin constraint including separate limits for different ones of the multiple axes on the deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction; and
generating a stabilized video based on the stabilized viewing trajectory of viewing direction for the spherical video.
2. The method of claim 1 , wherein the user-defined trajectory of viewing direction is identified by a user as a function of progress through the progress length of the spherical video.
3. The method of claim 2 , wherein the user-defined trajectory of viewing direction is identified by the user via user interaction with a touchscreen display.
4. The method of claim 2 , wherein the user-defined trajectory of viewing direction is identified by the user via user rotation of a mobile device.
5. The method of claim 4 , wherein the stabilized trajectory of viewing direction is generated to account for jerkiness or shakiness in the user-defined trajectory of viewing direction.
6. The method of claim 1 , wherein the multiple axes include a yaw axis, a pitch axis, and a roll axis.
7. The method of claim 6 , wherein the margin constraint separately includes a yaw axis constraint, a pitch axis constraint, and a roll axis constraint.
8. The method of claim 7 , wherein:
the yaw axis constraint limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction for rotation about the yaw axis;
the pitch axis constraint limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction for rotation about the pitch axis; and
the roll axis constraint limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction for rotation about the roll axis.
9. The method of claim 7 , wherein the margin constraint further includes a viewing size constraint.
10. The method of claim 9 , wherein the viewing size constraint limits deviation of a viewing size associated with the stabilized trajectory of viewing direction from a viewing size associated with the user-defined trajectory of viewing direction.
11. A system that stabilizes viewing of spherical video content, comprising:
one or more physical processors configured by machine-readable instructions to:
obtain a spherical video having a progress length;
obtain a user-defined trajectory of viewing direction for the spherical video, the user-defined trajectory of viewing direction including viewing directions for moments within the progress length of the spherical video, wherein the viewing directions are defined based on rotation about multiple axes;
generate a stabilized trajectory of viewing direction for the spherical video based on a margin constraint that limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction, the margin constraint including separate limits for different ones of the multiple axes on the deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction; and
generate a stabilized video based on the stabilized viewing trajectory of viewing direction for the spherical video.
12. The system of claim 11 , wherein the user-defined trajectory of viewing direction is identified by a user as a function of progress through the progress length of the spherical video.
13. The system of claim 12 , wherein the user-defined trajectory of viewing direction is identified by the user via user interaction with a touchscreen display.
14. The system of claim 12 , wherein the user-defined trajectory of viewing direction is identified by the user via user rotation of a mobile device.
15. The system of claim 14 , wherein the stabilized trajectory of viewing direction is generated to account for jerkiness or shakiness in the user-defined trajectory of viewing direction.
16. The system of claim 11 , wherein the multiple axes include a yaw axis, a pitch axis, and a roll axis.
17. The system of claim 16 , wherein the margin constraint separately includes a yaw axis constraint, a pitch axis constraint, and a roll axis constraint.
18. The system of claim 17 , wherein:
the yaw axis constraint limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction for rotation about the yaw axis;
the pitch axis constraint limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction for rotation about the pitch axis; and
the roll axis constraint limits deviation of the stabilized trajectory of viewing direction from the user-defined trajectory of viewing direction for rotation about the roll axis.
19. The system of claim 17 , wherein the margin constraint further includes a viewing size constraint.
20. The system of claim 19 , wherein the viewing size constraint limits deviation of a viewing size associated with the stabilized trajectory of viewing direction from a viewing size associated with the user-defined trajectory of viewing direction.