Method and apparatus for generating and displaying 360-degree video based on eye tracking and physiological measurements

1. A method comprising:

displaying multi-view video on a head mounted display (HMD) device of a user, the multi-view video associated with a point of view of a camera operator;

responsive to determining that a point of view of the user overlaps with the point of view of the camera operator, setting an effect intensity as a function of an amount of overlap between the point of view of the camera operator and the point of view of the user,

wherein the point of view of the user is defined by a viewable display of the HMD device; and

using an effect, in accordance with the effect intensity, to highlight an object of interest in the displayed multi-view video.

2. The method of claim 1 ,

wherein using the effect in accordance with the effect intensity to highlight the object of interest adjusts a brightness of the object of interest, and

wherein the effect intensity is a brightness level to which the brightness of the object of interest is adjusted.

3. The method of claim 1 ,

wherein using the effect in accordance with the effect intensity to highlight the object of interest adjusts a zoom level of the object of interest, and

wherein the effect intensity is the zoom level to which the object of interest is adjusted.

4. The method of claim 1 ,

wherein using the effect in accordance with the effect intensity to highlight the object of interest plays a sound, and

wherein the effect intensity is a volume level at which the sound is played.

5. The method of claim 1 ,

wherein using the effect in accordance with the effect intensity to highlight the object of interest causes a haptic module to vibrate, and

wherein the effect intensity is an intensity at which the haptic module vibrates.

6. The method of claim 1 , further comprising determining the object of interest based on eye tracking of the camera operator at a time of capture of the multi-view video.

7. The method of claim 1 , further comprising determining the object of interest based on physiological sensor information recorded from the camera operator at a time of capture of the multi-view video.

8. The method of claim 1 , further comprising:

capturing the multi-view video with a camera;

tracking the point of view of the camera operator;

measuring physiological data of the camera operator; and

identifying the object of interest in the multi-view video based on the point of view of the camera operator and the physiological data of the camera operator.

9. The method of claim 1 , further comprising:

comparing the point of view of the camera operator with the point of view of the user; and

determining the amount of overlap that the point of view of the user overlaps with the point of view of the camera operator.

10. The method of claim 1 , further comprising:

responsive to detecting a proximity between the point of view of the user and the point of view of the camera operator, displaying a visual effect indicating the proximity between the point of view of the user and the point of view of the camera operator,

wherein displaying the multi-view video comprises displaying the multi-view video to be synchronous with a head movement of the user.

11. The method of claim 1 , wherein the effect has an intensity equal to the effect intensity.

12. The method of claim 1 , further comprising determining the point of view of the user.

13. The method of claim 1 , further comprising determining whether the point of view of the user overlaps with the point of view of the camera operator.

14. The method of claim 1 , wherein the object of interest is identified as being within the point of view of the camera operator and is indicated as being of interest to the camera operator.

15. The method of claim 1 , wherein setting the effect intensity as the function of the amount of overlap between the point of view of the camera operator and the point of view of the user comprises setting the effect intensity based proportionally on the amount of overlap between the point of view of the camera operator and the point of view of the user.

16. An apparatus comprising:

a processor; and

a non-transitory computer-readable medium storing instructions that are operative, when executed by the processor, to cause the apparatus to:

display multi-view video on a head mounted display (HMD) device of a user, the multi-view video associated with a point of view of a camera operator;

responsive to determining that a point of view of the user overlaps with the point of view of the camera operator, set an effect intensity as a function of an amount of overlap between the point of view of the camera operator and the point of view of the user,

wherein the point of view of the user is defined by a viewable display of the HMD device; and

use an effect, in accordance with the effect intensity, to highlight an object of interest in the displayed multi-view video.

17. The apparatus of claim 16 , further comprising:

a gaze-tracking sensor;

a camera;

a physiological sensor; and

a display.

18. A method comprising:

displaying multi-view video on a head mounted display (HMD) device of a user, the multi-view video associated with a point of view of a camera operator;

rendering, within a point of view of the user and while the point of view of the user overlaps with the point of view of camera operator, as part of the displayed multi-view video, an object of interest identified as being in the point of view of the camera operator, the point of view of the user being defined by a viewable display of the HMD device; and

responsive to determining that the point of view of the user no longer overlaps with the point of view of the camera operator, implementing a display effect to continue rendering the identified object of interest within the point of view of the user.

19. The method of claim 18 , further comprising:

receiving information regarding the point of view of the camera operator and the object of interest in the multi-view video, the point of view of the camera operator being with respect to the multi-view video, and the object of interest is indicated as being of interest to the camera operator.

20. The method of claim 19 , further comprising:

capturing the multi-view video with a multi-view camera;

tracking a view direction and the point of view of the camera operator controlling the camera using an eye tracker mounted on the camera;

measuring physiological data of the camera operator; and

identifying the object of interest in the multi-view video based on the view direction and the physiological data.