Haptic content presentation and implementation
A method includes displaying, on a touchscreen, a video comprising a video frame and determining, based on a saliency map of the video frame, a region of interest in the video frame. The method also includes detecting a touch on a region of the touchscreen while the video frame is displayed and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest.
1. A method comprising:
displaying, on a touchscreen, a video comprising a video frame;
determining, based on a saliency map of the video frame, a region of interest in the video frame;
detecting a touch on a region of the touchscreen while the video frame is displayed;
in response to determining that the region of the touchscreen overlaps with the region of interest, generating a haptic response having an aspect that is determined based on the saliency map, wherein the aspect comprises at least one of an intensity or a frequency; and
varying the aspect based on a gradation of saliency in the saliency map.
2. The method of claim 1 , wherein the haptic response is generated using an actuator or a speaker.
3. The method of claim 1 , further comprising:
detecting an object of interest in the video frame; and
generating the saliency map such that the region of interest comprises the object.
4. The method of claim 1 , wherein the intensity or the frequency is varied based further on one or more of a size of an object of interest in the video frame, a curvature of the object, or a depth of the object in the video frame.
5. The method of claim 1 , wherein the intensity is varied based on the gradation of saliency in the saliency map.
6. The method of claim 1 , further comprising generating an audio response in response to determining that the region of the touchscreen overlaps with the region of interest.
7. The method of claim 1 , wherein the haptic response is generated by communicating an electric signal through a layer of the touchscreen.
8. An apparatus comprising:
a touchscreen configured to display a video comprising a video frame; and
a hardware processor communicatively coupled to the touchscreen, the hardware processor configured to:
determine, based on a saliency map of the video frame, a region of interest in the video frame;
detect a touch on a region of the touchscreen while the video frame is displayed;
in response to determining that the region of the touchscreen overlaps with the region of interest, generate a haptic response having an aspect that is determined based on the saliency map, wherein the aspect comprises at least one of an intensity or a frequency; and
varying the aspect based on a gradation of saliency in the saliency map.
9. The apparatus of claim 8 , further comprising at least one of an actuator or a speaker, wherein the haptic response is generated using the at least one of the actuator or the speaker.
10. The apparatus of claim 8 , wherein the hardware processor is further configured to:
detect an object of interest in the video frame; and
generate the saliency map such that the region of interest comprises the object.
11. The apparatus of claim 8 , wherein the intensity or the frequency is varied based further on one or more of a size of an object of interest in the video frame, a curvature of the object, or a depth of the object in the video frame.
12. The apparatus of claim 8 , wherein the intensity is varied based on the gradation of saliency in the saliency map.
13. The apparatus of claim 8 , further comprising a speaker, wherein the hardware processor is further configured to generate an audio response, using the speaker, in response to determining that the region of the touchscreen overlaps with the region of interest.
14. The apparatus of claim 8 , wherein the haptic response is generated by communicating an electric signal through the touchscreen.
15. A system comprising:
a server configured to communicate a video comprising a video frame; and
a computing device comprising:
a touchscreen configured to display the video from the server; and
a hardware processor communicatively coupled to the touchscreen, the hardware processor configured to:
determine, based on a saliency map of the video frame, a region of interest in the video frame;
detect a touch on a region of the touchscreen while the video frame is displayed;
in response to determining that the region of the touchscreen overlaps with the region of interest, generate a haptic response having an aspect that is determined based on the saliency map, wherein the aspect comprises at least one of an intensity or a frequency; and
varying the aspect based on a gradation of saliency in the saliency map.
16. The system of claim 15 , wherein the computing device further comprises at least one of an actuator or a speaker, wherein the haptic response is generated using the at least one of the actuator or the speaker.
17. The system of claim 15 , wherein the intensity or the frequency is varied based further on one or more of a size of an object of interest in the video frame, a curvature of the object, or a depth of the object in the video frame.
18. The system of claim 15 , wherein the intensity is varied based on the gradation of saliency in the saliency map.
19. The system of claim 15 , wherein the computing device further comprises a speaker, and wherein the hardware processor is further configured to generate an audio response, using the speaker, in response to determining that the region of the touchscreen overlaps with the region of the interest.
20. The system of claim 15 , wherein the haptic response is generated by communicating an electric signal through the touchscreen.