Haptic content presentation and implementation
Systems and methods generating a haptic output response are disclosed. Video content is displayed on a display. A location of a user touch on the display is detected while the video content is being displayed. A region of interest in the video content is determined based on the location of the user touch. And a haptic output response is generated to a user. A characteristic of the haptic output response is determined using one or more characteristics of the region of interest.
1. A method comprising:
receiving a saliency map of a frame of video content, the saliency map including a plurality of defined regions of interest in the frame of the video content;
displaying the video content on a display, wherein the plurality of defined regions of interest of the saliency map correspond to locations on the display;
detecting a location of a user touch on the display that overlaps a defined region of interest of the plurality of defined regions of interest of the saliency map while the frame of the video content is displayed on the display;
determining a region of interest of the plurality of defined regions of interest in the video content based on the location of the user touch and the saliency map; and
generating a haptic output response to a user, wherein a characteristic of the haptic output response is determined by one or more characteristics of the region of interest.
2. The method of claim 1 , wherein the characteristic of the haptic output response is based on an object in the region of interest.
3. The method of claim 2 , wherein the characteristic of the haptic output response is based on at least one of a size of the object, a depth of the object within the video content, or a shape of the object.
4. The method of claim 2 , further comprising:
generating an audio response to the user, wherein the audio response is based on at least one of a size of the object, a depth of the object within the video content, or a shape of the object.
5. The method of claim 1 , further comprising:
varying the characteristic of the haptic output response based on the region of interest to inform the user of the one or more characteristics of the region of interest.
6. The method of claim 4 , further comprising:
varying an aspect of the audio response based on the region of interest to inform the user of the one or more characteristics of the region of interest.
7. The method of claim 1 , wherein the characteristic of the haptic output response includes an intensity or a frequency.
8. The method of claim 7 , wherein the intensity or the frequency are based on a relevance of the region of interest relative to at least one other of the plurality of defined regions of interest in the video content.
9. A system, comprising:
a display;
at least one hardware processor; and
at least one non-transitory memory carrying instructions that, when executed by the at least one hardware processor, cause the system to:
receive a saliency map of a frame of video content, the saliency map including a plurality of defined regions of interest in the frame of the video content;
display the video content on the display, wherein the plurality of defined regions correspond to locations on the display;
detect a location of a user touch on the display while the frame of the video content is displayed on the display;
determine a particular region of interest of the plurality of defined regions of interest in the video content based on the location of the user touch overlapping the particular region of interest as defined in the saliency map; and
generate a haptic output response to a user, wherein a characteristic of the haptic output response is determined by one or more characteristics of the region of interest.
10. The system of claim 9 , wherein the characteristic of the haptic output response is based on an object in the particular region of interest.
11. The system of claim 10 , wherein the characteristic of the haptic output response is based on at least one of a size of the object, a depth of the object within the video content, or a shape of the object.
12. The system of claim 10 , wherein the instructions further cause the system to:
generate an audio response to the user, wherein the audio response is based on at least one of a size of the object, a depth of the object within the video content, or a shape of the object.
13. The system of claim 9 , wherein the instructions further cause the system to:
vary the characteristic of the haptic output response based on the particular region of interest to inform the user of the one or more characteristics of the region of interest.
14. The system of claim 12 , wherein the instructions further cause the system to:
vary an aspect of the audio response based on the particular region of interest to inform the user of the one or more characteristics of the region of interest.
15. The system of claim 9 , wherein the characteristic of the haptic output response includes an intensity or a frequency.
16. The system of claim 15 , wherein the intensity or the frequency are based on a relevance of the particular region of interest relative to at least one other of the plurality of defined regions of interest in the video content.
17. At least one non-transitory computer-readable medium carrying instructions that, when executed by a computing system, cause the computing system to perform operations comprising:
receiving a saliency map of a frame of video content, the saliency map including a plurality of defined regions of interest in the frame of the video content;
displaying the video content on a display, wherein the plurality of defined regions of interest correspond to locations on the display;
detecting a location of a user touch on the display that overlaps a defined region of interest of the plurality of defined regions of interest of the saliency map while the frame of the video content is displayed on the display;
determining a region of interest of the plurality of defined regions of interest in the video content based on the location of the user touch and the saliency map; and
generating a haptic output response to a user, wherein a characteristic of the haptic output response is determined by one or more characteristics of the region of interest.
18. The at least one non-transitory computer-readable medium of claim 17 , wherein the haptic output response is based on an object in the defined region of interest, and wherein the operations further comprise:
varying the characteristic of the haptic output response to inform the user of the one or more characteristics of the defined region of interest.