Dynamic haptic generation based on detected video events
A method or system that receives input media including at least video data in which a video event within the video data is detected. Related data that is associated with the detected video event is collected and one or more feature parameters are configured based on the collected related data. The type of video event is determining and a set of feature parameters is selected based on the type of video event. A haptic effect is then automatically generated based on the selected set of feature parameters.
1. A method of dynamically generating haptic effects comprising:
receiving input media comprising at least video data;
detecting a video event within the video data based on color and motion analysis of the video data;
collecting related data associated with the video event;
configuring one or more feature parameters based on the related data;
determining a type of the video event;
selecting a set of feature parameters from the one or more feature parameters based on the type of the video event; and
generating a haptic effect based on the set of feature parameters.
2. The method of claim 1 , wherein detecting the video event comprises automatically generating a start time and an end time of the video event.
3. The method of claim 1 , wherein collecting related data comprises collecting pixel data of a set of consecutive frames of the video event.
4. The method of claim 1 , wherein collecting related data comprises motion analysis of an object or event within a set of consecutive frames of the video event.
5. The method of claim 4 , wherein the motion analysis comprises a generation of a motion analysis vector.
6. The method of claim 1 , wherein collecting related data comprises collecting audio track data of a set of consecutive frames of the video event.
7. The method of claim 1 , wherein configuring the one or more feature parameters comprises configuring a haptic parameter based on a number of pixels associated with the video event.
8. The method of claim 7 , wherein configuring the one or more feature parameters comprises configuring a haptic parameter based on a difference in a number of pixels of a set of consecutive frames associated with the video event.
9. The method of claim 1 , wherein configuring the one or more feature parameters comprises configuring a haptic parameter based on a motion analysis vector between a set of consecutive frames associated with the video event.
10. The method of claim 1 , wherein configuring the one or more feature parameters comprises configuring a haptic parameter based on a magnitude or frequency of an audio track associated with the video event.
11. The method of claim 1 , wherein the determining a type of the video event comprises determining a collision event or an explosion event.
12. The method of claim 1 , wherein selecting a set of feature parameters comprises selecting the use of a motion analysis vector when the type of the video event is a collision event or the use of a number of pixels when the type of the video event is an explosion event.
13. A non-transient computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to generate haptic effects, the generating haptic effects comprising:
receiving input media comprising at least video data;
detecting a video event within the video data based on color and motion analysis of the video data;
collecting related data associated with the video event;
configuring one or more feature parameters based on the related data;
determining a type of the video event;
selecting a set of feature parameters from the one or more feature parameters based on the type of video event; and
generating a haptic effect based on the set of feature parameters.
14. The non-transient computer readable medium of claim 13 , wherein collecting related data comprises collecting pixel data of a set of consecutive frames of the video event.
15. The non-transient computer readable medium of claim 13 , wherein collecting related data comprises motion analysis of an object or event within a set of consecutive frames of the video event.
16. The non-transient computer readable medium of claim 13 , wherein configuring the feature parameter comprises configuring a haptic parameter based on a number of pixels associated with the video event.
17. The non-transient computer readable medium of claim 13 , wherein configuring the feature parameter comprises configuring a haptic parameter based on a motion analysis vector between a set of consecutive frames associated with the video event.
18. The non-transient computer readable medium of claim 13 , wherein selecting a set of feature parameters comprises selecting the use of a motion analysis vector when the type of video event is a collision event or the use of a number of pixels when the type of video event is an explosion event.
19. A haptic effect generation system comprising:
a memory unit configured for storing instructions;
a processor configured to execute the software instructions stored on the memory unit to
receive input media comprising at least video data and detect a video event within the video data based on color and motion analysis of the video data; and
collect related data associated with the video event;
define one or more feature parameters based on the related data; and
determine a type of the video event, select a set of feature parameters from the one or more feature parameters based on the type of video event; and
a haptic actuator system configured to dynamically generate a haptic effect based on the set of feature parameters.
20. The system of claim 19 , wherein the processor is further configured to execute software instructions to select the set of feature parameters that comprises selecting the use of a motion analysis vector when the type of video event is a collision event or the use of a number of pixels when the type of video event is an explosion event.