System and method for an end-device modulation based on a hybrid trigger
View Patent ↗A system for end-device modulation by a hybrid trigger comprising at least one end-device (E-D) in communication with at least a first device (D1) outputting audio/video (a/v) programming; a processor; a memory element coupled to the processor; a program executable by the processor to: position a virtual representation of the E-D on a digital canvas displayed on a D1-coupled display representing a user's physical and virtual space; and capture from a corresponding region of the virtual space for modulating an effect on a corresponding portion of the canvas-positioned E-D based on a combination of at least two different triggers recognizing at least one of an a/v element or a/v event from the a/v program.
1. A system for end-device modulation, said system comprising:
at least one end-device (E-D) in communication with at least a first device (D1) outputting audio/video (a/v) programming;
a processor;
a memory element coupled to the processor;
a program executable by the processor to:
provide an interface configured for end-user script input loaded onto a web-browser page, wherein the end-user script input is any one of a basic programming language, including HTML, HTML5, or Javascript (JS) for adjusting of an aspect of the immersive light effect from the at least one E-D during real-time play of a graphical content;
render the the inputted script to an off-screen buffer and then visualize the inputted script as at least a two-dimensional effects digital canvas;
position a virtual representation of the E-D on the digital canvas displayed on a D 1 -coupled display representing a user's physical and virtual space;
apply a geo-positional transform and scaling of the virtual E-D within the digital canvas; and
control a light effect emitted from the at least one E-D corresponding to a captured region of the transformed/scaled digital canvas based on the scripted input and a combination of different triggers recognizing at least one of an a/v element or a/v event from the a/v program, wherein the different triggers are at least one of active-play end-user scripting, computer vision score, audio score, or Optical Character Recognition.
2. The system of claim 1 , wherein the E-D is a vibro-tactile or haptic device.
3. The system of claim 1 , wherein the E-D is a light-emitting peripheral device (LEPD).
4. The system of claim 3 , wherein the LEPD is a RGB-Keyboard.
5. The system of claim 3 , wherein the LEPD is a light-emitting gaming device comprising at least one of a display/monitor, mouse, game controller, head-set, computing tower, game console, any portion and/or component of a computing tower, light-strip, bulb.
6. The system of claim 4 , wherein the RGB-keyboard lighting effects triggered by at least one of the a/v element or a/v event from the program is at least one of a nova, sparkle, rain, spiral, wave, collapse, rainbow, emoji, slash, sliding strip, cascade.
7. The system of claim 1 , wherein the a/v element recognized is at least one of opening packs/rewards, notifications as you fire, strike, block strikes, take damage, heal, death, health alerts, health meters, timers.
8. The system of claim 1 , wherein the trigger is a computer vision analysis of an a/v event comprising at least one of a pixel color score, pixel velocity score, pixel proximity score, or audio score.
9. The system of claim 1 , wherein the a/v event recognized is at least one fire, explosion, lava, lightening, freezing, taking a hit, gaining health, flying, sky diving, walking, running, falling, jumping, looking down a gun barrel, being underwater, getting into a vehicle, a flying vehicle, objects-frying pan, camp fire, launcher, special attack indicators, menus, inventory.
10. The system of claim 1 , wherein the trigger is an audio score.
11. The system of claim 1 , wherein the trigger is a collection of alphabet and/or numerical recognized by an Optical Character Recognition (OCR).
12. The system of claim 1 , wherein the trigger is a user-end-scripted trigger corresponding to at least one of an a/v element or a/v event from the program.
13. A system for processing an audio-video element in an audio-video output for light modulation of an RGB-keyboard, said system comprising:
the RGB-keyboard in communication with at least a first device (D1) outputting video programming;
a processor;
a memory element coupled to the processor;
a program executable by the processor to:
provide an interface configured for end-user script input loaded onto a web-browser page, wherein the end-user script input is any one of a basic programming language, including HTML, HTML5, or Javascript (JS) for adjusting an aspect of the immersive light effect from the at least one E-D during real-time play of a graphical content;
render the inputted script to an off-screen buffer and then visualize the inputted script as at least a two-dimensional effects digital canvas;
position a virtual representation of the RGB-keyboard on a digital canvas displayed on a D1-coupled display representing a user's physical and virtual space;
apply a geo-positional transform and scaling of the virtual E-D within the digital canvas; and
capture at least one a/v element from a corresponding region of the virtual space for modulating a lighting effect on a corresponding portion of the RGB-keyboard based on the scripted input and a combination of triggers recognizing the a/v element program, including active-play end-user scripting, computer vision score, audio score, or Optical Character Recognition.
14. The system of claim 13 , wherein the RGB-keyboard lighting effects are at least one of a nova, sparkle, rain, spiral, wave, collapse, rainbow, emoji, slash, sliding strip, cascade.
15. The system of claim 13 , wherein the a/v element recognized is at least one of 1 opening packs/rewards, notifications as you fire, strike, block strikes, take damage, heal, death, health alerts, health meters, timers.
16. The system of claim 13 , wherein the trigger is a collection of alphabet and/or numerical recognized by an Optical Character Recognition (OCR).
17. A system for end-device modulation, said system comprising:
at least one end-device (E-D) in communication with at least a first device (D 1 ) outputting audio/video programming;
a processor;
a memory element coupled to the processor;
a program executable by the processor to:
provide an interface configured for end-user script input loaded onto a web-browser page, wherein the end-user script input is any one of a basic programming language, including HTML, HTML5, or Javascript (JS) for adjusting an aspect of the immersive light effect from the at least one E-D during real-time play of a graphical content;
render the the inputted script to an off-screen buffer and then visualize the inputted script as at least a two-dimensional effects digital canvas;
position a virtual representation of the E-D on the digital canvas displayed on a D1-coupled display representing a user's physical and virtual space;
apply a geo-positional transform and scaling of the virtual E-D within the digital canvas; and
modulate an effect on a corresponding portion of the canvas-positioned E-D based on the scripted input and a combination of active-play end-user scripting and at least one different type of triggering a/v event program, including computer vision score, audio score, or Optical Character Recognition.
18. The system of claim 17 , wherein the E-D is a vibro-tactile or haptic device.
19. The system of claim 17 , wherein the E-D is a light-emitting peripheral device (LEPD).
20. The system of claim 19 , wherein the LEPD is a RGB-Keyboard.
21. The system of claim 19 , wherein the LEPD is a light-emitting gaming device comprising at least one of a display/monitor, mouse, game controller, head-set, computing tower, game console, any portion and/or component of a computing tower, light-strip, bulb.
22. The system of claim 20 , wherein the RGB-keyboard lighting effects triggered by the a/v event from the program is at least one of a nova, sparkle, rain, spiral, wave, collapse, rainbow, emoji, slash, sliding strip, cascade.
23. The system of claim 17 , wherein the trigger is a computer vision analysis of an a/v event comprising at least one of a pixel color score, pixel velocity score, pixel proximity score, or audio score.
24. The system of claim 17 , wherein the a/v event recognized is at least one of a fire, explosion, lava, lightening, freezing, taking a hit, gaining health, flying, sky diving, walking, running, falling, jumping, looking down a gun barrel, being underwater, getting into a vehicle, a flying vehicle, objects—frying pan, camp fire, launcher, special attack indicators, menus, inventory.
25. The system of claim 17 , wherein the trigger is an audio score of a certain threshold or range.