Biometric-music interaction methods and systems
A system and method for the automatic, procedural generation of musical content in relation to biometric data. The systems and methods use a user's device, such as a cell phone to capture image data of a body part, and derive a biometric signal from the image data. The biometric signal includes biometric parameters, which are used by a music generation engine to generate music. The music generation can also be based on user-specific data and quality data related to the biometric detection process.
1. A therapy system comprising:
a biosensor interface configured to acquire biometric data, the biosensor interface comprising an image sensor configured to capture image data, wherein a biometric signal is derived from the captured image data and one or more biometric parameters associated with the biometric signal are extracted therefrom; wherein further the image data captured by the image sensor is separable into red, green and blue images weighted according to the strength of detection of the biometric signal, wherein the biosensor interface is configured to perform a detection analysis on a selected color at a higher sampling rate than said other colors; and wherein the biosensor interface is configured to generate a color selection identifier containing information relating to said selected color for a user, said color selection identifier being integrated into an image capture configuration; and
a therapy engine coupled with the biosensor interface and configured to:
obtain the biometric data via the biosensor interface;
construct a multimodal digital therapy regimen associated with a therapy as a function of the biometric data, the multimodal digital therapy regimen comprising rendering instructions to generate a visual or audio signal, wherein the generated visual or audio signal provides a visualization or audio representation of one or more aspects of the biometric data; and
configure a device to render the multimodal digital therapy regimen according to the rendering instructions,
the therapy engine further comprising a therapy template database configured to store template objects representing the therapy, wherein the therapy engine is further configured to identify at least two of the template objects based on the biometric data and incorporate the identified at least two template objects into said generated visual or audio signal to provide the visualization or audio representation of one or more aspects of the biometric data; and
a communication interface to communicate the multimodal digital therapy regimen as a media presentation to a user of the system.
2. The system of claim 1 , wherein the multimodal digital therapy regimen is associated with a chest therapy.
3. The system of claim 1 , wherein the multimodal digital therapy regimen is associated with a mindfulness therapy.
4. The system of claim 1 , wherein the multimodal digital therapy regimen is constructed based on an active cycle breathing exercise template.
5. The system of claim 1 , wherein the multimodal digital therapy regimen is constructed based on a pranic breathing exercise template.
6. The system of claim 1 , wherein the biosensor interface comprises a photoplethysmograph.
7. The system of claim 6 , wherein the photoplethysmograph comprises a smart phone.
8. The system of claim 1 , wherein the biosensor interface comprises a smart phone.
9. The system of claim 1 , wherein the therapy engine comprises a mobile computing device configured to operate as the therapy engine.
10. The system of claim 9 , wherein the mobile computing device comprises at least one of the following: a cell phone, a media player, a medical device, a vehicle, a tablet, a phablet, and a game device.
11. The system of claim 9 , wherein the therapy engine comprises a remote server configured to operate as the therapy engine.
12. The system of claim 9 , wherein the multimodal digital therapy regimen comprises instructions to generate at least one of the following modalities of data: audio data, image data, video data, haptic data, kinesthetic data, olfactory data, and taste data.
13. The system of claim 9 , wherein therapy engine is further configured to obtain additional biometric data in response to a previously rendered therapy regimen.
14. The system of claim 9 , wherein the biometric data comprises at least one of the following: a breath rate, image data, audio data, accelerometer data, pulse oximetry data, EKG data, EEG data, galvanic data, and temperature data.
15. The system of claim 1 , wherein all of the elements of the system are physically present in a single device.
16. The system according to claim 1 , wherein the biometric interface is configured to perform detection analysis on a strongest color at said higher sampling rate than said other colors.
17. The system according to claim 1 , wherein the biometric interface is configured to store weightings of the red, green and blue images as a weighted proportion between the red, green and blue images for an individual user.
18. A therapy system comprising:
a biosensor interface configured to acquire biometric data, the biosensor interface comprising an image sensor configured to capture image data, wherein a biometric signal is derived from the captured image data and one or more biometric parameters associated with the biosensor signal are extracted therefrom; wherein further the image data captured by the image sensor is separable into red, green and blue images weighted according to the strength of detection of the biometric signal; and
a therapy engine coupled with the biosensor interface and configured to:
obtain the biometric data via the biosensor interface;
construct a multimodal digital therapy regimen associated with a therapy as a function of the biometric data, the multimodal digital therapy regimen comprising rendering instructions to generate a visual or audio signal, wherein the generated visual or audio signal provides a visualization or audio representation of one or more aspects of the biometric data; and
configure a device to render the multimodal digital therapy regimen according to the rendering instructions,
the therapy engine further comprising a therapy template database configured to store template objects representing the therapy, wherein the therapy engine is further configured to identify at least two of the template objects based on the biometric data and incorporate the identified at least two template objects into said generated visual or audio signal to provide the visualization or audio representation of one or more aspects of the biometric data; and
a communication interface to communicate the multimodal digital therapy regimen as a media presentation to a user of the therapy system, the communication interface being configured to modify a quality of the media presentation based on a detected quality of the images provided by the image sensor, wherein a biometric detection engine determines the detected quality of the images.