Transformation of sound to visual and/or tactile stimuli
View Patent ↗Methods and systems to transform human-perceptible acoustic vibrations (e.g., music) to human perceptible electromagnetic radiation (i.e., human perceptible colors and/or cymatic images), and/or to human perceptible tactile vibrations, based on pitch classes of tones contained within the acoustic vibrations.
1. A method, comprising:
detecting multiple tones of a recorded sound with a signal processor, including a fundamental tone and multiple overtones of the recorded sound;
selecting a plurality of the detected tones with the signal processor; and
for each selected tone, controlling a light emitter, with a processor and memory, to output visible electromagnetic radiation at a frequency that is based on a pitch class of the selected tone and at an intensity that is based on an amplitude of the selected tone, to provide a visual depiction of a frequency content and an envelope of the recorded sound.
2. The method of claim 1 , further including, for each selected tones:
stimulating a tactile device, with the processor and memory, at a frequency that is based on the pitch class of the selected tone and at an intensity that is based on the amplitude of the selected tone.
3. The method of claim 1 , further including:
controlling a cymatic device with the processor and memory to generate a cymatic image of the plurality of the selected tones based on frequencies, the amplitudes, and phases of the selected tones.
4. The method of claim 1 , wherein the overtones include a harmonic of the fundamental tone and a partial of the fundamental tone, and wherein:
the detecting multiple tones includes detecting the fundamental tone, the harmonic, and the partial;
the selecting includes selecting the fundamental and/or the harmonic, and selecting the partial; and
the controlling includes controlling the light emitter to output visible electromagnetic radiation at a first frequency associated with the fundamental tone and the harmonic, and controlling the light emitter to output visible electromagnetic radiation at a second frequency that is associated with the partial.
5. The method of claim 1 , wherein the outputting electromagnetic radiation includes, for each selected tone:
controlling the light emitter to output the visible electromagnetic radiation at a frequency that is equal to a frequency of the selected tone multiplied by 2 j , where j is an integer between 37 and 44 depending upon an octave of the selected tone.
6. The method of claim 1 , wherein the controlling a light emitter includes, for each selected tone:
doubling an octave of the selected tone until a result of the doubling is within a spectrum of visible electromagnetic radiation.
7. The method of claim 1 , wherein the controlling a light emitter includes, for each selected tone:
controlling a saturation value of the visible electromagnetic radiation based on the amplitude of the selected tone.
8. An apparatus, comprising:
a signal processor configured to detect multiple tones of a recorded sound, including a dominant tone and multiple overtones of the recorded sound, and to select a plurality of the detected tones; and
a processor and memory configured to, for each selected tones, control a light emitter to output visible electromagnetic radiation at a frequency that is based on a pitch class of the selected tone and at an intensity that is based on an amplitude of the selected tone, to provide a visual depiction of a frequency content and an envelope of the recorded sound.
9. The apparatus of claim 8 , wherein the processor and memory are further configured to, for each selected tones:
stimulate a tactile device at a frequency that is based on the pitch class of the selected tone and at an intensity that is based on the amplitude of the selected tone.
10. The apparatus of claim 8 , wherein the processor and memory are further configured to:
control a cymatic device to generate a cymatic image of the selected tones based on the frequencies, the amplitudes phases of the selected tones.
11. The apparatus of claim 8 , wherein the overtones include a harmonic of the fundamental tone and a partial of the fundamental tone, and wherein:
the signal processor is further configured to detect the fundamental tone, the harmonic, and the partial;
the processor and memory are further configured to select the fundamental and/or the harmonic, and select the partial; and
the processor and memory are further configured to control the light emitter to output visible electromagnetic radiation at a first frequency associated with the fundamental tone and the harmonic, and to control the light emitter to output visible electromagnetic radiation at a second frequency that is associated with the partial.
12. The apparatus of claim 8 , wherein the processor and memory are further configured to, for each selected tone:
control the light emitter to output the visible electromagnetic radiation at a frequency that is equal to a frequency of the selected tone multiplied by 2 j , where j is an integer between 37 and 44 depending upon an octave of the selected tone.
13. The apparatus of claim 8 , wherein the processor and memory are further configured to, for each selected tone:
double an octave of the selected tone until a result of the doubling is within a spectrum of visible electromagnetic radiation.
14. The apparatus of claim 8 , wherein the processor and memory are further configured to, for each selected tone:
control a saturation value of the visible electromagnetic radiation based on the amplitude of the selected tone.
15. A non-transitory computer readable medium encoded with a computer program that includes instructions to cause a processor to:
detect multiple tones of a recorded sound, including a dominant tone and multiple overtones of the recorded sound;
select a plurality of the detected tones; and
for each selected tones, control a light emitter to output visible electromagnetic radiation at a frequency that is based on a pitch class of the selected tone and at an intensity that is based on an amplitude of the selected tone, to provide a visual depiction of a frequency content and an envelope of the recorded sound.
16. The computer-readable medium of claim 15 , further including instructions to cause the processor to, for each selected tone:
stimulate a tactile device at a frequency that is based on the pitch class of the selected tone and at an intensity that is based on the amplitude of the selected tone.
17. The computer-readable medium of claim 15 , further including instructions to cause the processor to:
control a cymatic device to generate a cymatic image of the selected tones based on the frequencies, the amplitudes, and phases of the selected tones.
18. The non-transitory computer readable medium of claim 15 , wherein the overtones include a harmonic of the fundamental tone and a partial of the fundamental tone, further including instructions to cause the processor to:
detect the fundamental tone, the harmonic, and the partial;
select the fundamental and/or the harmonic, and select the partial; and
control the light emitter to output visible electromagnetic radiation at a first frequency associated with the fundamental tone and the harmonic, and to control the light emitter to output visible electromagnetic radiation at a second frequency that is associated with the partial.
19. The non-transitory computer readable medium of claim 15 , further including instructions to cause the processor to, for each selected tone:
control the light emitter to output the visible electromagnetic radiation at a frequency that is equal to a frequency of the selected tone multiplied by 2 j , where j is an integer between 37 and 44 depending upon an octave of the selected tone.
20. The non-transitory computer readable medium of claim 15 , further including instructions to cause the processor to, for each selected tone:
double an octave of the selected tone until a result of the doubling is within a spectrum of visible electromagnetic radiation.