User interaction customized generation of gaming music
System, process and device configurations are provided for customized generation of gaming music. A method includes detecting at least one user interaction with a gaming system directed to generated music, and updating a parameter for music generation based on the at least one user interaction. The method also includes generating gaming music based on the parameter and a game state dynamically. Musical interactions with the gaming system may be collected during gameplay to train and retrain a dynamic music generator. Retraining may be performed for dynamic music generation interfering with output of sound effects of the electronic game. Inputs may be provided by sensors of the gaming system to detect interactions and control of dynamic music during gameplay. Inputs may include detecting presence of viewers and user environment to modify at least one output characteristic of dynamically generated music.
1 . A method comprising:
detecting, by a gaming system, at least one user interaction interacting with a first generated music outputted by the gaming system, wherein the at least one user interaction includes visual data from a sensor configured to detect a visual element in a user environment;
determining, by the gaming system, based on the visual data, a characteristic of a spectator in the user environment, wherein the spectator watches a user's interaction with the gaming system without interacting with the gaming system;
updating, by the gaming system, based on the characteristic, a parameter for music generation;
generating, by the gaming system, second generated music for the gaming system based on the parameter and a game state, wherein the second generated music is generated dynamically to include at least one musical motif based on the parameter and the game state; and
outputting, by the gaming system, the second generated music.
2 . The method of claim 1 , wherein the at least one user interaction includes at least one of a user preference, feedback on the first generated music, reducing volume, increasing volume, muting or stopping music output.
3 . The method of claim 1 , wherein the at least one user interaction includes music seed material.
4 . The method of claim 1 , wherein updating the parameter includes updating a dynamic music generation parameter to include reinforcing the parameter for music generation based on the at least one user interaction.
5 . The method of claim 1 , wherein updating the parameter includes updating a dynamic music generation parameter to remove music output based on the at least one user interaction.
6 . The method of claim 1 , wherein updating the parameter includes retraining dynamic music generation interfering with output of sound effects of an electronic game outputted by the gaming system in association with the first generated music.
7 . The method of claim 1 , wherein the at least one user interaction with the gaming system is collected during gameplay, and updating includes training a dynamic music generator during gameplay.
8 . The method of claim 1 , wherein generating gaming music includes output of dynamic music in coordination based on training of a dynamic music generator and the at least one user interaction.
9 . The method of claim 1 , wherein the characteristic includes at least one of an age, or hearing deficit associated with a loss of hearing in a certain frequency range.
10 . The method of claim 1 , wherein the characteristic includes a music preference of the spectator.
11 . The method of claim 9 , wherein the parameter includes avoiding the certain frequency range.
12 . A device configured for user interaction customized generation of gaming music, the device comprising:
a memory storing computer-executable instructions; and
a processor configured to access the memory and execute the computer-executable instructions to perform operations comprising:
detecting at least one user interaction interacting with a first generated music outputted by a gaming system, wherein the at least one user interaction includes visual data from a sensor configured to detect a visual element in a user environment;
determining, based on the visual data, a characteristic of a spectator in the user environment, wherein the spectator watches a user's interaction with the gaming system without interacting with the gaming system;
updating based on the characteristic, a parameter for music generation;
generating second generated music for the gaming system based on the parameter and a game state, wherein the second generated music is generated dynamically to include at least one musical motif based on the parameter and the game state; and
outputting the second generated music.
13 . The device of claim 12 , wherein the at least one user interaction includes at least one of entry of a user preference, feedback on the first generated music, reducing volume, increasing volume, muting, or stopping music output.
14 . The device of claim 12 , wherein the at least one user interaction includes music seed material.
15 . The device of claim 12 , wherein updating the parameter includes updating a dynamic music generation parameter to include reinforcing the parameter for music generation based on the at least one user interaction.
16 . The device of claim 12 , wherein updating the parameter includes updating a dynamic music generation parameter to remove music output based on the at least one user interaction.
17 . The device of claim 12 , wherein updating the parameter includes retraining dynamic music generation interfering with output of sound effects of an electronic game outputted by the gaming system in association with the first generated music.
18 . The device of claim 12 , wherein the at least one user interaction with the gaming system is collected during gameplay, and updating includes training a dynamic music generator during gameplay.
19 . The device of claim 12 , wherein generating gaming music includes output of dynamic music in coordination based on training of a dynamic music generator and the at least one user interaction.
20 . One or more non-transitory computer-readable media comprising computer-executable instructions that, when executed by one or more processors of a first electronic device, cause the electronic device to perform operations comprising:
detecting, by a gaming system, at least one user interaction interacting with a first generated music outputted by the gaming system, wherein visual data from a sensor configured to detect a visual element in a user environment;
determining, by the gaming system, based on the visual data, a characteristic a spectator in the user environment, wherein the spectator watches a user's interaction with the gaming system without interacting with the gaming system;
updating, by the gaming system, based on the characteristic, a parameter for music generation;
generating, by the gaming system, second generated music for the gaming system based on the parameter and a game state, wherein the second generated music is generated dynamically to include at least one musical motif based on the parameter and the game state; and
outputting, by the gaming system, the second generated music.