Audio techniques for music content generation
Techniques are disclosed relating to implementing audio techniques for real-time audio generation. For example, a music generator system may generate new music content from playback music content based on different parameter representations of an audio signal. In some cases, an audio signal can be represented by both a graph of the signal (e.g., an audio signal graph) relative to time and a graph of the signal relative to beats (e.g., a signal graph). The signal graph is invariant to tempo, which allows for tempo invariant modification of audio parameters of the music content in addition to tempo variant modifications based on the audio signal graph.
1. A method, comprising:
accessing, by a computer system, a set of music content;
generating, by the computer system, a first graph of an audio signal of the music content, wherein the first graph is a graph of audio parameters relative to time;
generating, by the computer system, a second graph of the audio signal of the music content, wherein the second graph is a signal graph of the audio parameters relative to beat; and
generating, by the computer system, new music content from playback music content by modifying the audio parameters in the playback music content, wherein the audio parameters are modified based on a combination of the first graph and the second graph.
2. The method of claim 1 , wherein the audio parameters in the first graph and the second graph are defined by nodes in the graphs that determine changes in properties of the audio signal.
3. The method of claim 2 , wherein generating the new music content includes:
receiving the playback music content;
determining a first node in the first graph corresponding to an audio signal in the playback music content;
determining a second node in the second graph that corresponds to the first node;
determining one or more specified audio parameters based on the second node; and
modifying one or more properties of an audio signal in the playback music content by modifying the specified audio parameters.
4. The method of claim 3 , further comprising:
determining one or more additional specified audio parameters based on the first node; and
modifying one or more properties of an additional audio signal in the playback music content by modifying the additional specified audio parameters.
5. The method of claim 3 , wherein determining the one or more specified audio parameters includes:
determining a portion of the second graph to implement for the audio parameters based on a position of the second node in the second graph; and
selecting the audio parameters from the determined portion of the second graph as the one or more specified audio parameters.
6. The method of claim 5 , wherein modifying the one or more specified audio parameters modifies a portion of the playback music content that corresponds to the determined portion of the second graph.
7. The method of claim 3 , wherein the modified properties of the audio signal in the playback music content include signal amplitude, signal frequency, or a combination thereof.
8. The method of claim 1 , further comprising applying one or more automations to the audio parameters, wherein at least one of the automations is a pre-programmed temporal manipulation of at least one of the audio parameters.
9. The method of claim 8 , further comprising applying one or more modulations to the audio parameters, wherein at least one of the modulations modifies at least one of the audio parameters multiplicatively on top of at least one automation.
10. The method of claim 1 , further comprising providing, by the computer system, a heap allocated memory for storage of one or more objects associated with the set of music content, the one or more objects including at least one of: the audio signal, the first graph, and the second graph.
11. The method of claim 10 , further comprising storing the one or more objects in a data structure list in the heap allocated memory, wherein the data structure list includes a serialized list of links for the objects.
12. A non-transitory computer-readable medium having instructions stored thereon that are executable by a computing device to perform operations comprising:
accessing a set of music content;
generating a first graph of an audio signal of the music content, wherein the first graph is a graph of audio parameters relative to time;
generating a second graph of the audio signal of the music content, wherein the second graph is a signal graph of the audio parameters relative to beat; and
generating new music content from playback music content by modifying the audio parameters in the playback music content, wherein the audio parameters are modified based on a combination of the first graph and the second graph.
13. The non-transitory computer-readable medium of claim 12 , wherein the audio parameters in the first graph and the second graph are defined by nodes in the graphs that determine changes in properties of the audio signal, and wherein generating the new music content includes:
receiving the playback music content;
determining a first node in the first graph corresponding to an audio signal in the playback music content;
determining a second node in the second graph that corresponds to the first node;
determining one or more specified audio parameters based on the second node; and
modifying one or more properties of an audio signal in the playback music content by modifying the specified audio parameters.
14. The non-transitory computer-readable medium of claim 13 , wherein the modified properties of the audio signal in the playback music content include signal amplitude, signal frequency, or a combination thereof.
15. The non-transitory computer-readable medium of claim 12 , further comprising storing one or more objects associated with the set of music content in a heap allocated memory, wherein the one or more objects include at least one of: the audio signal, the first graph, and the second graph.
16. The non-transitory computer-readable medium of claim 12 , further comprising adding an identifier to the new music content, and storing the new music content in at least one circular buffer in a static array of circular buffers.
17. The non-transitory computer-readable medium of claim 16 , wherein the static array of circular buffers is accessible by a single user.
18. An apparatus, comprising:
one or more processors; and
one or more memories having program instructions stored thereon that are executable by the one or more processors to:
access a set of music content;
generate a first graph of an audio signal of the music content, wherein the first graph is a graph of audio parameters relative to time;
generate a second graph of the audio signal of the music content, wherein the second graph is a signal graph of the audio parameters relative to beat; and
generate new music content from playback music content by modifying the audio parameters in the playback music content, wherein the audio parameters are modified based on a combination of the first graph and the second graph.
19. The apparatus of claim 18 , further comprising an application programming interface, wherein the application programming interface implements application of one or more automations to the audio parameters.