Modification of electronic system operation based on acoustic ambience classification
Methods and systems for modification of electronic system operation based on acoustic ambience classification are presented. In an example method, at least one audio signal present in a physical environment of a user is detected. The at least one audio signal is analyzed to extract at least one audio feature from the audio signal. The audio signal is classified based on the audio feature to produce at least one classification of the audio signal. Operation of an electronic system interacting with the user in the physical environment is modified based on the classification of the audio signal.
1. An apparatus comprising:
at least one memory;
instructions; and
at least one processor to execute the instructions to:
extract an audio feature from a first audio signal, the first audio signal detected by a sensor during presentation of media content by a media player in an environment, the audio feature corresponding to the media content;
identify supplemental audio information from a second audio signal, the second audio signal detected by the sensor during the presentation of the media content in the environment, the supplemental audio information indicative of an action by one or more users in the environment, the action indicative of a reaction of the one or more users to the media content;
assign a first classification to the first audio signal based on the audio feature;
assign a second classification to the second audio signal based on the supplemental audio information; and
cause the media player to modify operation of the media player based on the reaction of the one or more users to the media content.
2. The apparatus of claim 1 , wherein the at least one processor is to execute a first classification model to identify the audio feature and a second classification model to identify the supplemental audio information.
3. The apparatus of claim 1 , wherein the first audio signal is a filtered audio signal and the second audio signal is an unfiltered audio signal.
4. The apparatus of claim 1 , wherein the supplemental audio information includes an environmental noise and the at least one processor is to identify the environmental noise in the second audio signal based on a location of the environment.
5. The apparatus of claim 1 , wherein the at least one processor generates an instruction to cause the media player to adjust a volume of the media content based on a level of the environmental noise relative to a threshold.
6. The apparatus of claim 1 , wherein the action of the one or more users includes a user input at the media player.
7. The apparatus of claim 1 , wherein the action of the one or more users includes talking or singing by the one or more users during the presentation of the media content.
8. The apparatus of claim 1 , wherein the audio feature includes one or more of volume, pitch, energy, bandwidth, or zero crossing rates associated with the first audio signal.
9. The apparatus of claim 1 , wherein the at least one processor causes the media player to modify the media content by generating an instruction to cause the media player to adjust one or more of a volume of the media content or a playlist including the media content.
10. A system comprising:
at least one sensor to detect (a) a first signal, the first signal detected by the at least one sensor during presentation of media content by a media player in an environment including the at least one sensor and (b) a second signal, the second signal detected by the at least one sensor during the presentation of the media content in the environment, the second signal including noise data associated with one or more users in the environment indicative of a reaction of the one or more users to the media content;
memory;
instructions; and
at least one processor to execute the instructions to:
identify an audio feature of the first signal, the audio feature corresponding to the media content;
assign a first classification to the first signal based on the audio feature;
assign a second classification to the second signal based on the noise data; and
cause the media player to modify operation of the media player based on the reaction of the one or more users to the media content.
11. The system of claim 10 , wherein the at least one processor is to filter the first signal to remove noise from the first signal.
12. The system of claim 10 , wherein the noise data is indicative of an action performed by the one or more users during the presentation of the media content.
13. The system of claim 10 , wherein the at least one processor is to generate an instruction to cause the media player to adjust a volume of the media content based on a level of the noise data relative to a threshold.
14. The system of claim 10 , wherein the at least one sensor includes one or more of a touch sensor or a vibration sensor.
15. At least one non-transitory machine readable storage medium comprising instructions that, when executed, cause at least one machine to at least:
extract an audio feature from a first audio signal, the first audio signal detected by a sensor during presentation of media content by a media player in an environment, the audio feature corresponding to the media content;
identify supplemental audio information from a second audio signal, the second audio signal detected by the sensor during the presentation of the media content in the environment, the supplemental audio information indicative of an action by one or more users in the environment, the action indicative of a reaction of the one or more users to the media content;
assign a first classification to the first audio signal based on the audio feature;
assign a second classification to the second audio signal based on the supplemental audio information; and
cause the media player to modify operation of the media player based on the reaction of the one or more users to the media content.
16. The at least one non-transitory machine readable storage medium of claim 15 , wherein the instructions, when executed, cause the at least one machine to execute a first classification model to identify the audio feature and a second classification model to identify the supplemental audio information.
17. The at least one non-transitory machine readable storage medium of claim 15 , wherein the instructions, when executed, cause the at least one machine to generate an instruction to cause the media player to adjust a volume of the media content based on a level of the environmental noise relative to a threshold.
18. The at least one non-transitory machine readable storage medium of claim 15 , wherein the instructions, when executed, cause the at least one machine to cause the media player to modify the media content by generating an instruction to cause the media player to adjust one or more of a volume of the media content or a playlist including the media content.
19. The at least one non-transitory machine readable storage medium of claim 15 , wherein the audio feature includes one or more of volume, pitch, energy, bandwidth, or zero crossing rates associated with the first audio signal.