Methods, systems and devices for providing portions of recorded game content in response to an audio trigger
A system that incorporates the subject disclosure may include, for example, a gaming system that cooperates with a graphical user interface to enable user modification and enhancement of one or more audio streams associated with the gaming system. In embodiments, the audio streams may include a game audio stream, a chat audio stream of conversation among players of a video game, and a microphone audio stream of a player of the video game. One of the audio streams may trigger an action in the gaming system such as recording a portion of game content for a timer period. Additional embodiments are disclosed.
1. A method, comprising:
receiving, by a processing system including a processor, a gaming system output stream during a video game, the gaming system output stream including audio output captured by a microphone, video output captured by a camera, or a combination thereof;
selecting, by the processing system, a trigger model for the gaming system output stream, wherein the selecting the trigger model comprises selecting the trigger model from a group of trigger models according to the video game, a genre of the video game, a location of a gaming device where the audio output was captured, or a combination thereof;
detecting, by the processing system, according to the trigger model, a current trigger in the gaming system output stream during the video game;
recording, by the processing system according to the trigger model, a trigger clip of game content, wherein the trigger clip comprises a portion of game content that includes the current trigger; and
providing, by the processing system, the trigger clip to a group of gaming devices over a communication network, wherein each gaming device of the group of gaming devices is associated with one player of the video game.
2. The method of claim 1 , wherein the detecting a current trigger comprises:
providing, by the processing system, the gaming system output stream to a neural network; and
receiving, by the processing system, an indication that the current trigger has been detected.
3. The method of claim 2 , wherein the neural network has been trained on training data from one or more video games.
4. The method of claim 3 , wherein the training data comprises data corresponding to vocal utterances and non-vocal utterances of players of the one or more video games.
5. The method of claim 4 , wherein the training data comprises data corresponding to conversations, laughter and screaming of players of the one or more video games.
6. The method of claim 1 , wherein the detecting a current trigger in the gaming system output stream comprises:
identifying, by the processing system, one of a laugh or a scream by a player of the video game in the gaming system output stream.
7. The method of claim 1 , wherein the receiving a gaming system output stream comprises:
receiving, by the processing system; a plurality of audio streams including a chat audio stream, a game audio stream and a microphone audio stream; and
detecting, by the processing system, the current trigger in one of the chat audio stream and the microphone audio stream.
8. A method comprising:
receiving, by a processing system including a processor, an input stream during a video game, the input stream including audio input captured by a microphone, video input captured by a camera, or a combination thereof;
applying, by the processing system, a trigger model to the input stream, wherein the trigger model is generated by a neural network trained on a training audio input, a training video input, or a combination thereof, and wherein the trigger model is selected from a group of trigger models according to the video game, a genre of the video game, a location of a gaming device where the audio input or video input was captured, or a combination thereof;
detecting, by the processing system according to the trigger model, a current trigger in the input stream during the video game, wherein the current trigger comprises an audio trigger, a video trigger or combination thereof; and
recording, by the processing system, a trigger clip of game content, wherein the trigger clip comprises a portion of game content for a time period before and after the current trigger.
9. The method of claim 8 , wherein the training audio input includes speech, laughing, and screaming.
10. The method of claim 8 , wherein the detecting the current trigger in the input stream during the video game is based on detecting an emotion change of a player from video input of the player and audio input captured from the player.
11. The method of claim 8 , further comprising
capturing speech by the microphone as the audio input; and
converting the speech to text and analyzing the text, wherein the detecting the current trigger in the input stream during the video game is based on the analyzing the text.
12. The method of claim 8 , wherein the neural network has been trained on training data from one or more video games.
13. The method of claim 12 , wherein the training audio input comprises data corresponding to vocal utterances and non-vocal utterances of players of the one or more video games.
14. The method of claim 8 , wherein the detecting a current trigger in the input stream during the video game comprises:
identifying, by the processing system, one of a laugh or a scream by a player of the video game in the input stream.
15. The method of claim 8 , wherein the receiving an input stream comprises:
receiving, by the processing system; a plurality of audio streams including a chat audio stream, a game audio stream and a microphone audio stream; and
detecting, by the processing system, the current trigger in one of the chat audio stream and the microphone audio stream.
16. A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
receiving, by a processing system including a processor, an input stream during a video game, the input stream including audio input captured by a microphone, video input captured by a camera, or a combination thereof;
applying, by the processing system, a trigger model to the input stream, wherein the trigger model is selected from a group of trigger models according to the video game, a genre of the video game, a location of a gaming device where the audio input or video input was captured, or a combination thereof;
detecting, by the processing system according to the trigger model, a current trigger in the input stream during the video game, wherein the current trigger comprises an audio trigger, a video trigger or combination thereof; and
recording, by the processing system, a trigger clip of game content, wherein the trigger clip comprises a portion of game content for a time period before and after the current trigger.
17. The non-transitory machine-readable medium of claim 16 wherein the trigger model is generated by a neural network trained on a training audio input, a training video input, or a combination thereof.
18. The non-transitory machine-readable medium of claim 17 wherein the training audio input comprises data corresponding to vocal utterances and non-vocal utterances of players of one or more video games.
19. The non-transitory machine-readable medium of claim 18 , wherein the detecting a current trigger in the input stream during the video game comprises:
identifying, by the processing system, one of a laugh or a scream by a player of the video game in the input stream.
20. The non-transitory machine-readable medium of claim 19 , wherein the receiving an input stream comprises:
receiving, by the processing system; a plurality of audio streams including a chat audio stream, a game audio stream and a microphone audio stream; and
detecting, by the processing system, the current trigger in one of the chat audio stream and the microphone audio stream.