Gameplay event detection and gameplay enhancement operations
Information handling systems, methods, and computer-readable media enable gameplay event detection and gameplay enhancement operations. One or more in-game events may be detected by monitoring audio content, by monitoring video content, by monitoring user input, by monitoring other information, or a combination thereof. The one or more in-game events (and information related to the one or more in-game events) may be stored at a database. Information of the database may be accessed to trigger one or more gameplay enhancement operations. The one or more gameplay enhancement operations may include an automatic highlight capture operation, a dynamic screen aggregation operation, a dynamic position switch operation, a dynamic player switch operation, a gameplay enhancement operation using one or more peripheral devices (e.g., a lighting effect or a haptic feedback event), one or more other gameplay enhancement operations, or a combination thereof.
1. A method, comprising:
during execution of a video game application by an information handling system to generate an audio-visual (AV) stream, identifying one or more in-game events associated with the video game application by:
analyzing one or more elements of a heads-up display (HUD) of a video portion of the AV stream to identify one or more in-game events associated with the video game application; and
presenting, by an audio driver, a first number of audio channels to the video game application for generation of the AV stream, wherein the first number of audio channels is greater than a second number of audio channels configured for an output device of the information handling system;
analyzing the first number of audio channels of an audio portion of the AV stream to identify one or more in-game events associated with the video game application; and
down-converting the first number of audio channels to the second number of audio channels for output to the output device;
based on the one or more in-game events, storing, to a database, first video metadata corresponding to a game state of the video game application, the first video metadata associated with a first user;
retrieving, from the database, second video metadata corresponding to the game state, the second video metadata associated with a second user; and
based on a comparison of the first video metadata and the second video metadata, initiating one or more gameplay enhancement operations during the execution of the video game application.
2. The method of claim 1 , further comprising:
receiving user selection of a region of interest (ROI) including an element of the one or more elements of the HUD; and
identifying the element based on the user selection.
3. The method of claim 1 , further comprising identifying an element of the one or more elements by detecting that the element maintains a common position in at least a threshold number of frames of the video portion.
4. The method of claim 1 , wherein generating the one or more gameplay enhancement operations includes generating a gameplay assistance message based on the first video metadata, and wherein the gameplay assistance message includes a second HUD that is presented in the AV stream.
5. The method of claim 4 , wherein the gameplay assistance message indicates one or more tips, based on gameplay of the second user indicated by the second video metadata, to improve gameplay performance of the first user relative to the second user.
6. The method of claim 1 , further comprising tracking the one or more elements during gameplay of the video game application, wherein tracking the one or more elements includes generating a mask based on locations of the one or more elements within the HUD.
7. The method of claim 6 , further comprising:
applying the mask to the video portion to generate a masked version of the video portion; and
sampling the one or more elements from the masked version to identify one or more in-game events associated with the video game application.
8. An information handling system, comprising:
a memory; and
a processor coupled to the memory, the processor configured to:
during execution of a video game application to generate an audio-visual (AV) stream, identify one or more in-game events associated with the video game application by:
analyzing one or more elements of a heads-up display (HUD) of a video portion of the AV stream to identify one or more in-game events associated with the video game application; and
presenting, by an audio driver, a first number of audio channels to the video game application for generation of the AV stream, wherein the first number of audio channels is greater than a second number of audio channels configured for an output device of the information handling system;
analyzing the first number of audio channels of an audio portion of the AV stream to identify one or more in-game events associated with the video game application; and
down-converting the first number of audio channels to the second number of audio channels for output to the output device;
based on the one or more in-game events, store, to a database, first video metadata corresponding to a game state of the video game application, the first video metadata associated with a first user;
retrieve, from the database, second video metadata corresponding to the game state, the second video metadata associated with a second user; and
based on a comparison of the first video metadata and the second video metadata, initiate one or more gameplay enhancement operations during the execution of the video game application.
9. The information handling system of claim 8 , wherein the processor is further configured to receive user selection of a region of interest (ROI) including an element of the one or more elements of the HUD and to identify the element based on the user selection.
10. The information handling system of claim 8 , wherein the processor is further configured to identify an element of the one or more elements by detecting that the element maintains a common position in at least a threshold number of frames of the video portion.
11. The information handling system of claim 8 , wherein the processor is further configured to generate a gameplay assistance message based on the first video metadata, wherein the gameplay assistance message includes a second HUD that is presented in the AV stream.
12. The information handling system of claim 11 , wherein the gameplay assistance message indicates one or more tips, based on gameplay of the second user indicated by the second video metadata, to improve gameplay performance of the first user relative to the second user.
13. The information handling system of claim 8 , wherein the processor is further configured to track the one or more elements during gameplay of the video game application by generating a mask based on locations of the one or more elements within the HUD, by applying the mask to the video portion to generate a masked version of the video portion, and by sampling the one or more elements from the masked version to identify one or more in-game events associated with the video game application.
14. A non-transitory computer-readable medium storing instructions executable by a processor to perform operations, the operations comprising:
during execution of a video game application by an information handling system to generate an audio-visual (AV) stream, identifying one or more in-game events associated with the video game application by:
analyzing one or more elements of a heads-up display (HUD) of a video portion of the AV stream to identify one or more in-game events associated with the video game application;
presenting, by an audio driver, a first number of audio channels to the video game application for generation of the AV stream, wherein the first number of audio channels is greater than a second number of audio channels configured for an output device of the information handling system;
analyzing the first number of audio channels of an audio portion of the AV stream to identify one or more in-game events associated with the video game application; and
down-converting the first number of audio channels to the second number of audio channels for output to the output device;
based on the one or more in-game events, storing, to a database, first video metadata corresponding to a game state of the video game application, the first video metadata associated with a first user;
retrieving, from the database, second video metadata corresponding to the game state, the second video metadata associated with a second user; and
based on a comparison of the first video metadata and the second video metadata, initiating one or more gameplay enhancement operations during the execution of the video game application.
15. The non-transitory computer-readable medium of claim 14 , further comprising:
receiving user selection of a region of interest (ROI) including an element of the one or more elements of the HUD; and
identifying the element based on the user selection.
16. The non-transitory computer-readable medium of claim 14 , further comprising identifying an element of the one or more elements by detecting that the element maintains a common position in at least a threshold number of frames of the video portion.
17. The non-transitory computer-readable medium of claim 14 , wherein the operations further include generating a gameplay assistance message based on the first video metadata, wherein the gameplay assistance message includes a second HUD that is presented in the AV stream.
18. The non-transitory computer-readable medium of claim 17 , wherein the gameplay assistance message indicates one or more tips, based on gameplay of the second user indicated by the second video metadata, to improve gameplay performance of the first user relative to the second user.
19. The non-transitory computer-readable medium of claim 14 , wherein the operations further comprise tracking the one or more elements during gameplay of the video game application, and wherein tracking the one or more elements includes generating a mask based on locations of the one or more elements within the HUD.
20. The non-transitory computer-readable medium of claim 19 , wherein the operations further comprise:
applying the mask to the video portion to generate a masked version of the video portion; and
sampling the one or more elements from the masked version to identify one or more in-game events associated with the video game application.