IP Library › Granted Patent US 11,154,773
Granted Patent B2
US 11,154,773 · App. 16/669,939 · Granted Oct 26, 2021

Game event recognition

Inventors: Jonathan White (Fort Collins, CO); Dave Clark (Cary, NC); Nathan Otterness (Mebane, NC); Travis Muhlestein (Redmond, WA); Prabindh Sundareson (Bangalore, IN); Jim van Welzen (Durham, NC); Jack van Welzen (Raleigh, NC)
Assignee: NVIDIA CORPRATION
A63F13/30A63F13/426A63F13/428A63F13/44A63F13/79A63F13/86G07F17/3209H04N21/23418H04N21/44008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,154,773
App. No.
16/669,939
Granted
Oct 26, 2021
Kind
B2
Abstract

A game-agnostic event detector can be used to automatically identify game events. Game-specific configuration data can be used to specify types of pre-processing to be performed on media for a game session, as well as types of detectors to be used to detect events for the game. Event data for detected events can be written to an event log in a form that is both human- and process-readable. The event data can be used for various purposes, such as to generate highlight videos or provide player performance feedback.

Claims (57)

1. A computer-implemented method, comprising:

receiving, by at least one electronic device configured for local or network-based processing, video data corresponding to a gameplay session for a player of a game;

performing, by the least one electronic device and based at least in part on a game configuration file, pre-processing of a frame of the video data to determine an event region;

analyzing, by the least one electronic device, the video data for the event region using one or more event detectors;

determining, by the least one electronic device, an event, based at least in part on a change displayed in the event region, with at least a minimum level of confidence; and

providing, by the least one electronic device, event data corresponding to the determined event.

2. The computer-implemented method of claim 1 , further comprising:

determining, by the least one electronic device, the one or more event detectors using a game-specific configuration file, the event detectors performing at least one of image recognition, pattern matching, icon recognition, optical character recognition, audio recognition, or player input analysis.

3. The computer-implemented method of claim 1 , further comprising:

determining, by the least one electronic device, one or more pre-processing algorithms to use for the pre-processing using a game-specific configuration file, the pre-processing algorithms performing at least one of region selection, upscaling, downscaling, filtering, stretching, warping, perspective correction, noise removal, color space transform, color isolation, or value thresholding.

4. The computer-implemented method of claim 1 , further comprising:

receiving, by the least one electronic device from the one or more event detectors, one or more event cues; and

utilizing, by the least one electronic device, at least one cue-to-event translation algorithm to determine the event based, at least in part, upon the one or more event cues.

5. The computer-implemented method of claim 1 , further comprising:

receiving, by the least one electronic device, the video data in the form of a file or stream during, or after, the gameplay session.

6. The computer-implemented method of claim 1 , further comprising:

writing, by the least one electronic device, the event data to an event log for the gameplay session.

7. The computer-implemented method of claim 6 , further comprising:

analyzing, by the least one electronic device, the event data in the event log for purposes of identifying events of one or more event types, and associated with the player, in the gameplay session.

8. The computer-implemented method of claim 7 , further comprising:

generating, by the least one electronic device, game-related content corresponding to the event data in the event log, the game-related content including at least one of a highlight video, a game montage, player coaching, player skill determination, or player gameplay style analysis.

9. The computer-implemented method of claim 1 , further comprising:

analyzing, by the least one electronic device, additional data for the gameplay session, the additional data including at least one of video data of the player, audio data for the player, biometric data for the player, or game input of the player.

10. A system comprising:

one or more processors accessible locally or over a network; and

memory including instructions that, when executed by the one or more processors, cause the system to:

receive media corresponding to a gameplay session for a player of a game;

determine at least one event region in the media, based at least in part on a game configuration file;

analyze the video data for the at least one event region using a game-agnostic detection engine and one or more event detectors identified for the game;

determine an event, based at least in part on a change displayed in the at least one event region; and

provide event data corresponding to the determined event.

11. The system of claim 10 , wherein the instructions when executed further cause the system to:

determine the one or more event detectors using a game-specific configuration file, the event detectors performing at least one of image recognition, pattern matching, icon recognition, optical character recognition, audio recognition, or player input analysis.

12. The system of claim 10 , wherein the instructions when executed further cause the system to:

determine one or more pre-processing algorithms to use for pre-processing of the media using a game-specific configuration file, the pre-processing algorithms performing at least one of event region selection, upscaling, downscaling, filtering, stretching, warping, perspective correction, noise removal, color space transform, color isolation, or value thresholding.

13. The system of claim 10 , wherein the instructions when executed further cause the system to:

receive, from the one or more event detectors, one or more event cues; and

utilize at least one cue-to-event translation algorithm to determine the event based, at least in part, upon the one or more event cues.

14. The system of claim 10 , wherein the instructions when executed further cause the system to:

receive the media in the form of a file or stream during, or after, the gameplay session.

15. The system of claim 10 , wherein the instructions when executed further cause the system to:

write the event data to an event log for the gameplay session, the event data being both human and process readable, the event log being accessible at least for identifying events of one or more event types, and associated with the player, in the gameplay session.

16. A non-transitory machine-readable medium having stored thereon a set of instructions, which if performed by one or more processors accessible locally or over a network, cause the one or more processors to at least:

receive media representative of a gameplay session for a game, the media including video data;

determine at least one event region in the media, based at least in part on a game configuration file;

analyze the video data for the at least one event region using one or more event detectors identified for the game;

determine an event, based at least in part on a change displayed in the at least one event region; and

provide event data corresponding to the determined event.

17. The non-transitory machine-readable medium of claim 16 , wherein the instructions if performed further cause the one or more processors to:

determine the one or more event detectors using a game-specific configuration file, the event detectors performing at least one of image recognition, pattern matching, icon recognition, optical character recognition, audio recognition, or player input analysis.

18. The non-transitory machine-readable medium of claim 16 , wherein the instructions if performed further cause the one or more processors to:

determine one or more pre-processing algorithms to use for pre-processing of the media using a game-specific configuration file, the pre-processing algorithms performing at least one of event region selection, upscaling, downscaling, filtering, stretching, warping, perspective correction, noise removal, color space transform, color isolation, or value thresholding.

19. The non-transitory machine-readable medium of claim 16 , wherein the instructions if performed further cause the one or more processors to:

receive, from the one or more event detectors, one or more event cues; and

utilize at least one cue-to-event translation algorithm to determine the event based, at least in part, upon the one or more event cues.

20. The non-transitory machine-readable medium of claim 16 , wherein the instructions if performed further cause the one or more processors to:

write the event data to an event log for the gameplay session, the event data being both human and process readable, the event log being accessible at least for identifying events of one or more event types, and associated with a player, in the gameplay session.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2019
From: WHITE, JONATHAN; CLARK, DAVE; OTTERNESS, NATHAN; MUHLESTEIN, TRAVIS; SUNDARESON, PRABINDH; VAN WELZEN, JIM; VAN WELZEN, JACK
To: NVIDIA CORPRATION
Reel/Frame 050879/0610 →
Continuity (1)
Related Publication 20210129017A1 · May 6, 2021