Graphical style modification for video games using machine learning
Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module generates a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream.
1. A system for enhancing Audio Visual content, the system comprising:
a processor;
a memory coupled to the processor;
non-transitory executable instructions embedded in memory configured to implement a method of Graphical Style Modification upon execution by the processor, the method comprising:
generating a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream for a duration of the buffered video stream that is less than or equal to the time it takes for a Graphical Style Modification neural network to apply the style adapted from the target image frame to said each image frame in the buffered video stream.
2. The system of claim 1 wherein the Graphical Style Modification neural network is configured to provide the style adapted video stream to a host system for display on a display screen.
3. The system of claim 1 wherein the Graphical Style Modification neural network is configured to apply the style adapted from the target image frame only to a portion of an image frame in the buffered video stream that is less than the entirety of said image frame in the buffered video stream.
4. The system of claim 1 further comprising a controller coupled to the Graphical Style Modification neural network, wherein the controller is configured to synchronize output of the style accommodation module with one or more other neural network modules and wherein the Graphical Style Modification neural network comprises a generative neural network that is trained to apply the style adapted from the target image frame to said each image frame in the buffered video stream.
5. The system of claim 4 wherein the one or more other neural network modules includes an action description module configured to describe action occurring within a video that includes the buffered video stream.
6. The system of claim 1 where in the target image frame and said each image frame in the buffered video stream are video game images.
7. A method for enhancing Audio Visual content, comprising:
generating a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream for a duration of the buffered video stream that is less than or equal to the time it takes for a Graphical Style Modification neural network to apply the style adapted from the target image frame to said each image frame in the buffered video stream.
8. The method of claim 7 further comprising providing the style adapted video stream to a host system for display on a display screen with the Graphical Style Modification neural network.
9. The method of claim 7 wherein applying the style adapted from the target image frame to the each image frame in the buffered video stream includes applying the style adapted from the target image only to a portion of an image frame in the buffered video stream that is less than the entirety of the image frame in the buffered video stream.
10. The method of claim 7 further comprising configured synchronizing output of the graphical style modification neural network with one or more other neural network modules and wherein the Graphical Style Modification neural network comprises a generative neural network that is trained to apply the color style of the target image frame to the first frame.
11. The method of claim 10 wherein the one or more other neural network modules includes an action description module configured to describe action occurring within a video that includes the buffered video stream.
12. The method of claim 7 wherein the target image frame and said each image frame in the buffered video stream are video game images.
13. A non-transitory computer-readable medium having computer readable instructions embodied therein, the instructions being configured upon execution to implement a method for enhancing Audio Visual content, the method, comprising;
generating a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream for a duration of the buffered video stream that is less than or equal to the time it takes for a Graphical Style Modification neural network to apply the style adapted from the target image frame to said each image frame in the buffered video stream.