Parameterized noise synthesis for graphical artifact removal
Pre-encoding noise parameterization techniques mitigate or eliminate banding and other graphical artifacts in video frames for decoding and presentation by a client device. For one or more input video frames, a quantization parameter associated with the input video frames is identified. Noise synthesis parameters are determined based on the identified quantization parameter, and the input video frames are encoded for transmission. The encoded video frames are transmitted to the client device along with the determined noise synthesis parameters, for use by the client device in generating synthetic noise to add to resulting video frames decoded by the client device.
1 . A computer-implemented method comprising:
for one or more input video frames:
identifying a quantization parameter (QP) for the one or more input video frames;
encoding, using the identified QP, the one or more input video frames for transmission to at least one client device;
determining, based at least in part on the identified QP and independent of any noise present in the one or more input video frames, one or more noise synthesis parameters; and
initiating transmission of one or more encoded video frames to the at least one client device based on the encoding of the one or more input video frames, wherein initiating the transmission includes providing the determined one or more noise synthesis parameters to the at least one client device.
2 . The computer-implemented method of claim 1 , further comprising generating the one or more input video frames via a game application.
3 . The computer-implemented method of claim 1 , wherein the one or more noise synthesis parameters are determined as a function of the identified QP.
4 . The computer-implemented method of claim 1 , further comprising pre-processing the one or more input video frames prior to the encoding.
5 . The computer-implemented method of claim 4 , further comprising identifying one or more video frame characteristics based on the pre-processing of the input video frames, and wherein the determining of the one or more noise synthesis parameters is further based in part on the one or more video frame characteristics.
6 . The computer-implemented method of claim 5 , wherein the one or more additional video frame characteristics include a variance of at least one of the one or more input video frames.
7 . The computer-implemented method of claim 1 , wherein encoding the one or more input video frames for transmission includes encoding the one or more input video frames in accordance with an AVI video coding standard.
8 . The computer-implemented method of claim 1 , wherein providing the determined noise synthesis parameters includes providing the determined noise synthesis parameters for use by the at least one client device in synthesizing noise to apply to the one or more transmitted video frames.
9 . A system comprising at least one processor and a memory coupled to the at least one processor and storing a set of executable instructions, that when executed by the at least one processor, manipulate the at least one processor to perform the method of claim 1 .
10 . A system, comprising:
a first processor to, for one or more input video frames:
identify a quantization parameter (QP) associated with the one or more input video frames;
encode, using the identified QP, the one or more input video frames for transmission to at least one client device;
determine, based at least in part on the identified QP and independent of any noise present in the one or more input video frames, one or more noise synthesis parameters; and
initiate transmission of one or more encoded video frames to the at least one client device based on the encoding of the one or more input video frames, wherein to initiate the transmission includes to provide the determined one or more noise synthesis parameters to the at least one client device.
11 . The system of claim 10 , wherein the first processor is further to pre-process the one or more input video frames.
12 . The system of claim 10 , wherein the first processor is further to identify one or more video frame characteristics based on the pre-processing of the input video frames, and wherein to determine the one or more noise synthesis parameters is further based on the one or more video frame characteristics.
13 . The system of claim 12 , wherein the one or more video frame characteristics include a variance of at least one of the one or more input video frames.
14 . The system of claim 10 , wherein to encode the one or more input video frames for transmission includes to encode the one or more input video frames in accordance with an AVI video coding standard.
15 . The system of claim 10 , wherein to provide the determined noise synthesis parameters includes to provide the determined noise synthesis parameters for the client device to synthesize noise to apply to the one or more input video frames.
16 . The system of claim 10 , further comprising a second processor to generate the one or more input video frames via a game application.
17 . The system of claim 16 , wherein the first processor is distinct from the second processor.
18 . A server computing system, comprising:
a set of one or more processors to:
generate one or more input video frames via execution of an application;
identify a quantization parameter (QP) associated with the one or more input video frames;
encode, using the identified QP, the one or more input video frames for transmission to at least one client device;
determine, based at least in part on the identified QP and independent of any noise present in the one or more input video frames, one or more noise synthesis parameters; and
initiate transmission of one or more encoded video frames to the at least one client device based on the encoding of the one or more input video frames; and
a network interface that is coupled to the set of one or more processors and that is configured to provide the one or more encoded video frames and the determined one or more noise synthesis parameters to one or more client computing systems via at least one computer network.
19 . The server computing system of claim 18 , wherein the set of one or more processors is further to manipulate the at least one processor to pre-process the one or more input video frames.
20 . The server computing system of claim 19 , wherein the set of executable instructions is further to manipulate the at least one processor to identify one or more video frame characteristics based on the pre-processing of the input video frames, and wherein to determine the one or more noise synthesis parameters is further based in part on the one or more video frame characteristics.
21 . The server computing system of claim 20 , wherein the one or more video frame characteristics include a variance of at least one of the one or more input video frames.
22 . The server computing system of claim 18 , wherein to encode the one or more input video frames for transmission includes to encode the one or more input video frames in accordance with an AVI video coding standard.