Systems and methods for deferred post-processes in video encoding
Systems and methods for deferring post-process effects in video encoding are disclosed. The systems and methods are capable of calculating the capability of client hardware to defer load, and summing a known load of one or more deferral candidates to evaluate how many post-process deferral candidates are capable of being deferred to client hardware. The systems and methods are also capable of sending an updated deferral list of post-processes to a remote server that can apply the list of deferred post-process candidates during the post-processing phase of a first video frame.
1. A computer-implemented method for deferring post-processes comprising the steps of:
transmitting an instruction to a client application to measure client hardware capability; and
transmitting an instruction to a client application to sum a known load of one or more predetermined post-process deferral candidates to evaluate how many post-process deferral candidates are capable of being deferred to client hardware,
wherein a post-process deferral list is compiled,
wherein the post-process deferral list is built in reverse order,
wherein a server receives the post-process deferral list, skips the list of deferred post-processes during the post-processing phase of a first video frame, and transmits an instruction to a client application to render an image, and
wherein the post-process deferral list is added to a benchmarking process.
2. The method of claim 1 , wherein the client application re-measures the capability of the client hardware in response to one or more environmental changes.
3. The method of claim 2 , wherein the client application performs a callback or polls one or more operating system events to determine whether to re-measure the capability of the client hardware.
4. The method of claim 1 , wherein the client application evaluates how many post-process deferral candidates are capable of being deferred to the client hardware by measuring frame rate and/or resource usage.
5. The method of claim 1 , wherein the server applies the updated deferral list to a next available video frame.
6. The method of claim 1 , further comprising the step of the server transmitting encoded video data to the client application without metadata associated with post-processes.
7. The method of claim 1 , wherein the capability of the client hardware is measured by detecting available instruction sets, memory, CPU, and/or GPU characteristics.
8. The method of claim 1 , wherein the list of post-process deferral candidates is recalculated based on changes to the client hardware's battery state.
9. The method of claim 1 , wherein the server returns the first or next available video frame to the client application with a metadata flag.
10. A system for deferring post-process, wherein over a network, a server:
transmits an instruction to a client application to measure client hardware capability; and
transmits an instruction to a client application to sum a known load of one or more predetermined post-process deferral candidates to evaluate how many post-process deferral candidates are capable of being deferred to client hardware,
wherein a post-process deferral list is compiled,
wherein the post-process deferral list is built in reverse order,
wherein a server receives the post-process deferral list, skips the list of deferred post-processes during the post-processing phase of a first video frame, and transmits an instruction to a client application to render an image, and
wherein the post-process deferral list is added to a benchmarking process.
11. The system of claim 10 , wherein the client application re-measures the capability of the client hardware in response to one or more environmental changes.
12. The system of claim 11 , wherein the client application performs a callback or polls one or more operating system events to determine whether to re-measure the capability of the client hardware.
13. The system of claim 10 , wherein the client application evaluates how many post-process deferral candidates are capable of being deferred to the client hardware by measuring frame rate and/or resource usage.
14. The system of claim 10 , wherein the server applies the updated list of post-process deferral candidates to a next available video frame.
15. The system of claim 10 , wherein the server transmits encoded video data to the client application without metadata associated with post-processes.
16. The system of claim 10 , wherein the capability of the client hardware is measured by detecting available instruction sets, memory, CPU, and/or GPU characteristics.
17. The system of claim 10 , wherein the list of post-process deferral candidates is recalculated based on changes to the client hardware's battery state.
18. The system of claim 10 , wherein the server returns the first or next available video frame to the client application with a metadata flag.