Rendering changed portions of composited images
Rendering graphics on a display of a device. In a portable or wireless device, a list of instructions needed to refresh or generate a frame is first created. The created instructions are then parsed or optimized to remove instructions that result in unnecessary processing instructions. The optimized list is then executed. During generation of a given frame, a view hierarchy is traversed to identify damaged portions of a display. The damaged portions are not copied to the frame. Also, information that has not changed is likewise not usually copied. Damage from the previous frame less damage from the current frame is copied to the appropriate buffer. The instructions are optimized to render only the portion of the frame that is necessary. Portions of the display that are not visible are not traversed in the view hierarchy and are not considered until visible on the display.
1. A method, performed by a computer system comprising one or more processors, for minimizing the processing required for rendering frames of an image on a display of a device, the method comprising:
accessing, by the computer system, a view hierarchy comprised of a plurality of hierarchically arranged nodes, each node defining a portion of content from which frames can be generated for display on the device;
traversing, by the computer system, the view hierarchy to render a subsequent frame by:
(1) identifying a first set of nodes in the view hierarchy that define a portion of content in a previous frame that will remain unchanged in a subsequent frame, and copying the unchanged portions from the previous frame to a buffer in which the subsequent frame is being composited; and
(2) identifying a second set of nodes in the view hierarchy that define a portion of content in a previous frame that will be changed in the subsequent frame, and generating a list of instructions using the second set of nodes that, when executed, will generate the changed portions in the subsequent frame;
determining, by the computer system, that at least one of the instructions in the list of instructions is at least partially redundant to at least one other instruction in the list of instructions;
prior to executing the list of instructions, optimizing, by the computer system, the list of instructions by removing at least one instruction that is at least partially redundant;
executing, by the computer system, the optimized list of instructions to generate the changed portions of the subsequent frame in the buffer; and
accessing, by the computer system, the buffer to output the subsequent frame for display on the device.
2. The method of claim 1 , wherein traversing the view hierarchy further comprises:
identifying a third set of nodes that define a portion of content that will not be visible in the subsequent frame; and
bypassing the processing of the third set of nodes while rendering the subsequent frame.
3. The method of claim 1 , wherein optimizing the list of instructions further comprises altering at least one instruction.
4. The method of claim 1 , wherein copying the unchanged portions from the previous frame comprises copying the unchanged portions from a second buffer in which the previous frame is stored.
5. The method of claim 1 , wherein copying the unchanged portions from the previous frame comprises copying the unchanged portions from one or more other buffers in which the unchanged portions are stored.
6. The method of claim 1 , wherein identifying the second set of nodes comprises identifying that a frame number is associated with each node in the second set of nodes.
7. The method of claim 6 , wherein the frame number defines the last frame prior to the changed portions being changed.
8. The method of claim 1 , wherein the previous frame is displayed immediately prior to the subsequent frame.
9. The method of claim 1 , wherein one or more other frames are displayed between the previous frame and the subsequent frame.
10. One or more non-transitory computer storage media storing computer executable instructions which when executed by one or more processors of a computer system perform a method for minimizing the processing required for rendering frames of an image on a display of a device, the method comprising:
accessing a view hierarchy comprised of a plurality of hierarchically arranged nodes, each node defining a portion of content from which frames can be generated for display on the device;
traversing the view hierarchy to render a subsequent frame by:
(1) identifying a first set of nodes in the view hierarchy that define a portion of content in a previous frame that will remain unchanged in a subsequent frame, and copying the unchanged portions from the previous frame to a buffer in which the subsequent frame is being composited; and
(2) identifying a second set of nodes in the view hierarchy that define a portion of content in a previous frame that will be changed in the subsequent frame, and generating a list of instructions using the second set of nodes that, when executed, will generate the changed portions in the subsequent frame;
determining that at least one of the instructions in the list of instructions is at least partially redundant to at least one other instruction in the list of instructions;
prior to executing the list of instructions, optimizing the list of instructions by removing at least one instruction that is at least partially redundant;
executing the optimized list of instructions to generate the changed portions of the subsequent frame in the buffer; and
accessing the buffer to output the subsequent frame for display on the device.
11. The computer storage media of claim 10 , wherein traversing the view hierarchy further comprises:
identifying a third set of nodes that define a portion of content that will not be visible in the subsequent frame; and
bypassing the processing of the third set of nodes while rendering the subsequent frame.
12. The computer storage media of claim 10 , wherein optimizing the list of instructions further comprises altering at least one instruction.
13. The computer storage media of claim 10 , wherein copying the unchanged portions from the previous frame comprises copying the unchanged portions from a second buffer in which the previous frame is stored.
14. The computer storage media of claim 10 , wherein copying the unchanged portions from the previous frame comprises copying the unchanged portions from one or more other buffers in which the unchanged portions are stored.
15. The computer storage media of claim 10 , wherein identifying the second set of nodes comprises identifying that a frame number is associated with each node in the second set of nodes.
16. The computer storage media of claim 15 , wherein the frame number defines the last frame prior to the changed portions being changed.
17. The computer storage media of claim 10 , wherein the previous frame is displayed immediately prior to the subsequent frame.
18. The computer storage media of claim 10 , wherein one or more other frames are displayed between the previous frame and the subsequent frame.
19. A computing device comprising:
one or more processors; and
memory storing computer executable instructions which when executed perform a method for minimizing the processing required for rendering frames of an image on the computing device, the method comprising:
accessing a view hierarchy comprised of a plurality of hierarchically arranged nodes, each node defining a portion of content from which frames can be generated for display on the device;
traversing the view hierarchy to render a subsequent frame by:
(1) identifying a first set of nodes in the view hierarchy that define a portion of content in a previous frame that will remain unchanged in a subsequent frame, and copying the unchanged portions from the previous frame to a buffer in which the subsequent frame is being composited; and
(2) identifying a second set of nodes in the view hierarchy that define a portion of content in a previous frame that will be changed in the subsequent frame, and generating a list of instructions using the second set of nodes that, when executed, will generate the changed portions in the subsequent frame;
determining that at least one of the instructions in the list of instructions is at least partially redundant to at least one other instruction in the list of instructions;
prior to executing the list of instructions, optimizing the list of instructions by removing at least one instruction that is at least partially redundant;
executing the optimized list of instructions to generate the changed portions of the subsequent frame in the buffer; and
accessing the buffer to output the subsequent frame for display on the device.
20. The computing device of claim 19 , wherein copying the unchanged portions from the previous frame comprises copying the unchanged portions from a second buffer in which the previous frame is stored.