Graphics pipeline method and apparatus
Provided are a graphics pipeline method and apparatus. For each of plural screen pixels, locations of one or more sampling are determined based on a set pattern to modify an image to be rendered. A pixel corresponding to a set primitive is generated at a determined location of a sampling point, of the one or more sampling points. The image is rendered using the generated pixel.
1. A graphics pipeline method, the method comprising:
determining, using one or more processing devices, respective locations of a plurality of sampling points for a plurality of screen pixels of a display, by determining, for each of the screen pixels, a location of a sampling point based on a pattern to modify an image to be rendered;
generating a pixel based on the image and corresponding to a primitive at a determined location of a sampling point, of the plurality of sampling points, determined to overlap the primitive to be rasterized; and
rendering the image using the generated pixel,
wherein a sampling shading stage comprising the determining of the respective locations of the plurality of sampling points is performed in parallel with operation stages comprising a vertex shading stage, a clipping stage, and a projection stage of a graphics pipeline, before an operation stage of a rasterizing stage of the graphics pipeline that performs the generating of the pixel.
2. The method according to claim 1 , wherein the pattern is a distortion pattern for applying distortion to the image so that the rendered image is a distortion image.
3. The method according to claim 2 , wherein
the determining of the respective locations comprises determining the respective locations of the plurality of sampling points based on respective central locations of each of modified locations of the screen pixels; and
the screen pixels are arranged in an equal distant or repeated grid pattern.
4. The method according to claim 1 , further comprising:
acquiring information of a resolution of the screen pixels of the display, the resolution defining locations of the screen pixels; and
wherein the determining of the respective locations further comprises,
converting, based on the information of the resolution, a location of a screen pixel, of the screen pixels, into a location of a corresponding sampling point based on the pattern, and
mapping a location of a pixel of the image to the location of the corresponding sampling point.
5. The method according to claim 1 , wherein the sampling shading stage is a programmable stage, implemented by the one or more processing devices processing a shader source code for changing and defining a pattern type, of a plurality of pattern types, of the pattern.
6. The method according to claim 1 , wherein the determining of the respective locations comprises:
determining locations of two or more sampling points for one screen pixel when multisampling is determined to be enabled; and
determining a location of a single sampling point for the one screen pixel when the multisampling is determined to be disabled, and
wherein, when the multisampling is determined to be enabled, the respective two or more sampling points determined for each of the screen pixels are arranged in proportion to an extent to which locations of each of the screen pixels are set to be modified by the pattern so that the rendered image is a distortion image.
7. The method according to claim 1 , wherein the generating of the pixel comprises:
determining the location of the sampling point by searching for the location of the sampling point, from among select one or more subsets of the determined respective locations of the sampling points, that overlaps the primitive based on a quadtree algorithm that calls for repeatedly subdividing a set of the sampling points into smaller subsets based on regions of a viewpoint to which the plurality of sampling points of the set respectively belong.
8. The method according to claim 1 , wherein the determining of the respective locations includes determining locations of respective sampling points for different color components for a screen pixel by respectively applying different offsets when determining the locations of the respective sampling points for the different color components for the screen pixel.
9. The method according to claim 1 , wherein the sampling shading stage is performed in a single pass of a tile binning operation when the graphics pipeline is a graphics pipeline for tile-based rendering.
10. A non-transitory processor-readable medium comprising computer readable code to control at least one processing device to implement the method according to claim 1 .
11. A graphics pipeline apparatus, the apparatus comprising:
a sampling shader configured to determine respective locations of a plurality of sampling points for a plurality of screen pixels of a display, by determining, for each of the screen pixels, a location of a sampling point based on a pattern to modify an image to be rendered; and
a rasterizer configured to generate a pixel based on the image and corresponding to a primitive at a determined location of a sampling point, of the plurality of sampling points, determined to overlap the primitive to be rasterized, and to output the generated pixel to render the image,
wherein the sampling shader is further configured to perform a sampling shading stage for the determination of the respective locations before the rasterizer performs a rasterization operation stage of the generated pixel as the outputting of the generated pixel to render the image, and in parallel with operation stages comprising a vertex shading stage, a clipping stage, and a projection stage.
12. The apparatus according to claim 11 , wherein the pattern is a distortion pattern for applying distortion to the image so that the rendered image is a distortion image.
13. The apparatus according to claim 12 , wherein the sampling shader is further configured to determine the respective locations of the sampling points based on respective central locations of each of modified locations of the screen pixels, and wherein the screen pixels are arranged in an equal distant or repeated grid pattern.
14. The apparatus according to claim 11 , wherein
the sampling shader is further configured to acquire information of a resolution of the screen pixels of the display, the resolution defining locations of the screen pixels, and
in the determining of the respective locations, the sampling shader is further configured to convert, based on the information of the resolution, a location of a screen pixel, of the screen pixels, into a location of a corresponding sampling point based on the pattern, and maps a location of a pixel of the image to the location of the corresponding sampling point.
15. The apparatus according to claim 11 , wherein the sampling shader is configured as a programmable shader stage, of a graphics processing device, configured to process a shader source code for changing and defining a pattern type, of a plurality of pattern types, of the pattern.
16. The apparatus according to claim 11 , wherein
the sampling shader is configured to determine locations of two or more sampling points for one screen pixel when multisampling is determined to be enabled and configured to determine a location of a single sampling point for the one screen pixel when the multisampling is determined to be disabled; and
when the multisampling is determined to be enabled, the respective two or more sampling points determined for each of the screen pixels are arranged in proportion to an extent to which locations of each of the screen pixels are set to be modified by the pattern so that the rendered image is a distortion image.
17. The apparatus according to claim 11 , wherein, in the generating of the pixel, the rasterizer is further configured to determine the location of the sampling point by searching for the location of the sampling point, from among select one or more subsets of the determined locations of the sampling points, that overlaps the primitive based on a quadtree algorithm that calls for repeatedly subdividing a set of the sampling points into smaller subsets based on regions of a viewpoint to which the sampling points of the set respectively belong.
18. The apparatus according to claim 11 , wherein, in the determining of the respective locations, the sampling shader is further configured to determine locations of respective sampling points for different color components for a screen pixel by respectively applying different offsets when determining the locations of the respective sampling points for the different color components for the screen pixel.