Method and apparatus for rendering image based projected shadows with multiple depth aware blurs
View Patent ↗A computer readable storage medium stores one or more computer programs adapted to cause a processor based system to execute steps including: identifying one or more groups of objects in a frame of content, wherein each group of objects includes one or more shadow casters and corresponding shadow receivers; for visible shadow receivers in the identified groups of objects, establishing depth information in a small white buffer; for each of the identified groups of objects, rendering the shadow casters into a single depth map; blurring the small white buffer; and upsampling the small white buffer into a full sized white buffer, wherein the upsampling comprises using depth information as a metric. A method includes similar steps, and an apparatus includes a processor based system that is configured to execute similar steps.
1. A non-transitory computer readable storage medium storing one or more computer programs adapted to cause a processor based system to execute steps comprising:
identifying one or more groups of objects in a frame of content, wherein each group of objects includes one or more shadow casters and corresponding shadow receivers;
for visible shadow receivers in the identified groups of objects, establishing depth information in a small buffer;
for each of the identified groups of objects, rendering the shadow casters into a single depth map;
blurring the small buffer;
after the blurring the small buffer, upsampling the blurred small buffer into a full sized buffer, wherein the upsampling comprises using depth information as a metric in upsampling color information; and
rendering the shadow receivers in the identified groups of objects by sampling the upsampled full sized buffer.
2. The computer readable storage medium of claim 1 , wherein the sampling the upsampled full sized buffer comprises discarding samples having a depth that is beyond a certain distance from a sample point.
3. The computer readable storage medium of claim 1 , wherein the one or more computer programs are further adapted to cause the processor based system to execute steps comprising:
performing a first depth prepass with all opaque and cutout geometry in the content;
wherein the upsampling is performed using high resolution depth information stored in the first depth prepass to weight each of a number of bilinear low resolution samples.
4. The computer readable storage medium of claim 1 , wherein the upsampling comprises setting weights to zero for each sample having a depth that is beyond a certain distance from a high resolution sample point's depth.
5. The computer readable storage medium of claim 1 , wherein the upsampling comprises weighting based on distance each sample having a depth that is within a certain distance from a high resolution sample point's depth.
6. The computer readable storage medium of claim 1 , wherein the blurring comprises performing blurring with a depth aware low pass filter.
7. The computer readable storage medium of claim 1 , wherein the blurring comprises not including an influence of samples having a depth that is beyond a certain distance from a sample point.
8. The computer readable storage medium of claim 1 , wherein the blurring comprises weighting based on distance each sample having a depth that is within a certain distance from a sample point.
9. The computer readable storage medium of claim 1 , wherein the establishing depth information in a small buffer comprises rendering a depth prepass to the small buffer for visible shadow receivers in the identified groups of objects.
10. The computer readable storage medium of claim 1 , wherein the one or more computer programs are further adapted to cause the processor based system to execute steps comprising:
for each of the identified groups of objects, rendering the shadow receivers to the small buffer;
wherein the rendering the shadow receivers to the small buffer comprises using a certain amount of filtering samples.
11. The computer readable storage medium of claim 1 , wherein the upsampling comprises using depth values to determine whether or not a sample should be used in the upsampling.
12. The computer readable storage medium of claim 1 , wherein the blurring comprises using depth values to determine whether or not a sample should be used in the blurring.
13. A method, comprising:
identifying one or more groups of objects in a frame of content, wherein each group of objects includes one or more shadow casters and corresponding shadow receivers;
for visible shadow receivers in the identified groups of objects, establishing depth information in a small buffer;
for each of the identified groups of objects, rendering the shadow casters into a single depth map;
blurring the small buffer;
after the blurring the small buffer, upsampling the blurred small buffer into a full sized buffer, wherein the upsampling comprises using depth information as a metric in upsampling color information and is performed by a processor-based apparatus; and
rendering the shadow receivers in the identified groups of objects by sampling the upsampled full sized buffer.
14. The method of claim 13 ,
wherein the sampling the upsampled full sized buffer comprises discarding samples having a depth that is beyond a certain distance from a sample point; and
wherein the method further comprises displaying the rendered shadow receivers on a display.
15. The method of claim 13 , further comprising:
performing a first depth prepass with all opaque and cutout geometry in the content;
wherein the upsampling is performed using high resolution depth information stored in the first depth prepass to weight each of a number of bilinear low resolution samples.
16. The method of claim 13 , wherein the upsampling comprises setting weights to zero for each sample having a depth that is beyond a certain distance from a high resolution sample point's depth.
17. The method of claim 13 , wherein the upsampling comprises weighting based on distance each sample having a depth that is within a certain distance from a high resolution sample point's depth.
18. The method of claim 13 , wherein the blurring comprises performing blurring with a depth aware low pass filter.
19. The method of claim 13 , wherein the blurring comprises not including an influence of samples having a depth that is beyond a certain distance from a sample point.
20. The method of claim 13 , wherein the blurring comprises weighting based on distance each sample having a depth that is within a certain distance from a sample point.
21. The method of claim 13 , wherein the establishing depth information in a small buffer comprises rendering a depth prepass to the small buffer for visible shadow receivers in the identified groups of objects.
22. The method of claim 13 , further comprising:
for each of the identified groups of objects, rendering the shadow receivers to the small buffer;
wherein the rendering the shadow receivers to the small buffer comprises using a certain amount of filtering samples.
23. The method of claim 13 , wherein the upsampling comprises using depth values to determine whether or not a sample should be used in the upsampling.
24. The method of claim 13 , wherein the blurring comprises using depth values to determine whether or not a sample should be used in the blurring.
25. An apparatus, comprising:
a display; and
a processor based system coupled to the display, wherein the processor based system is configured to execute steps comprising:
identifying one or more groups of objects in a frame of content, wherein each group of objects includes one or more shadow casters and corresponding shadow receivers;
for visible shadow receivers in the identified groups of objects, establishing depth information in a small buffer;
for each of the identified groups of objects, rendering the shadow casters into a single depth map;
blurring the small buffer;
after the blurring the small buffer, upsampling the blurred small buffer into a full sized buffer, wherein the upsampling comprises using depth information as a metric in upsampling color information; and
rendering the shadow receivers in the identified groups of objects by sampling the upsampled full sized buffer.
26. The apparatus of claim 25 , wherein
the sampling the upsampled full sized buffer comprises discarding samples having a depth that is beyond a certain distance from a sample point; and
wherein the processor based system is further configured to execute a step comprising displaying the rendered shadow receivers on the display.
27. The apparatus of claim 25 , wherein the upsampling comprises setting weights to zero for each sample having a depth that is beyond a certain distance from a high resolution sample point's depth.
28. The apparatus of claim 25 , wherein the upsampling comprises weighting based on distance each sample having a depth that is within a certain distance from a high resolution sample point's depth.
29. The apparatus of claim 25 , wherein the blurring comprises performing blurring with a depth aware low pass filter.
30. The apparatus of claim 25 , wherein the blurring comprises not including an influence of samples having a depth that is beyond a certain distance from a sample point.
31. The apparatus of claim 25 , wherein the blurring comprises weighting based on distance each sample having a depth that is within a certain distance from a sample point.
32. The apparatus of claim 25 , wherein the establishing depth information in a small buffer comprises rendering a depth prepass to the small buffer for visible shadow receivers in the identified groups of objects.
33. The apparatus of claim 25 , wherein the upsampling comprises using depth values to determine whether or not a sample should be used in the upsampling.
34. The apparatus of claim 25 , wherein the blurring comprises using depth values to determine whether or not a sample should be used in the blurring.