Artificial aperture adjustment for synthetic depth of field rendering
This disclosure relates to various implementations that dynamically adjust one or more shallow depth of field (SDOF) parameters based on a designated, artificial aperture value. The implementations obtain a designated, artificial aperture value that modifies an initial aperture value for an image frame. The designated, artificial aperture value generates a determined amount of synthetically-produced blur within the image frame. The implementations determine an aperture adjustment factor based on the designated, artificial aperture value in relation to a default so-called “tuning aperture value” (for which the camera's operations may have been optimized). The implementations may then modify, based on the aperture adjustment factor, one or more SDOF parameters for an SDOF operation, which may, e.g., be configured to render a determined amount of synthetic bokeh within the image frame. In response the modified SDOF parameters, the implementations may render an updated image frame that corresponds to the designated, artificial aperture value.
1. A non-transitory program storage device comprising instructions stored thereon to cause one or more processors to:
obtain a designated, artificial aperture value that modifies an initial aperture value of an image frame, wherein the designated, artificial aperture value modifies an amount of synthetically produced blur within the image frame;
determine an aperture adjustment factor based on the designated, artificial aperture value and a tuning aperture value for rendering the image frame, wherein the tuning aperture value is associated with one or more default shallow depth of field (SDOF) parameters;
modify, based on the aperture adjustment factor, the one or more default SDOF parameters to obtain updated SDOF parameters for performing one or more SDOF operations; and
render an updated SDOF image frame using the updated SDOF parameters to perform the one or more SDOF operations.
2. The non-transitory program storage device of claim 1 , wherein one of the one or more SDOF operations is an artifact mitigation operation that adjusts blur values based on a region of interest.
3. The non-transitory program storage device of claim 2 , wherein one of the SDOF parameters is a parameter gradient that adjusts blur values for pixels that are located outside the region of interest.
4. The non-transitory program storage device of claim 2 , wherein the instructions that cause the one or more processors to modify, based on the aperture adjustment factor, the one or more default SDOF parameters further comprise instructions that cause the one or more processors to modify, based on the aperture adjustment factor, a parameter gradient associated with the artifact mitigation operation for pixels within a transition region of the image frame.
5. The non-transitory program storage device of claim 1 , wherein the aperture adjustment factor is a scaling factor that modifies the one or more default SDOF parameters for the one or more SDOF operations, and wherein the scaling factor is determined using the tuning aperture value and the designated, artificial aperture value.
6. The non-transitory program storage device of claim 1 , wherein the instructions that cause the one or more processors to determine the aperture adjustment factor further comprise instructions that cause the one or more processors to perform a lookup operation based on the designated, artificial aperture value.
7. The non-transitory program storage device of claim 1 , wherein the initial aperture value matches the tuning aperture value.
8. The non-transitory program storage device of claim 1 , wherein one of the one or more SDOF operations comprises a sampling operation that determines an inclusion weight parameter.
9. The non-transitory program storage device of claim 1 , wherein the instructions that cause the one or more processors to modify, based on the aperture adjustment factor, the one or more default SDOF parameters further comprise instructions that cause the one or more processors to generate a compressed bokeh shape determined from an overlapping region between a first bokeh shape and a second bokeh shape associated with a candidate pixel.
10. The non-transitory program storage device of claim 1 , wherein one of the one or more default SDOF parameters comprises a gating threshold for classifying pixels within the image frame as being highlights.
11. An imaging system, comprising:
a programmable control device; and
a memory coupled to the programmable control device, wherein instructions are stored in the memory, and wherein the instructions, when executed, cause the programmable control device to:
obtain a designated, artificial aperture value that modifies an initial aperture value of an image frame, wherein the designated, artificial aperture value modifies an amount of synthetically produced blur within the image frame;
determine an aperture adjustment factor based on the designated, artificial aperture value and a tuning aperture value for rendering the image frame, wherein the tuning aperture value is associated with one or more default shallow depth of field (SDOF) parameters;
modify, based on the aperture adjustment factor, the one or more default SDOF parameters to obtain updated SDOF parameters for performing one or more SDOF operations; and
render an updated SDOF image frame using the updated SDOF parameters to perform the one or more SDOF operations.
12. The imaging system of claim 11 , wherein the instructions that cause the programmable control device to modify, based on the aperture adjustment factor, the one or more default SDOF parameters further comprise instructions that cause the programmable control device to generate a compressed bokeh shape determined from an overlapping region between a first bokeh shape and a second bokeh shape associated with a candidate pixel.
13. The imaging system of claim 11 , wherein the instructions that cause the programmable control device to modify, based on the aperture adjustment factor, the one or more default SDOF parameters further comprise instructions that cause the programmable control device to modify, based on the aperture adjustment factor, a parameter gradient associated with an artifact mitigation operation for pixels within a transition region of the image frame.
14. The imaging system of claim 11 , wherein the aperture adjustment factor is a scaling factor that modifies the one or more default SDOF parameters for the one or more SDOF operations, and wherein the scaling factor is determined using the tuning aperture value and the designated, artificial aperture value.
15. The imaging system of claim 11 , wherein the instructions that cause the programmable control device to determine the aperture adjustment factor further comprise instructions that cause the programmable control device to perform a lookup operation based on the designated, artificial aperture value.
16. An image processing method, comprising:
obtaining a designated, artificial aperture value that modifies an initial aperture value of an image frame, wherein the designated, artificial aperture value modifies an amount of synthetically produced blur within the image frame;
determining an aperture adjustment factor based on the designated, artificial aperture value and a tuning aperture value for rendering the image frame, wherein the tuning aperture value is associated with one or more default shallow depth of field (SDOF) parameters;
modifying, based on the aperture adjustment factor, the one or more default SDOF parameters to obtain updated SDOF parameters for performing one or more SDOF operations; and
rendering an updated SDOF image frame using the updated SDOF parameters to perform the one or more SDOF operations.
17. The image processing method of claim 16 , wherein modifying, based on the aperture adjustment factor, the one or more default SDOF parameters further comprises generating a compressed bokeh shape determined from an overlapping region between a first bokeh shape and a second bokeh shape associated with a candidate pixel.
18. The image processing method of claim 16 , wherein modifying, based on the aperture adjustment factor, the one or more default SDOF parameters further comprises modifying, based on the aperture adjustment factor, a parameter gradient associated with an artifact mitigation operation for pixels within a transition region of the image frame.
19. The image processing method of claim 16 , wherein the aperture adjustment factor is a scaling factor that modifies the one or more default SDOF parameters for the one or more SDOF operations, and wherein the scaling factor is determined using the tuning aperture value and the designated, artificial aperture value.
20. The image processing method of claim 16 , wherein determining the aperture adjustment factor further comprises performing a lookup operation based on the designated, artificial aperture value.