Accelerated texture-based fusion renderer
View Patent ↗An exemplary method of combining two images to form a fused image is provided. A hierarchical structure for each of a plurality of volumes is built. All blocks in each of the hierarchical structures that intersect a slicing plane are found. Each of the plurality of volumes is divided into stacks of parallel slices, and the parallel slices are sorted by visibility order. A next slice in the sorted parallel slices is chosen. The next slice belongs to a current volume. Rendering parameters are changed if the current volume is different from a previous volume associated with the chosen slice in a previous iteration of the step of choosing the slice. Based on the rendering parameters, the next slice is rendered by intersecting the slicing plane with the blocks corresponding to the current volume. The steps of choosing the slice, changing the rendering parameters, and rendering the slice are repeated until all of the sorted parallel slices are rendered.
1. A method of combining two images to form a fused image, comprising:
(a) building, by a processor, a hierarchical structure for each of a plurality of volumes;
(b) finding, by a processor, all blocks in each of the hierarchical structures that intersect a slicing plane;
(c) dividing, by a processor, each of the plurality of volumes into stacks of parallel slices and sorting the parallel slices by visibility order;
(d) choosing, by a processor, a next slice in the sorted parallel slices, the next slice belonging to a current volume;
(e) changing, by a processor, rendering parameters if the current volume is different from a previous volume in a previous iteration of step (d);
(f) rendering, by a processor, based on the rendering parameters, the next slice by intersecting the slicing plane with the blocks corresponding to the current volume; and
(g) repeating steps (d)-(f) until all of the sorted parallel slices of the current volume and the previous volume are rendered together in a fused image.
2. The method of claim 1 , wherein the step (b) comprises:
finding all blocks in each of the hierarchical structures that intersect a slicing plane while skipping invisible blocks by utilizing the slice-by-slice invisible space skipping approach described in the invention.
3. The method of claim 1 , wherein the step (e) comprises:
changing one of a transformation, a transfer function, a rendering mode, a crop box, or clip-planes.
4. The method of claim 1 , further comprising:
receiving a fusion rule;
determining whether the fusion rule can be represented as a blending function.
5. The method of claim 4 , further comprising:
if it is determined that a fusion rule can be represented as a blending function,
converting the fusion rule into the blending function.
6. The method of claim 4 , further comprising:
if it is determined that fusion rule cannot be represented as a blending function,
uniformly setting a spacing for the parallel slices to the same value for each of the plurality of volumes,
storing each of the results of step (f) into an intermediate buffer associated with the current volume; and
blending the each of the results into a fused buffer using a fusion rule.
7. The method of claim 4 , further comprising:
if it is determined that fusion rule cannot be represented as a blending function,
converting the fusion rule into a plurality of non-overlapping sub-rules, and
choosing one of the plurality of non-overlapping sub-rules.
8. The method of claim 1 , further comprising:
dividing the volume into a plurality of bricks; and
repeating steps (c) to (g) for each of the plurality of bricks, wherein each of the plurality bricks is treated as a separate volume.
9. The method of claim 8 , wherein the step of dividing the volume into a plurality of bricks, comprises:
dividing the volume into a plurality of bricks by inserting internal clip-planes boarding each of the plurality of bricks.
10. The method of claim 1 , wherein the step of dividing each of the plurality of volumes into stacks of parallel slices, comprises:
independently setting a spacing for the parallel slices for each of the plurality of volumes.
11. The method of claim 1 , wherein the step of dividing each of the plurality of volumes into stacks of parallel slices and sorting the parallel slices by visibility order, comprises:
virtually dividing each of the plurality of volumes into stacks of parallel slices and virtually sorting the parallel slices by visibility order.
12. A computer-readable medium having instructions stored thereon for combining two images to form a fused image, comprising the steps of:
(a) building a hierarchical structure for each of a plurality of volumes;
(b) finding all blocks in each of the hierarchical structures that intersect a slicing plane;
(c) dividing each of the plurality of volumes into stacks of parallel slices and sorting the parallel slices by visibility order;
(d) choosing a next slice in the sorted parallel slices, the next slice belonging to a current volume;
(e) changing rendering parameters if the current volume is different from a previous volume in a previous iteration of step (d);
(f) rendering, based on the rendering parameters, the next slice by intersecting the slicing plane with the blocks corresponding to the current volume; and
(g) repeating steps (d)-(f) until all of the sorted parallel slices of the current volume and the previous volume are rendered together in a fused image.
13. The computer-readable medium of claim 12 , wherein the step (b) comprises:
finding all blocks in each of the hierarchical structures that intersect a slicing plane while skipping invisible blocks by utilizing the slice-by-slice invisible space skipping approach described in the invention.
14. The computer-readable medium of claim 12 , further comprising:
receiving a fusion rule;
determining whether the fusion rule can be represented as a blending function.
15. The computer-readable medium of claim 14 , further comprising:
if it is determined that fusion rule cannot be represented as a blending function,
uniformly setting a spacing for the parallel slices to the same value for each of the plurality of volumes,
storing each of the results of step (f) into an intermediate buffer associated with the current volume; and
blending the each of the results into a fused buffer using a fusion rule.
16. The computer-readable medium of claim 14 , further comprising:
if it is determined that fusion rule cannot be represented as a blending function,
converting the fusion rule into a plurality of non-overlapping sub-rules, and
choosing one of the plurality of non-overlapping sub-rules.
17. A system for forming a fused image, comprising:
a texture-based fusion renderer comprising a processor and a memory for (a) building a hierarchical structure for each of a plurality of volumes;
(b) finding all blocks in each of the hierarchical structures that intersect a slicing plane while skipping invisible blocks by utilizing the slice-by-slice invisible space skipping approach described in the invention;
(c) dividing each of the plurality of volumes into stacks of parallel slices and sorting the parallel slices by visibility order;
(d) choosing a next slice in the sorted parallel slices, the next slice belonging to a current volume;
(e) changing rendering parameters if the current volume is different from a previous volume in a previous iteration of step (d);
(f) rendering, based on the rendering parameters, the next slice by intersecting the slicing plane with the blocks corresponding to the current volume; and
(g) repeating steps (d)-(f) until all of the sorted parallel slices of the current volume and the previous volume are rendered together in a fused image.
18. The system of claim 17 , further comprising:
receiving a fusion rule;
determining whether the fusion rule can be represented as a blending function.
19. The system of claim 18 , further comprising:
if it is determined that fusion rule cannot be represented as a blending function,
uniformly setting a spacing for the parallel slices to the same value for each of the plurality of volumes,
storing each of the results of step (f) into an intermediate buffer associated with the current volume; and
blending the each of the results into a fused buffer using a fusion rule.
20. The system of claim 18 , further comprising:
if it is determined that fusion rule cannot be represented as a blending function,
converting the fusion rule into a plurality of non-overlapping sub-rules, and
choosing one of the plurality of non-overlapping sub-rules.