IP Library Granted Patent US 11,423,612
Granted Patent B2
US 11,423,612 · App. 16/870,938 · Granted Aug 23, 2022

Correcting segmented surfaces to align with a rendering of volumetric data

Inventors: Falko Loeffler (Graal-Mueritz, DE); Thomas Ruth (Rostock, DE); Christian Goetze (Rostock, DE); Michael C Wussow (Madison, WI)
Assignee: Arivis AG
G06T17/10G06T7/11G06T15/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,612
App. No.
16/870,938
Granted
Aug 23, 2022
Kind
B2
Abstract

The invention relates to a computer-implemented method comprising the steps of: (S 100 ) presenting a surface (S) comprising segments derived from volumetric data (VD) in a virtual reality user interface ( 6 ); (S 200 ) presenting volumetric data (VD) in the virtual reality user interface ( 6 ); (S 300 ) applying a signed distance field technique (SDF) to the segments in reference to the presented volumetric data (VD); (S 400 ) adjusting at least one of the segments based on a result of applying the signed distance field technique (SDF) so that the presented surface data complies with the presented volumetric data (VD); and (S 500 ) saving the adjusted at least one of the segments in a data file (DF) separately from a data file of the volumetric data (VD).

Claims (25)

1. A computer-implemented method comprising the steps of:

deriving a surface comprising segments from volumetric data by obtaining a signed distance field referencing said segments to said volumetric data;

presenting, in a virtual reality user interface, at least a part of said segmented surface overlaid on at least a part of the volumetric data from which the segmented surface originates;

determining a portion of said surface that does not align to the volumetric data;

obtaining a signed distance value as a surface generation error for said portion, wherein the signed distance value indicates noncompliance of said segmented surface with the volumetric data from which the segmented surface originates;

interactively adjusting the signed distance field for at least one of the segments using the signed distance value so that the presented surface aligns more accurately with the presented volumetric data on which the surface is overlaid in the virtual reality user interface; and

saving the interactively adjusted at least one of the segments in a data file separately from a data file of the volumetric data.

2. The computer-implemented method according to claim 1 , wherein the surface is generated manually and/or automatically from the volumetric data.

3. The computer-implemented method according to claim 1 , wherein the surface is manipulated by a tool adapted to reference the surface to the presented volumetric data, wherein the tool uses a signed distance field technique to reference the surface to the presented volumetric data.

4. The computer-implemented method according to claim 1 , wherein a de-novo segmentation of original volumetric data is performed at least semi-automatically in order to obtain the presented volumetric data.

5. The computer-implemented method according to claim 1 , wherein the method includes a method of fitting the surface to the volumetric data.

6. The computer-implemented method according to claim 1 , wherein the adjusting of the signed distance field for the at least one of the segments includes use of a signed distance field technique to manipulate the surface to align with the volumetric data rendered in the virtual reality user interface, wherein the surface is in spatial coordination with the volumetric data.

7. The computer-implemented method according to claim 6 , wherein the signed distance field technique indicates a direction of manipulation that results in the presented surface complying with the presented volumetric data.

8. The computer-implemented method according to claim 6 , wherein a positive/negative or a negative/positive distance of the signed distance field technique indicates that at least one point in the surface is outside/within a target area in a rendered image based on the volumetric data.

9. The computer-implemented method according to claim 6 , wherein the signed distance field technique uses the signed distance value.

10. The computer-implemented method according to claim 1 , wherein the adjusting of the surface to comply with the volumetric data includes direct rendering of the volumetric data in a first rendering pass to obtain a rendering volume, rendering the surface in a second rendering pass to obtain a rendered surface, and integrating the rendered volume from the first pass with the rendered surface from the second pass with a surface manipulation tool, wherein the surface manipulation tool includes a signed distance field technique.

11. The computer-implemented method according to claim 10 , wherein the first and second rendering passes are performed sequentially and/or independently.

12. The computer-implemented method according to claim 10 , wherein the rendered surface is spatially aligned with the rendered volume based on an index established when the rendered surface was derived from the rendered volume.

13. The computer-implemented method according to claim 10 , wherein the rendered surface and the rendered volume are mixed in the virtual reality user interface based on depth information associated with at least one of the data of the surface and the volumetric data.

14. The computer-implemented method according to claim 1 , wherein the adjusting of the signed distance field for the at least one segment of the surface includes converting the surface to a signed distance field representation, performing adjustments based on the signed distance field representation so that the surface is substantially aligned with a surface of the volumetric data.

15. The computer-implemented method according to claim 1 , wherein the method comprises generating the surface from the volumetric data, rendering the surface and the volumetric data, determining portions of the surface that do not align to the volumetric data, applying a signed distance field technique to at least a portion of the surface that does not align to the volumetric data, adjusting the surface based thereon, and saving the adjusted surface.

16. A data processing system comprising means for carrying out the steps of the method according to claim 1 .

17. A computer program stored on a non-transitory computer-readable medium, the computer program comprising instructions which, when the program is executed by a processor, cause the processor to carry out the steps of the method according to claim 1 .

18. A non-transitory computer-readable medium comprising instructions which, when executed by a processor, cause the processor to carry out the steps of the method according to claim 1 .

19. The computer-implemented method according to claim 1 , further comprising manipulating the determined portion in three dimensions by at least one of enlarging, shrinking, joining, separating, contouring, bending or shaping, at least one of said surface segments.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2025
From: CARL ZEISS MICROSCOPY SOFTWARE CENTER ROSTOCK GMBH
To: CARL ZEISS MICROSCOPY GMBH
Reel/Frame 070909/0645 →
CHANGE OF NAME Recorded May 23, 2023
From: ARIVIS AG
To: CARL ZEISS MICROSCOPY SOFTWARE CENTER ROSTOCK GMBH
Reel/Frame 063781/0514 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2021
From: GOETZE, CHRISTIAN; LOEFFLER, FALKO; RUTH, THOMAS; WUSSOW, MICHAEL C
To: ARIVIS AG
Reel/Frame 054968/0338 →
Continuity (4)
Continuation PCTEP2018080835 · Nov 9, 2018
Provisional Application 62583839 · Nov 9, 2017
Provisional Application 62620758 · Jan 23, 2018
Related Publication 20200273244A1 · Aug 27, 2020