Granted Patent B2

US 12,471,836 · App. 18/230,317 · Granted Nov 18, 2025

Inventors: Gemma Taverni (Zürich, CH); Hakki Karaman (Uster, CH); Stefan Geissbühler (Langenthal, CH); Simon Mark (Thal, CH); Zheng Yang (Friedrichshafen, DE); Burkhard Böckem (Jonen AG, CH); Lukas Buchmann (Zürich, CH); Sandra Tobler (Berneck, CH); Jan Glückert (Lindau, DE); Markus Wettstein (Wädenswil, CH)

Assignee: HEXAGON TECHNOLOGY CENTER GMBH

A61B5/441A61B5/0075A61B5/0077A61B5/0079A61B5/442A61B5/742G06T7/0012G06T7/40G06T17/00H04N23/56H04N23/90G06T2207/30088G06T2207/30196

Abstract

Claims (64)

1 . A measuring system for measuring an object, in particular the skin of a person, the measuring system comprising

a capture device comprising a set of illumination elements for illuminating the object and a set of cameras for capturing an image of the object, and

a controlling and processing unit comprising at least

a data acquisition functionality which is configured to provide surface data by activating at least a part of the set of illumination elements for illuminating the object with measuring light and capturing at least one image by detecting measuring light reflected at the object by means of at least a part of the set of cameras,

a 3D-modelling functionality which is configured to provide a 3D model of the object by processing the surface data,

wherein:

a first group of illumination elements of the set of illumination elements comprises circular polarised filtering of a first circulation direction,

a first group of cameras of the set of cameras comprises circular polarised filtering of the first circulation direction, the first group of the cameras comprises at least a first camera and a second camera,

the data acquisition functionality is configured to provide the surface data by activating the first group of illumination elements for illuminating the object with measuring light and capturing the at least one image by detecting measuring light reflected at the object by means of the first group of cameras, and

a second group of illumination elements of the set of illumination elements comprises circular polarised filtering of a second circulation direction, opposite to the first circulation direction.

2 . The measuring system according to claim 1 , wherein a second group of cameras of the set of cameras comprises circular polarised filtering of the second circulation direction, opposite to the first circulation direction, the second group of cameras comprises at least a third camera and a fourth camera.

3 . The measuring system according to claim 2 , wherein the data acquisition functionality is configured to provide the surface data comprising reflection surface data, wherein the reflection surface data is acquired by:

illuminating the object by activating the first group of illumination elements and capturing at least two reflection images by means of the second group of cameras, or

illuminating the object by activating the second group of illumination elements and capturing at least two reflection images by means of the first group of cameras,

wherein a first of the at least two reflection images is captured by the first or the third camera, respectively, and a second of the at least two reflection images is captured by the second or the fourth camera, respectively,

wherein

a point cloud is derived based on the at least two reflection images, and the 3D-modelling functionality is configured to derive or supplement the 3D model based on the reflection surface data, and/or

the at least two reflection images are referenced relative to each other in order to provide a reflection map of the object.

4 . The measuring system according to claim 1 , wherein the data acquisition functionality is configured to provide the surface data comprising diffuse surface data, wherein the diffuse surface data is acquired by:

illuminating the object by activating the first group of illumination elements,

capturing at least one diffuse image by means of the first group of cameras, and

deriving a point cloud based on the at least one diffuse image, and

the 3D-modelling functionality is configured to derive the 3D model based on the diffuse surface data.

5 . The measuring system according to claim 4 , wherein at least two diffuse images are captured by means of the first group of cameras and the point cloud is derived based on the at least two diffuse images to provide the diffuse surface data, wherein a first of the at least two diffuse images is captured by the first camera and a second of the at least two diffuse images is captured by the second camera.

6 . The measuring system according to claim 1 , wherein the data acquisition functionality is configured to provide a specular map for the object, wherein the specular map is derived by

illuminating the object by activating the first group of illumination elements and capturing at least one diffuse image by means of the first group of cameras,

illuminating the object by activating either the first group of illumination elements or the second group of illumination elements and capturing at least one reflection image by means of either the second group of cameras or the first group of cameras, wherein illuminating the object is provided with circular polarised filtering of a circulation direction different from a circulation direction of circular polarised filtering for capturing the at least one reflection image,

comparing the image data of the at least one diffuse image and the image data of the at least one reflection image, in particular wherein comparing the image data comprises subtraction of the image data of the at least one diffuse image and the image data of the at least one reflection image and/or providing a ratio between the image data of the at least one diffuse image and the image data of the at least one reflection image, and

deriving the specular map based on the comparison of the image data,

wherein the at least one diffuse image and the at least one reflection image at least partly cover a common part of the object.

7 . The measuring system according to claim 1 , wherein

the cameras of the set of cameras are fixedly arranged relative to each other and

the optical axis of the first camera is transversally oriented relative to the optical axis of the second camera and/or

the optical axis of the third camera is transversally oriented relative to the optical axis of the fourth camera,

in particular wherein the optical axes of the first camera and the second camera, and/or the optical axes of the third camera and the fourth camera respectively, enclose an angle between 80° and 100°, in particular 90°, in particular when projecting the optical axes on a plane which is defined by at least one of the optical axes and a connecting line between the first camera and the second camera or between the third camera and the fourth camera, respectively.

8 . The measuring system according to claim 1 , wherein

at least the first camera and/or the second camera

are provided as high-resolution monochromatic cameras and

comprise a filter element which is configured to transmit light with a wavelength of the blue spectrum, in particular to transmit light with a wavelength out of a wavelength range between 380 nm and 500 nm, and to block transmission of light with a wavelength besides the blue spectrum, in particular to block light with a wavelength less than 380 nm and/or greater than 500 nm, in particular to block light with a wavelength out of a wavelength range between 500 nm and 1000 nm.

9 . The measuring system according to claim 1 , wherein

the data acquisition functionality is configured to provide sets of surface data, wherein the sets of surface data are acquired by capturing at least two images each with the first camera and with the second camera, and

the 3D-modelling functionality is configured to provide a set of 3D models of the object by processing the sets of surface data, wherein a number of 3D models are computed according to the number of sets of surface data acquire by one of the cameras.

10 . The measuring system according to claim 9 , wherein the sets of surface data are acquired by successively capturing multiple images with the first camera and with the of the second camera within a defined time period.

11 . The measuring system according to claim 9 , wherein capturing the sets of surface data with the first camera is synchronised with capturing the sets of surface data with the second camera.

12 . The measuring system according to claim 9 , wherein the 3D-modelling functionality is configured to generate a video sequence based on the set of 3D models.

13 . The measuring system according to claim 1 , wherein the measuring system comprises a guiding functionality which is configured to

provide a guiding output, in particular an acoustic guiding output and/or a visual guiding output, to guide the object to approach a defined capture position relative to the capture device, and

control or notice the execution of the data acquisition functionality as a function of a deviation of a position of the object from the capture position,

in particular wherein the guiding output is derived base on image-based or video-based monitoring of the object by means of at least one camera of the set of cameras and image processing the camera data generated in the course of the monitoring.

14 . The measuring system according to claim 1 , wherein the measuring system comprises a display device configured to display the 3D model, in particular wherein the display device comprises the controlling and processing unit.

15 . The measuring system according to claim 1 , wherein the capture device comprises an infinity mirror to provide defined positioning of the object, in particular of the person, relative to the capture device.

16 . The measuring system according to claim 1 , wherein:

the 3D-modelling functionality comprises a monitoring functionality for monitoring a state of the object, wherein the monitoring functionality is configured to:

execute the data acquisition functionality at a first point in time and, by that, to provide reference surface data of the object,

provide a reference 3D model of the object by processing the reference surface data,

store the reference 3D model on a storage medium,

execute the data acquisition functionality at a second point in time and, by that, to provide progress surface data of the object,

provide a progress 3D model of the object by processing the progress surface data,

store the progress 3D model on the storage medium,

virtually align the reference 3D model relative to the progress 3D model, and

compare the reference 3D model with to the progress 3D model.

17 . The measuring system according to claim 16 , wherein the monitoring functionality comprises the step of deriving a progress measure based on the comparison of the reference 3D model with the progress 3D model, wherein the progress measure is computed by comparing volumes and/or sizes and/or shapes of the reference 3D model and the progress 3D or of a corresponding region of the reference 3D model and the progress 3D model.

18 . The measuring system according to claim 16 , wherein the monitoring functionality comprises the step of identifying a region of interest in the progress 3D model based on the comparison of the reference 3D model with the progress 3D model, wherein particular progress measures are derived for particular regions of the progress 3D model and the region of interest is defined in the progress 3D model by comparing the progress measures with a defined threshold.

19 . The measuring system according to claim 16 , wherein the object is guided to the capturing position for the first time for acquiring the reference surface data and is guided to the capturing position for the second time for acquiring the progress surface data.

Assignments (2)

Continuity (2)

References Cited (24)