Granted Patent B2

US 12,657,273 · App. 18/728,108 · Granted Jun 16, 2026

Inventors: Peter Schillen (Mannheim, DE); Benjamin Guthier (Mannheim, DE); Nicolas Wipfler (Ludwigshafen am Rhein, DE)

Assignee: TRINAMIX GMBH

G06F21/32

Abstract

Claims (31)

1 . A method for authorizing an object of a device to perform at least one operation on the device that requires authentication, comprising the steps:

receiving, from a user interface associated with a device, an unlock request for the device from a user;

in response to receiving the unlock request, triggering illumination of the object with patterned infrared illumination, wherein the patterned infrared illumination is an irregular dot pattern;

triggering to capture at least one pattern image of the object using a camera located on the device while the object is being illuminated with the patterned infrared illumination;

triggering to capture at least one flood image showing the object while it is illuminated with flood light, determining an outline of the object indicating the position and extent of the object from the flood image;

extracting material data of the object from the at least one pattern image, wherein the material data is extracted from the intensity distribution of the dots reflected by the object, wherein the extracting of material data comprises manipulating the pattern image to generate a partial image using the outline of the object and extracting material data of the object from the partial image by providing the partial image to a data-driven model, wherein the data-driven model is parametrized according to a training data set including partial images and material data to map the partial image to a material classifier signifying the material, and determining a material heat map signifying the material distribution in the partial image, wherein the material data comprising a material class and/or a material type; and

allowing or declining the object to perform at least one operation on the device that requires authentication based on the material data.

2 . The method according to claim 1 , wherein, the capturing of the at least one pattern image comprises capturing the at least one image of the object using the camera located on the device while the object is being illuminated with the patterned infrared illumination.

3 . The method according to claim 1 , wherein the authenticating uses a facial recognition authentication process operating on the pattern image and/or the extracted material data.

4 . The method according to claim 3 , wherein the authentication process is validated based on the extracted material data.

5 . The method according to claim 4 , wherein the validating based on the extracted material data comprises determining if the extracted material data corresponds to a desired material data.

6 . The method according to claim 4 , wherein the authentication process or its validation comprises generating at least one feature vector from the material data and matching the material feature vector with associate reference template vector for a material.

7 . The method according to claim 6 , wherein the material feature vector comprises a representation of the luminance or translucence included in the material data.

8 . The method according to claim 1 , wherein the patterned infrared illumination is a regular pattern and/or a periodic pattern with pattern features per face area at a distance of 5-200 cm.

9 . The method according to claim 1 , wherein the extracting of material data comprises performing a beam profile analysis by applying an image filter on pattern features of the image.

10 . The method according to claim 1 , wherein the operation requiring authentication comprises unlocking the device.

11 . The method according to claim 1 , wherein the manipulating of the pattern image comprises: suppressing texture information from the object located in a region of interest; and/or partitioning the pattern image and/or data of the pattern image; and/or cropping the pattern image to a partial image; and/or determining a bounding box for the region of interest in the image and cropping the image to extract the region of interest.

12 . A device for authorizing a user of a device to perform at least one operation on the device that requires authentication, the device comprising a processor configured to perform the following steps:

receiving, from a user interface associated with a device, an unlock request for the device from a user;

in response to receiving the unlock request, triggering illumination of the object with patterned infrared illumination, wherein the patterned infrared illumination is an irregular dot pattern;

triggering to capture at least one pattern image of the object using a camera located on the device while the object is being illuminated with the patterned infrared illumination;

triggering to capture at least one flood image showing the object while it is illuminated with flood light, determining an outline of the object indicating the position and extent of the object from the flood image;

extracting material data of the object from the at least one pattern image, wherein the material data is extracted from the intensity distribution of the dots reflected by the object, wherein the extracting of material data comprises manipulating the pattern image to generate a partial image using the outline of the object and extracting material data of the object from the partial image by providing the partial image to a data-driven model, wherein the data-driven model is parametrized according to a training data set including partial images and material data to map the partial image to a material classifier signifying the material, and determining a material heat map signifying the material distribution in the partial image, wherein the material data comprising a material class and/or a material type; and

allowing or declining the object to perform at least one operation on the device that requires authentication based on the material data.

13 . A computer program for authorizing a user of a device to perform at least one operation on the device that requires authentication, wherein the computer program is recorded on a non-transitory computer readable medium;

the computer program including instructions causing a computer to execute the steps of the method according to claim 1 .

14 . The method according to claim 1 , wherein the patterned infrared illumination is a regular pattern and/or a periodic pattern with at least 2 pattern features per face area at a distance of 5-200 cm.

15 . The method according to claim 1 , wherein the patterned infrared illumination is a regular pattern and/or a periodic pattern with at least 2 pattern features per face area at a distance of 30-60 cm.

16 . The method according to claim 1 , wherein the patterned infrared illumination is a regular pattern and/or a periodic pattern with at least 20 pattern features per face area at a distance of 15-80 cm.

17 . The method according to claim 1 , wherein the extracting of material data comprises performing a beam profile analysis by applying a material dependent image filter on pattern features of the image.

18 . The method according to claim 11 , wherein the region of interest is a face of the user.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (21)