IP Library Granted Patent US 12,462,527
Granted Patent B2
US 12,462,527 · App. 18/023,647 · Granted Nov 4, 2025

Method and device for classifying targets

Inventors: Julia Nitsch (Hamburg, DE); Christian Fellenberg (Hamburg, DE); Thorbjörn Posewsky (Hamburg, DE); Jennifer Erdmann (Hamburg, DE); Cornelia Hofsäss (Hamburg, DE)
Assignee: Microvision, Inc.
G06V10/764G01S17/89G06V10/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,527
App. No.
18/023,647
Granted
Nov 4, 2025
Kind
B2
Abstract

A method for classifying targets is proposed, which comprises the extraction of features from measurement data of one or several receiving elements of a sensor by means of a neuronal network or by means of a Gaussian Mixture Model, wherein the respective measurement data of the at least one receiving element of the sensor involve at least one section of a photon histogram, and wherein the neuronal network involves a fully connected neuronal network or a convolutional neuronal network.

Claims (38)

1 . A method for classifying targets, comprising:

obtaining measurement data from at least one receiving element of a sensor;

generating a photon histogram as a one-dimensional array from the measurement data;

converting the photon histogram into a two-dimensional image representation;

extracting features from the two-dimensional image representation of the photon histogram by means of a convolutional neuronal network or a Gaussian Mixture Model to obtain extracted features; and

classifying the targets based at least in part on the extracted features, wherein the extracted features comprise a shape of a peak in the two-dimensional image representation of the photon histogram, and wherein the classifying comprises distinguishing between object reflections and environmental condition reflections based on the extracted features.

2 . The method according to claim 1 , wherein the extracted features further comprise a height of the peak in the two-dimensional image representation of the photon histogram.

3 . The method according to claim 1 ,

wherein the sensor is a solid-state Lidar sensor, wherein the method comprises a performance of light transit time measurements for at least one defined measuring interval by means of the sensor, and

wherein the generating of the photon histogram comprises generating the photon histogram per measuring interval based upon the light transit time measurements.

4 . The method according to claim 1 ,

wherein the method comprises a provision of the measurement data for the neuronal network or the Gaussian Mixture Model,

wherein only at least one section of the photon histogram is provided, and wherein the section comprises precisely one peak.

5 . The method according to claim 1 , further comprising determining and allocating a distance to each of the targets based on a position of the peak in the two-dimensional image representation of the photon histogram.

6 . The method according to claim 1 , wherein the photon histogram is generated for each measuring interval and for each receiving element of the sensor.

7 . The method according to claim 1 ,

wherein the classifying takes place by means of an additional neuronal network, wherein the additional neuronal network is designed as a fully connected neuronal network.

8 . The method according to claim 1 , wherein the method comprises a determination of a statement about an environmental condition.

9 . The method according to claim 8 ,

wherein the statement relates to a presence of the environmental condition and/or a type of environmental condition and/or a strength of the environmental condition.

10 . The method according to claim 1 wherein the method comprises a determination and allocation of a distance to each detected target, primarily to each detected object and/or each detected environmental condition.

11 . A device for classifying targets, comprising:

a sensor with several receiving elements;

an evaluation unit with a neuronal network, wherein the neuronal network involves a fully connected neuronal network or a convolutional neuronal network,

wherein the neuronal network is configured to extract features from measurement data of one or several receiving elements of the sensor,

wherein the measurement data of the at least one receiving element of the sensor each involve at least one section of a two-dimensional image representation of a photon histogram, wherein the neuronal network is configured to classify the targets based at least in part on the features, wherein the features comprise a shape of a peak in the two-dimensional image representation of the photon histogram, and wherein the targets are classified as either object reflections or environmental condition reflections based on the features.

12 . The device according to claim 11 , wherein the features further comprise a height of the peak in the two-dimensional image representation of the photon histogram.

13 . The device according to claim 11 , wherein the features further comprise a width of the peak in the two-dimensional image representation of the photon histogram.

14 . The device according to claim 11 , wherein the features further comprise a smoothness of the peak in the two-dimensional image representation of the photon histogram.

15 . A non-transitory computer-readable storage medium on which a program is stored that allows a computer, once it has been loaded into a memory of the computer, to implement a method, wherein the method comprises:

extracting features from measurement data of one or several receiving elements of a sensor by means of a neuronal network or by means of a Gaussian Mixture Model, wherein the respective measurement data of the at least one receiving element of the sensor involve at least one section of a two-dimensional image representation of a photon histogram,

wherein the neuronal network involves a fully connected neuronal network or a convolutional neuronal network; and

classifying targets based at least in part on the features comprise a shape of a peak in the two-dimensional image representation of the photon histogram, and wherein the classifying comprises distinguishing between object reflections and environmental condition reflections based on the features.

16 . The non-transitory computer-readable storage medium according to claim 15 , wherein the classifying takes place by means of an additional neuronal network, wherein the neuronal network is designed as a fully connected neuronal network.

17 . The non-transitory computer-readable storage medium according to claim 15 , wherein the method comprises a determination of a statement about an environmental condition.

18 . The non-transitory computer-readable storage medium according to claim 17 , wherein the statement relates to a presence of the environmental condition and/or a type of environmental condition and/or a strength of the environmental condition.

19 . The non-transitory computer-readable storage medium according to claim 15 , wherein the features further comprise a smoothness of the peak in the two-dimensional image representation of the photon histogram.

20 . The non-transitory computer-readable storage medium according to claim 15 , wherein the features further comprise a width of the peak in the two-dimensional image representation of the photon histogram.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2023
From: NITSCH, JULIA; FELLENBERG, CHRISTIAN; POSEWSKY, THORBJORN; ERDMANN, JENNIFER; HOFSAB, CORNELIA
To: IBEO AUTOMOTIVE SYSTEMS GMBH
Reel/Frame 063667/0199 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2023
From: MICROVISION GMBH
To: MICROVISION, INC.
Reel/Frame 063061/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2023
From: IBEO AUTOMOTIVE SYSTEMS GMBH
To: MICROVISION GMBH
Reel/Frame 062992/0769 →
Priority Claims (1)
EP 20193251 · Aug 28, 2020 · regional
Continuity (1)
Related Publication 20230316712A1 · Oct 5, 2023
References Cited (10)
US 20190324147A1 · Day · 2019 [cited by examiner]
US 20200225333A1 · Birnbacher · 2020 [cited by applicant]
US 20200364501A1 · Herz · 2020 [cited by examiner]
JP 2018077786 · 2018 [cited by applicant]
JP 20180777786 · 2018 [cited by applicant]
JP 2020521544 · 2020 [cited by applicant]
KR 1020190131050 · 2019 [cited by applicant]
Sergio Hernandez-Marin et al., Bayesian Analysis of Lidar Signals with Multiple Returns, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, Issue 12 (Year: 2007). [cited by examiner]
Caramazza et al, Neural network identification of people hidden from view with a single-pixel, single-photon detector, Scientific Reports, 8, 11945 (Year: 2018). [cited by examiner]
Hernandez-Marin, et al., “Bayesian Analysis of Lidar Signals with Multiple Returns” , IEEE Transactions on Pattern Analysis and Machine Intelligence, Nov. 5, 2007, pp. 2170-2180, vol. 29, No. 12, IEEE Computer Society, … [cited by applicant]