Granted Patent B2

US 12,522,172 · App. 18/051,229 · Granted Jan 13, 2026

Inventors: Amil George (Wuppertal, DE); Timo Rehfeld (Cologne, DE); Alexander Barth (Wermelskirchen, DE)

Assignee: Aptiv Technologies AG

B60R22/48G06V10/22G06V10/764G06V10/811G06V20/59G06V40/10B60R2022/4808B60R2022/4866

Abstract

Claims (96)

1 . A method comprising:

obtaining at least one first image in the infrared spectrum of at least part of a seat belt region where a seat belt is expected to be visible when it is worn by a person in a vehicle;

obtaining at least one second image in the visible light spectrum of at least part of the seat belt region used to obtain the at least one first image;

performing image analysis to extract information from each of the at least one first image and the at least one second image;

attributing a score to each of the at least one first image and the at least one second image based on the information extracted from the at least one first image and the at least one second image, respectively, and based on a predefined rule, each score being indicative of trustworthiness of the corresponding image to detect a seat belt status;

transmitting the at least one first image to a first classifier, dedicated for images in the infrared spectrum;

transmitting the at least one second image to a second classifier, dedicated for images in the visible light spectrum;

determining from the first classifier a first estimate of probability that the at least one first image includes the seat belt being correctly worn;

determining from the second classifier a second estimate of probability that the at least one second image includes the seat belt being correctly worn;

combining the first estimate of probability and the second estimate of probability, based on the scores attributed to each of the at least one first image and to the at least one second image, to determine a combined probability; and

comparing the combined probability to a predetermined threshold to determine the seat belt status;

wherein obtaining the at least one first image further comprises:

obtaining the at least one first image from a first image capturing device, the first image capturing device configured for capturing the at least one first image in the infrared spectrum inside the vehicle;

wherein obtaining the at least one second image further comprises:

obtaining the at least one second image from a second image capturing device, the second image capturing device configured for capturing the at least one second image in the visible light spectrum inside the vehicle; and

wherein the method further comprises:

generating, from the at least one first image, a plurality of first images of different parts of the seat belt region respectively; and

generating, from the at least one second image, a plurality of second images of different parts of the seat belt region respectively;

wherein the operation of obtaining the at least one first image further comprises:

selecting one or more of the plurality of first images;

wherein the operation of obtaining the at least one second image further comprises selecting one or more of the plurality of second images; and

wherein only the selected first and second images are transmitted to the first and second classifiers, respectively.

2 . The method according to claim 1 , wherein performing the image analysis comprises, for each image, at least one of the following image analysis tasks:

analysis of statistical properties of the image;

detection of an occlusion to detect that vision of the seat belt is occluded in the image;

seat belt color profile recognition to recognize a predetermined profile of a seat belt color in the image; or

clothing detection to detect clothing occluding a back area in the image.

3 . The method of claim 2 , wherein the image analysis tasks are performed by a digital image processor.

4 . The method according to claim 1 , wherein the selecting of the one or more of the plurality of first images and the selecting of the one or more of the plurality of second images is performed based on the scores attributed to the plurality of first images and the plurality of second images, respectively.

5 . The method according to claim 1 , further comprising:

detecting body key points for one or more occupants of the vehicle visible in each of the plurality of first images and the plurality of second images; and

determining the seat belt region, based on the detected body key points, in each of the plurality of first images and the plurality of second images.

6 . The method according to claim 1 , wherein the operations of obtaining the at least one first image and obtaining the at least one second image are repeated cyclically, and, at each cycle, N first images are generated from the at least one first image, N second images are generated from the at least one second image, and M first images from the N first images and M second images from the N second images are selected, with M<N, and wherein image positions of the selected images change at each cycle.

7 . The method according to claim 6 , wherein a result of the combining operation is stabilized by a feed-back loop where the scores of the at least one first image and of the at least one second image and the outputs of the first and second classifiers are provided as inputs for the next execution of the cycle.

8 . The method according to claim 1 , wherein, in the operation of combining, the first estimate of probability of the at least one first image and the second estimate of probability of the at least one second image are weighted using the scores respectively attributed to the at least one first image and to the at least one second image to compute the combined probability.

9 . The method according to claim 1 , wherein the operation of combining uses predefined rules for combining the estimates of probability of the at least one first image and the at least one second image.

10 . The method of claim 1 , wherein at least one of:

obtaining the at least one first image comprises:

obtaining the at least one first image from a first image capturing device;

obtaining the at least one second image comprises:

obtaining the at least one second image from a second image capture device; or

obtaining the at least one first image comprises obtaining the at least one first image from a first image capturing device and obtaining the at least one second image comprises obtaining the at least one second image from the first image capturing device.

11 . A system for a vehicle, comprising:

an image capturing device; and

a processing device operable to:

obtain, from the image capturing device, at least one first image in the infrared spectrum of at least part of a seat belt region where a seat belt is expected to be visible when it is worn by a person in the vehicle;

obtain, from the image capturing device, at least one second image in the visible light spectrum of at least part of the seat belt region used to obtain the at least one first image;

perform image analysis to extract information from each of the at least one first image and the at least one second image;

attribute a score to each of the at least one first image and the at least one second image based on the information extracted from the at least one first image and the at least one second image, respectively, and based on a predefined rule, each score being indicative of trustworthiness of the corresponding image to detect a seat belt status;

transmit the at least one first image to a first classifier, dedicated for images in the infrared spectrum;

transmit the at least one second image to a second classifier, dedicated for images in the visible light spectrum,

determine from the first classifier a first estimate of probability that the at least one first image includes the seat being belt correctly worn;

determine from the second classifier a second estimate of probability that the at least one second image includes the seat belt being correctly worn;

combine the first estimate of probability and the second estimate of probability, based on the scores attributed to each of the at least one first image and to the at least one second image, to determine a combined probability; and

compare the combined probability to a predetermined threshold to determine the seat belt status;

wherein the processing device is operable to obtain the at least one first image by:

obtaining the at least one first image from a first image capturing device, the first image capturing device configured to capture the at least one first image in the infrared spectrum inside the vehicle;

wherein the processing device is operable to obtain the at least one second image by:

obtaining the at least one second image from a second image capturing device, the second image capturing device configured to capture the at least one second image in the visible light spectrum inside the vehicle; and

wherein the processing device is further operable to:

generate, from the at least one first image, a plurality of first images of different parts of the seat belt region respectively; and

generate, from the at least one second image, a plurality of second images of different parts of the seat belt region respectively;

wherein the processing device is operable to obtain the at least one first image by selecting one or more of the plurality of first images;

wherein the processing device is operable to obtain the at least one second image by selecting one or more of the plurality of second images; and

wherein only the selected first and second images are transmitted to the first and second classifiers, respectively.

12 . The system of claim 11 , further comprising the vehicle.

13 . The system of claim 11 , wherein the processing device is operable to perform the image analysis by performing at least one of the following image analysis tasks:

analysis of statistical properties of the image;

detection of an occlusion to detect that vision of the seat belt is occluded in the image;

seat belt color profile recognition to recognize a predetermined profile of the seat belt color in the image; or

clothing detection to detect clothing occluding a back area in the image.

14 . The system of claim 13 , further comprising:

a digital image processor, wherein the digital image processor performs the image analysis tasks.

15 . An apparatus comprising:

a processor; and

a computer-readable medium storing instructions that, responsive to execution by the processor, cause the processor to execute operations comprising:

obtain, from an image capturing device, at least one first image in the infrared spectrum of at least part of a seat belt region where a seat belt is expected to be visible when it is worn by a person in the vehicle;

obtain, from the image capturing device, at least one second image in the visible light spectrum of at least part of the seat belt region used to obtain the at least one first image;

perform image analysis to extract information from each of the at least one first image and the at least one second image;

attribute a score to each of the at least one first image and the at least one second image based on the information extracted from the at least one first image and the at least one second image, respectively, and based on a predefined rule, each score being indicative of trustworthiness of the corresponding image to detect a seat belt status;

transmit the at least one first image to a first classifier, dedicated for images in the infrared spectrum;

transmit the at least one second image to a second classifier, dedicated for images in the visible light spectrum,

determine from the first classifier a first estimate of probability that the at least one first image includes the seat belt correctly worn;

determine from the second classifier a second estimate of probability that the at least one second image includes the seat belt correctly worn;

combine the first estimate of probability and the second estimate of probability, based on the scores attributed to each of the at least one first image and to the at least one second image, to determine a combined probability; and

compare the combined probability to a predetermined threshold to determine the seat belt status;

wherein the instructions, responsive to execution by the processor, further cause the processor to obtain the at least one first image by:

obtaining the at least one first image from a first image capturing device, the first image capturing device configured to capture the at least one first image in the infrared spectrum inside the vehicle;

wherein the instructions, responsive to execution by the processor, further cause the processor to obtain the at least one second image by:

obtaining the at least one second image from a second image capturing device, the second image capturing device configured to capture the at least one second image in the visible light spectrum inside the vehicle; and

wherein the processing device is further operable to:

generate, from the at least one first image, a plurality of first images of different parts of the seat belt region respectively; and

generate, from the at least one second image, a plurality of second images of different parts of the seat belt region respectively;

wherein the instructions, responsive to execution by the processor, further cause the processor to obtain the at least one first image by selecting one or more of the plurality of first images;

wherein the instructions, responsive to execution by the processor, further cause the processor to obtain the at least one second image by selecting one or more of the plurality of second images; and

wherein only the selected first and second images are transmitted to the first and second classifiers, respectively.

Assignments (4)

Priority Claims (1)

Continuity (1)

References Cited (27)