Methods and Systems for Determining One or More Characteristics Inside a Cabin of a Vehicle
Methods and systems are described that implement determining one or more characteristics of the interior of a vehicle that lead to a reliable detection or observation of objects even if the direct line of sight between the objects and the camera is occluded. In an aspect, a computer implemented method includes the following operations carried out by computer hardware components: determining an image of an area of a cabin inside a vehicle using a sensor, the image including at least one first region representing the area reflected by at least one reflective surface provided in the cabin and at least one second region representing the area in a direct line of sight; and determining one or more characteristics inside the cabin of the vehicle based on at least one of: the at least one first region of the image; or the at least one second region of the image.
1 . A computer implemented method comprising the following operations carried out by computer hardware components:
determining an image of an area of a cabin inside a vehicle using a sensor, the image comprising at least one first region representing at least a portion of an area reflected by at least one reflective surface provided in the cabin and at least one second region representing at least a portion of an area in a direct line of sight; and
determining one or more characteristics inside the cabin of the vehicle based on at least one of:
the at least one first region of the image; or
the at least one second region of the image.
2 . The method of claim 1 , wherein the first region represents at least a portion of an area in an indirect line of sight.
3 . The method of claim 1 , further comprising at least one of:
wherein the at least one reflective surface is positioned in a roof area of the cabin, or
wherein the at least one reflective surface comprises a layer configured to reflect infrared radiation.
4 . The method of claim 1 ,
wherein the first region represents the at least a portion of an area in an indirect line of sight,
wherein the at least one reflective surface is positioned in a roof area of the cabin, and
wherein the at least one reflective surface comprises a layer configured to reflect infrared radiation.
5 . The method of claim 1 , further comprising:
extracting each of the at least one first region and each of the at least one second region.
6 . The method of claim 5 , further comprising:
cropping the at least one first region, extracted in the image, to generate at least one cropped first region.
7 . The method of claim 6 , further comprising:
cropping the at least one second region, extracted in the image, to generate at least one cropped second region; and
determining the one or more characteristics inside the cabin of the vehicle based on at least one of:
the at least one cropped first region, or
the at least one cropped second region.
8 . The method of claim 1 , further comprising:
determining whether the direct line of sight is occluded; and
determining the one or more characteristics inside the cabin of the vehicle based on the at least one first region of the image when it is determined that the direct line of sight is occluded.
9 . The method of claim 1 , further comprising:
determining a first visual signature of the first region of the image at a first point of time;
determining a second visual signature of the first region of the image at a second point of time;
comparing the first visual signature and the second visual signature; and
determining the one or more characteristics related to an object in the area based on the comparison of the first visual signature and the second visual signature.
10 . The method of claim 1 , further comprising:
determining that the direct line of sight is occluded;
determining the one or more characteristics inside the cabin of the vehicle based on the at least one first region of the image responsive to determining that the direct line of sight is occluded;
determining a first visual signature of the first region of the image at a first point of time;
determining a second visual signature of the first region of the image at a second point of time;
comparing the first visual signature and the second visual signature; and
determining the one or more characteristics related to an object in the area based on the comparison of the first visual signature and the second visual signature.
11 . The method of claim 10 , wherein the first point of time is a point of time where the direct line of sight is not occluded.
12 . The method of claim 1 , further comprising:
extracting each of the at least one first region and each of the at least one second region;
determining a first visual signature of the first region of the image at a first point of time;
determining a second visual signature of the first region of the image at a second point of time;
comparing the first visual signature and the second visual signature; and
determining the one or more characteristics related to an object in the area based on the comparison of the first visual signature and the second visual signature.
13 . The method of claim 1 , further comprising:
converting the at least one first region of the image into a converted region to correct a distortion in the at least one first region of the image, wherein the determining of the one or more characteristics is based on the converted region of the image.
14 . The method of claim 13 ,
wherein the converting uses a first machine learning technique,
wherein the determining of the one or more characteristics uses a second machine learning technique, and
wherein the first machine learning technique and the second machine learning technique are trained end-to-end.
15 . The method of claim 14 , wherein the determination of the one or more characteristics inside the cabin of the vehicle uses a machine learning technique.
16 . The method of claim 1 , wherein the determination of the one or more characteristics inside the cabin of the vehicle uses a machine learning technique.
17 . The method of claim 1 , wherein the one or more characteristics is related to at least one of an object, a person, a portion of a person, a child-seat, a bag, or an empty seat.
18 . A computer system comprising a plurality of computer hardware components configured to:
determine an image of an area of a cabin inside a vehicle using a sensor, the image comprising at least one first region representing at least a portion of an area reflected by at least one reflective surface provided in the cabin and at least one second region representing at least a portion of an area in a direct line of sight; and
determine one or more characteristics inside the cabin of the vehicle based on at least one of:
the at least one first region of the image; or
the at least one second region of the image.
19 . The computer system of claim 18 , further comprising:
the vehicle;
the sensor; and
the reflective surface.
20 . A non-transitory computer readable medium comprising instructions that when executed, configure computer hardware components to:
determine an image of an area of a cabin inside a vehicle using a sensor, the image comprising at least one first region representing at least a portion of an area reflected by at least one reflective surface provided in the cabin and at least one second region representing at least a portion of an area in a direct line of sight; and
determine one or more characteristics inside the cabin of the vehicle based on at least one of:
the at least one first region of the image; or
the at least one second region of the image.