IP Library Granted Patent US 11,334,985
Granted Patent B2
US 11,334,985 · App. 16/663,496 · Granted May 17, 2022

System and method for shared vehicle cleanliness detection

Inventor: Philip Ventimiglia (Northville, MI)
Assignee: Robert Bosch GmbH
G06T7/001G06T7/0002G06T7/11G06V20/59G07C5/0825G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,334,985
App. No.
16/663,496
Granted
May 17, 2022
Kind
B2
Abstract

A method of operating a vehicle including a cabin having a plurality of interior segments, includes generating image data for each interior segment of the plurality of interior segments with an imaging device located within the cabin. The method further includes processing the generated image data to generate score data including a plurality of scores with a controller operably connected to the imaging device, each score of the plurality of scores corresponding to one of the interior segments of the plurality of interior segments, and combining the generated scores into a single vehicle cleanliness score. The method also includes generating availability data indicating if the vehicle is available or unavailable based on a comparison of the cleanliness score to a cleanliness threshold, and removing the vehicle from service based on the availability data.

Claims (73)

1. A method of operating a vehicle including a cabin having a plurality of interior segments, the method comprising:

generating image data for each interior segment of the plurality of interior segments with an imaging device located within the cabin;

processing the generated image data to generate score data including a plurality of scores with a controller operably connected to the imaging device, each score of the plurality of scores corresponding to one of the interior segments of the plurality of interior segments;

combining the generated scores into a single vehicle cleanliness score;

generating percent change data based on a percent change of the single vehicle cleanliness score compared to a previous vehicle cleanliness score of the vehicle;

generating availability data indicating if the vehicle is available or unavailable based on (i) a comparison of the single vehicle cleanliness score to a cleanliness threshold, and/or (ii) the percent change data; and

removing the vehicle from service when the availability data indicates that the vehicle is unavailable.

2. A method of operating a vehicle including a cabin having a plurality of interior segments, the method comprising:

generating image data for each interior segment of the plurality of interior segments with an imaging device located within the cabin;

processing the generated image data to generate score data including a plurality of scores with a controller operably connected to the imaging device, each score of the plurality of scores corresponding to one of the interior segments of the plurality of interior segments;

combining the generated scores into a single vehicle cleanliness score;

generating availability data indicating if the vehicle is available or unavailable based on a comparison of the cleanliness score to a cleanliness threshold; and

removing the vehicle from service when the availability data indicates that the vehicle is unavailable,

wherein processing the generated image data to generate the plurality of scores comprises:

determining an occlusion metric for each interior segment of the plurality of interior segments to generate a plurality of occlusion metrics; and

converting each of the occlusion metrics to a corresponding score of the plurality of scores,

wherein each occlusion metric of the plurality of occlusion metrics is a percentage of the corresponding interior segment that is occluded by a non-vehicle element.

3. The method as claimed in claim 2 , wherein converting each of the occlusion metrics to a corresponding score comprises:

weighting each occlusion metric according to a weighting scale.

4. The method as claimed in claim 3 , wherein:

the plurality of interior segments includes at least a driver seat segment, a passenger seat segment, a driver floor segment, a passenger floor segment, a center console segment, and a rear seat segment, and

the weighting scale applies the following weights to the plurality of interior segments

the driver seat segment is weighted at 30%,

the passenger seat segment is weighted at 25%,

the driver floor segment is weighted at 10%,

the passenger floor segment is weighted at 10%,

the center console segment is weighted at 15%, and

the rear seat segment is weighted at 10%.

5. The method as claimed in claim 3 , wherein the weighting scale is a first weighting scale, and converting each of the occlusion metrics to a corresponding score comprises:

weighting each occlusion metric according to the first weighting scale during a first seasonal time period, and

weighting each occlusion metric according to a second weighting scale during a second seasonal time period that is different than the first seasonal time period.

6. The method as claimed in claim 5 , wherein:

the plurality of interior segments includes at least a driver seat segment, a passenger seat segment, a driver floor segment, a passenger floor segment, a center console segment, and a rear seat segment,

the first weighting scale applies the following weights to the plurality of interior segments

the driver seat segment is weighted at 30%,

the passenger seat segment is weighted at 25%,

the driver floor segment is weighted at 10%,

the passenger floor segment is weighted at 10%,

the center console segment is weighted at 15%, and

the rear seat segment is weighted at 10%, and

the second weighting scale applies the following weights to the plurality of interior segments

the driver seat segment is weighted at 40%,

the passenger seat segment is weighted at 30%,

the driver floor segment is weighted at 5%,

the passenger floor segment is weighted at 5%,

the center console segment is weighted at 15%, and

the rear seat segment is weighted at 5%.

7. The method as claimed in claim 1 , wherein:

the previous vehicle cleanliness score is associated with a first user,

the single vehicle cleanliness score is associated with a second user, and

the method further comprises assessing a penalty to the second user when the percent change data exceeds a percent change threshold.

8. The method as claimed in claim 2 , further comprising:

processing the generated image data to generate to hazardous item data corresponding to hazardous items in the cabin,

removing the vehicle from service based on the hazardous item data.

9. An apparatus for monitoring a cabin of a vehicle, the cabin including a plurality of interior segments, the apparatus comprising:

an imaging device located within the cabin and configured to generate image data for each interior segment of the plurality of interior segments;

a controller operably connected to the imaging device and configured to:

process the generated image data to generate score data including a plurality of scores, each score of the plurality of scores corresponding to one of the interior segments of the plurality of interior segments,

combine the generated scores into a single vehicle cleanliness score,

generate availability data indicating if the vehicle is available or unavailable based on a comparison of the cleanliness score to a cleanliness threshold, and

remove the vehicle from shared vehicle service when the availability data indicates that the vehicle is unavailable,

wherein processing the generated image data to generate the score data includes (i) determining an occlusion metric for each interior segment of the plurality of interior segments to arrive at a plurality of occlusion metrics, and (ii) converting each of the occlusion metrics to a corresponding score of the plurality of scores by weighting each occlusion metric of the plurality of scores according to a weighting scale, and

wherein each of the occlusion metrics is a percentage of the corresponding interior segment that is occluded by a non-vehicle element.

10. The apparatus as claimed in claim 9 , further comprising:

a housing located within a compartment of the cabin,

wherein the imaging device and the controller are located within the housing.

11. The apparatus as claimed in claim 10 , wherein the compartment is located in an overhead console of the vehicle.

12. The apparatus as claimed in claim 9 , further comprising:

at least one visible lighting device operably connected to the controller and configured to illuminate the cabin with light in the visible spectrum; and

an infrared lighting device operably connected to the controller and configured to illuminate the cabin with light in the infrared spectrum.

13. The apparatus as claimed in claim 9 , wherein the controller and imaging device are electrically isolated from an electrical system of the vehicle.

14. The system as claimed in claim 9 , further comprising:

a transceiver operably connected to the controller and configured to transmit wirelessly at least the availability data to a remote base station.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2020
From: VENTIMIGLIA, PHILIP
To: ROBERT BOSCH GMBH
Reel/Frame 053000/0937 →
Continuity (1)
Related Publication 20210125322A1 · Apr 29, 2021
Cited By (1)
US 12,260,652