IP Library Granted Patent US 10,479,328
Granted Patent B2
US 10,479,328 · App. 15/343,726 · Granted Nov 19, 2019

System and methods for assessing the interior of an autonomous vehicle

Inventors: Michael E Reibling (Sterling Heights, MI); Ramzi Ahmad Chraim (Dearborn, MI); Steven Michael Cyr (Lake Orion, MI); Ray C. Siciak (Ann Arbor, MI)
Assignee: FORD GLOBAL TECHNOLOGIES, LLC
B60S1/64B60S3/008G05D1/0088G05D1/021G06Q10/20G06Q50/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,479,328
App. No.
15/343,726
Filed
Nov 4, 2016
Granted
Nov 19, 2019
Kind
B2
Art Unit
3665
USPC
701/23
Abstract

An autonomous vehicle includes interior sensors including a camera, IR camera, electro-chemical sensor, humidity sensor, and temperature sensor. Initial and final outputs of these sensors are captured for a trip conveying one or more passengers. If changes in the outputs of the sensors are detected, whether the final outputs of the sensors are acceptable may be evaluated. In some embodiments, an aggregation of the outputs is evaluated and found unacceptable even where individual outputs are acceptable. Outputs may be presented to a dispatcher to confirm that the outputs are unacceptable. If the outputs are found to be unacceptable, the vehicle may be autonomously driven to a cleaning station. Personal items may be identified in camera outputs and alerts generated in response.

Claims (49)

1. A system for a vehicle comprising:

a plurality of sensors each sensing a different property of an interior of the vehicle, the plurality of sensors including all of a visible light camera, an infrared (IR) camera, and an electrochemical sensor;

a controller coupled to the plurality of interior sensors and programmed to—

receive a first output for each sensor of the plurality of sensors;

receive a second output for each sensor of the plurality of sensors after receiving the first output for each sensor of the plurality of sensors;

for each sensor of the plurality of sensors—

calculate a change value that is a change between the first output and the second output for the each sensor; and

when the change value meets a threshold condition corresponding to the each sensor, invoke cleaning of the interior;

calculate an aggregate change as one of a sum and a weighted sum of the change values for the plurality of sensors;

compare the aggregate change to an aggregate threshold condition; and

when the aggregate change between the first outputs and the second outputs exceeds the aggregate threshold condition and the change value for each of the sensors of the plurality of sensors does not meet the threshold corresponding to the each sensor, invoke cleaning of the interior.

2. The system of claim 1 , wherein the plurality of sensors include a humidity sensor.

3. The system of claim 2 , wherein the controller is further programmed to, if the change between the first and second outputs of at least one of the electro-chemical sensor and humidity sensor meet a corresponding threshold conditions:

activate a ventilation system of the vehicle;

again measure outputs of the at least one of the electro-chemical sensor and humidity sensor; and

if the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions, invoking cleaning of the interior.

4. The system of claim 2 , wherein the controller is programmed to determine if the aggregate change between the second outputs and the first outputs meets the threshold condition by inputting the first outputs and second outputs into a machine learning model.

5. The system of claim 1 , wherein the controller is programmed to invoke cleaning of the interior comprises autonomously driving the vehicle to a cleaning station.

6. The system of claim 5 , wherein the controller is programmed to, if an aggregate change between the second outputs and the first outputs does not meet a threshold condition, autonomously driving the vehicle to a pick up location without first autonomously driving the vehicle to any cleaning station.

7. A method for evaluating a vehicle, the method comprising:

providing a plurality of sensors each sensing a different property of an interior of the vehicle, the plurality of sensors including all of a visible light camera, an infrared (IR) camera, and an electrochemical sensor;

receiving, by a controller coupled to the plurality of interior sensors, first outputs from the plurality of interior sensors;

receiving, by the controller, second outputs from the plurality of sensors after a trip in the vehicle by a passenger subsequent to receiving the first outputs;

calculating, by the controller, for each sensor of the plurality of sensors, a change value that is a change between the first output and the second output for the each sensor;

calculating, by the controller, an aggregate change as a weighted sum of the change values for the plurality of sensors;

comparing the aggregate change to a threshold condition;

determining, by the controller, that the aggregate change exceeds the threshold condition;

in response to determining that the aggregate change between the second outputs and the first outputs exceeds the threshold condition invoking, by the controller, cleaning of the interior.

8. The method of claim 7 , wherein the plurality of sensors include a humidity sensor.

9. The method of claim 8 , wherein the threshold condition is a first threshold condition;

wherein the method further comprises:

receiving, by the controller, third outputs of the plurality of sensors;

receiving, by the controller, fourth outputs of the plurality of sensors after receiving the third outputs;

determining, by the controller, that a change between the third and fourth outputs of any one of the camera, IR camera, electro-chemical sensor, and humidity sensor meets a corresponding threshold condition;

in response to determining that the change between the third and fourth outputs of any one of the camera, IR camera, electro-chemical sensor, and humidity sensor meets the corresponding threshold condition, invoking, by the controller, cleaning of the interior.

10. The method of claim 8 , further comprising:

determining outputs of at least one of the electro-chemical sensor and humidity sensor meet a corresponding threshold conditions;

in response to determining that outputs of at least one of the electro-chemical sensor and humidity sensor meets the corresponding threshold condition—

activating, by the controller, a ventilation system of the vehicle;

again measuring, by the controller, the outputs of the at least one of the electro-chemical sensor and humidity sensor; and

determining, by the controller, that the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions; and

in response to determining that the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions, invoking cleaning of the interior.

11. The method of claim 8 , further comprising determining that the aggregate change between the second outputs and the first outputs meets the threshold condition by inputting the first outputs and second outputs into a machine learning model.

12. The method of claim 7 , wherein invoking cleaning of the interior comprises autonomously driving the vehicle to a cleaning station.

13. The method of claim 12 , further comprising:

receiving, by the controller, third outputs of the plurality of sensors;

receiving, by the controller, fourth outputs of the plurality of sensors after receiving the third outputs;

determining, by the controller, that an aggregate change between the third outputs and the fourth outputs does not meet the threshold condition; and

in response to determining that the aggregate change between the third outputs and the fourth outputs does not meet the threshold condition, autonomously driving, by the controller, the vehicle to a pick up location without driving the vehicle to any cleaning station.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2016
From: REIBLING, MICHAEL E; CHRAIM, RAMZI AHMAD; CYR, STEVEN MICHAEL; SICIAK, RAY C.
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 040226/0142 →
Continuity (1)
Related Publication 20180126960A1 · May 10, 2018