Detecting objects within a vehicle in connection with a service
View Patent ↗A system for monitoring a vehicle used in providing a service is disclosed. The system detects when the service is complete, and upon detecting that the service is complete, the system determines, from one or more sensors of the vehicle, that an object which should have been removed from the vehicle after completion of the transport service, remains in the vehicle. The system then automatically initiates performance of a remedial action.
1. A computer-implemented method for monitoring a vehicle that is operating to provide transportation services, the method comprising:
receiving, by a computing system comprising one or more computing devices, data that describes a first transportation service to be provided by the vehicle for a user;
receiving, by the computing system, sensor data collected by one or more sensors physically located on or within the vehicle;
detecting, by the computing system and based at least in part on the sensor data, that an object has been placed in or removed from the vehicle; and
in response to detecting that the object has been placed in or removed from the vehicle:
determining, by the computing system, that the first transportation service has started or ended; and
providing, by the computing system, data to the user indicating that the first transportation service has started or ended.
2. The computer-implemented method of claim 1 , further comprising performing an image recognition process on the sensor data to recognize the object based on visual characteristics.
3. The computer-implemented method of claim 1 , wherein:
detecting, by the computing system and based at least in part on the sensor data, that the object has been placed in or removed from the vehicle comprises detecting, by the computing system and based at least in part on the sensor data, that the object has been placed in the vehicle; and
determining, by the computing system, that the first transportation service has started or ended comprises, in response to detecting that the object has been placed in the vehicle, determining, by the computing system, that the first transportation service has started.
4. The computer-implemented method of claim 1 , wherein:
detecting, by the computing system and based at least in part on the sensor data, that the object has been placed in or removed from the vehicle comprises detecting, by the computing system and based at least in part on the sensor data, that the object has been removed from the vehicle; and
determining, by the computing system, that the first transportation service has started or ended comprises, in response to detecting that the object has been removed from the vehicle, determining, by the computing system, that the first transportation service has ended.
5. The computer-implemented method of claim 1 , wherein the first transportation service is a delivery service and the object is an item to be delivered.
6. The computer-implemented method of claim 1 , wherein the first transportation service is a passenger transportation service for a human passenger and the object is associated with the human passenger.
7. The computer-implemented method of claim 1 , wherein the vehicle comprises an autonomous vehicle.
8. The computer-implemented method of claim 1 , wherein the one or more sensors comprise one or more cameras.
9. The computer-implemented method of claim 1 , wherein the one or more sensors comprise one or more weighing devices.
10. The computer-implemented method of claim 1 , wherein the one or more sensors comprise one or more antennas of the vehicle that use wireless protocols.
11. The computer-implemented method of claim 1 , wherein the transportation service comprises a food delivery service.
12. The computer-implemented method of claim 11 , wherein detecting, by the computing system and based at least in part on the sensor data, that an object has been placed in or removed from the vehicle further comprises detecting that a food product has been placed in or removed from the vehicle.
13. The computer-implemented method of claim 1 , wherein the object comprises a food product.
14. A vehicle comprising:
one or more sensors that generate sensor data; and
a control system to execute instructions that cause the vehicle to perform operations comprising:
receiving, from a remote system, instructions for the vehicle to provide a first transportation service for a user;
obtaining the sensor data generated by the one or more sensors;
detecting, based at least in part on the sensor data, that an object has been placed in or removed from the vehicle; and
in response to detecting that the object has been placed in or removed from the vehicle;
determining that the first transportation service has started or ended; and
providing data to the user indicating that the first transportation service has started or ended.
15. The vehicle of claim 14 , wherein the operations further comprise performing an image recognition process on the sensor data recognize the object based on visual characteristics.
16. The vehicle of claim 14 , wherein:
detecting, based at least in part on the sensor data, that the object has been placed in or removed from the vehicle comprises detecting, based at least in part on the sensor data, that the object has been placed in the vehicle; and
determining that the first transportation service has started or ended comprises, in response to detecting that the object has been placed in the vehicle, determining that the first transportation service has started.
17. The vehicle of claim 14 , wherein:
detecting, based at least in part on the sensor data, that the object has been placed in or removed from the vehicle comprises detecting, based at least in part on the sensor data, that the object has been removed from the vehicle; and
determining that the first transportation service has started or ended comprises, in response to detecting that the object has been removed from the vehicle, determining that the first transportation service has ended.
18. The vehicle of claim 14 , wherein the first transportation service is a delivery service and the object is an item to be delivered.
19. The vehicle of claim 14 , wherein the first transportation service is a passenger transportation service for a human passenger and the object is associated with the human passenger.
20. The vehicle of claim 14 , wherein the vehicle comprises an autonomous vehicle.
21. The vehicle of claim 14 , wherein the one or more sensors comprise one or more cameras.
22. The vehicle of claim 14 , wherein the one or more sensors comprise one or more weighing devices.
23. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of an on-board computing system of a vehicle, cause the on-board computing system to perform operations including:
receiving, by the on-board computing system, data that describes a first transportation service to be provided by the vehicle for a user;
receiving, by the on-board computing system, sensor data collected by one or more sensors physically located on or within the vehicle;
detecting, by the on-board computing system and based at least in part on the sensor data, that an object has been placed in or removed from the vehicle; and
in response to detecting that the object has been placed in or removed from the vehicle;
determining, by the on-board computing system, that the first transportation service has started or ended; and
providing, by the on-board computing system, data to the user indicating that the first transportation service has started or ended.