Classification using multiframe analysis
A system for video analysis includes an interface and a processor. The interface is configured to receive a trigger indication. The processor is configured to determine a time sequence set of video frames associated with the trigger indication; determine a decision based at least in part on an analysis of the time sequence set of video frames; and indicate the decision.
1. A system for video analysis, comprising:
an interface configured to receive a trigger indication, wherein the trigger indication comprises a bin lift signal being detected on a truck;
a processor configured to:
determine a time sequence set of video frames associated with the trigger indication;
determine a decision based at least in part on an analysis of the time sequence set of video frames, comprising to:
process the time sequence set of video frames in parallel;
combine the results of the processing of the time sequence set of video frames; and
determine the decision regarding the activity depicted in the time sequence set of video frames, wherein the decision includes a determination of whether the time sequence set of video frames includes a bin that is overflowing prior to being emptied; and
indicate the decision.
2. The system as in claim 1 , wherein the analysis of the time sequence set of video frames comprises parallel processing of a plurality of frames of the time sequence set of video frames.
3. The system as in claim 2 , wherein the parallel processing output is processed using a neural net.
4. The system as in claim 1 , wherein the analysis of the time sequence set of video frames includes classification of each frame of the time sequence set of video frames.
5. The system as in claim 4 , wherein the classification of each frame is combined with other classifications to determine the decision.
6. The system as in claim 1 , wherein the interface is configured to receive the time sequence set of video frames.
7. The system as in claim 1 , further comprising a data storage device, wherein the data storage device stores the time sequence set of video frames.
8. The system as in claim 1 , wherein the time sequence set of video frames is captured using a video camera mounted to a vehicle.
9. The system as in claim 8 , wherein the time sequence set of video frames is transmitted to a server from the vehicle.
10. The system as in claim 9 , wherein the analysis is performed by the server.
11. The system as in claim 1 , wherein the analysis is performed by a computing system in a vehicle.
12. The system as in claim 1 , wherein the trigger indication is received using a vehicle bus signal.
13. The system as in claim 1 , wherein the decision comprises a bin overflow decision.
14. The system as in claim 1 , wherein the trigger indication comprises a door opening signal following an engine running for greater than a cruising period.
15. The system as in claim 1 , wherein the decision comprises a passenger pickup decision.
16. The system as in claim 1 , wherein the trigger indication comprises a signal generated using computer vision or a signal generated using data processing.
17. The method for video analysis, comprising:
receiving a trigger indication, wherein the trigger indication comprises a bin lift signal being detected on a truck;
determining, using a processor, a time sequence set of video frames associated with the trigger indication;
determining a decision based at least in part on an analysis of the time sequence set of video frames, comprising:
processing the time sequence set of video frames in parallel;
combining the results of the processing of the time sequence set of video frames; and
determining the decision regarding the activity depicted in the time sequence set of video frames, wherein the decision includes a determination of whether the time sequence set of video frames includes a bin that is overflowing prior to being emptied; and
indicating the decision.
18. A non-transitory computer program product for video analysis, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
receiving a trigger indication, wherein the trigger indication comprises a bin lift signal being detected on a truck;
determining, using a processor, a time sequence set of video frames associated with the trigger indication;
determining a decision based at least in part on an analysis of the time sequence set of video frames, comprising:
processing the time sequence set of video frames in parallel;
combining the results of the processing of the time sequence set of video frames; and
determining the decision regarding the activity depicted in the time sequence set of video frames, wherein the decision includes a determination of whether the time sequence set of video frames includes a bin that is overflowing prior to being emptied; and
indicating the decision.