IP Library Granted Patent US 11,443,528
Granted Patent B2
US 11,443,528 · App. 17/109,499 · Granted Sep 13, 2022

Classification using multiframe analysis

Inventors: Jesse Daniels (San Diego, CA); Vincent Nguyen (San Diego, CA)
Assignee: Lytx, Inc.
G06V20/584G06N3/02G06T7/254G06V20/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,528
App. No.
17/109,499
Granted
Sep 13, 2022
Kind
B2
Abstract

A system for video analysis includes an interface and a processor. The interface is configured to receive a trigger indication. The processor is configured to determine a time sequence set of video frames associated with the trigger indication; determine a decision based at least in part on an analysis of the time sequence set of video frames; and indicate the decision.

Claims (30)

1. A system for video analysis, comprising:

an interface configured to receive a trigger indication, wherein the trigger indication comprises a door opening signal following an engine running for greater than a cruising period, wherein the cruising period corresponds to 1 or more minutes; and

a processor configured to:

determine a time sequence set of video frames associated with the trigger indication;

determine a decision based at least in part on an analysis of the time sequence set of video frames, wherein the decision comprises a passenger pickup decision; and

indicate the decision.

2. The system as in claim 1 , wherein the analysis of the time sequence set of video frames comprises parallel processing of a plurality of frames of the time sequence set of video frames.

3. The system as in claim 2 , wherein the parallel processing is processed using a neural net.

4. The system as in claim 1 , wherein the analysis of the time sequence set of video frames includes classification of a frame of the time sequence set of video frames.

5. The system as in claim 4 , wherein the classification of the frame is combined with other classifications to determine the decision.

6. The system as in claim 1 , wherein the interface is configured to receive the time sequence set of video frames.

7. The system as in claim 1 , further comprising a data storage device, wherein the data storage device stores the time sequence set of video frames.

8. The system as in claim 1 , wherein the time sequence set of video frames is captured using a video camera mounted to a vehicle.

9. The system as in claim 8 , wherein the vehicle comprises one of the following: a car, a van, a truck, a truck with a trailer, or a delivery truck.

10. The system as in claim 8 , wherein the time sequence set of video frames is transmitted to a server from the vehicle.

11. The system as in claim 10 , wherein the analysis is performed by the server.

12. The system as in claim 1 , wherein the analysis is performed by a computing system in a vehicle.

13. The system as in claim 1 , wherein the trigger indication is received using a vehicle bus signal.

14. The system as in claim 1 , wherein the trigger indication further comprises one or more of the following: a seat weight signal, an audio detection signal, an engine RPM signal, a braking signal, or a vehicle bus signal.

15. The system as in claim 1 , wherein the trigger indication further comprises a signal generated using computer vision or a signal generated using data processing.

16. A method for video analysis, comprising:

receiving a trigger indication, wherein the trigger indication comprises a door opening signal following an engine running for greater than a cruising period, wherein the cruising period corresponds to 1 or more minutes;

determining, using a processor, a time sequence set of video frames associated with the trigger indication;

determining a decision based at least in part on an analysis of the time sequence set of video frames, wherein the decision comprises a passenger pickup decision; and

indicating the decision.

17. A computer program product for video analysis, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving a trigger indication, wherein the trigger indication comprises a door opening signal following an engine running for greater than a cruising period, wherein the cruising period corresponds to 1 or more minutes;

determining, using a processor, a time sequence set of video frames associated with the trigger indication;

determining a decision based at least in part on an analysis of the time sequence set of video frames, wherein the decision comprises a passenger pickup decision; and

indicating the decision.

Assignments (1)
SECURITY INTEREST Recorded Mar 30, 2023
From: LYTX, INC.
To: GUGGENHEIM CREDIT SERVICES, LLC, AS COLLATERAL AGENT
Reel/Frame 063158/0500 →
Continuity (2)
Continuation 16009612 · Jun 15, 2018
Related Publication 20210081686A1 · Mar 18, 2021