IP Library Granted Patent US 9,864,923
Granted Patent B2
US 9,864,923 · App. 15/187,347 · Granted Jan 9, 2018

Assisted surveillance of vehicles-of-interest

Inventors: Michael T. Chan (Bedford, MA); Jason R. Thornton (Chelmsford, MA); Aaron Z. Yahr (Somerville, MA); Heather Zwahlen (Arlington, MA)
Assignee: Massachusetts Institute of Technology
G06K9/4609G06K9/00536G06K9/00771G06K9/00785G06K9/4652G06K2209/23G08G1/015
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,864,923
App. No.
15/187,347
Granted
Jan 9, 2018
Kind
B2
Abstract

A computer-implemented image processing method includes accessing image data representing a plurality of images of a plurality of vehicles and reading a data model representing a predefined vehicle attribute. The method further includes processing a portion of the image data to detect a vehicle feature of at least one of the vehicles represented in at least one of the images based on the predefined vehicle attribute, and processing the portion of the image data to generate vehicle data representing the detected vehicle feature.

Claims (44)

1. A computer-implemented image processing method, the computer including a processor and a memory operatively coupled to the processor, the method performed by the processor comprising:

accessing image data representing a plurality of images of a plurality of vehicles;

accessing a discriminative type-specific vehicle model calculated from training data representing a predefined vehicle attribute;

processing, using the discriminative type-specific vehicle model, a portion of the image data to automatically detect a vehicle feature of a vehicle of interest from the plurality of vehicles represented in two or more images of the plurality of images based on the predefined vehicle attribute;

processing the portion of the image data to automatically generate vehicle data representing the detected vehicle feature; and

reconstructing a path traveled by the vehicle of interest using the vehicle data.

2. The computer-implemented method of claim 1 , wherein the discriminative type-specific vehicle model is a part-based mixture model calculated from training data representing the predefined vehicle attribute and where the vehicle feature is detected in the portion of the image data using the part-based mixture model.

3. The computer-implemented method of claim 2 , wherein the part-based mixture model is learned using a latent support vector machine.

4. The computer-implemented method of claim 1 , further comprising processing the image data representing the detected vehicle feature to generate a characterization of the vehicle of interest based at least in part on the discriminative type-specific vehicle model.

5. The computer-implemented method of claim 4 , wherein the characterization of the vehicle of interest includes at least one of a predefined vehicle type and a predefined vehicle color.

6. The computer-implemented method of claim 1 , further comprising:

receiving a search query from a user;

processing the vehicle data to search for the vehicle of interest in the plurality of images corresponding to the search query; and

displaying, using a graphical user interface operatively coupled to the processor, a composite view depicting recorded activities of the vehicle of interest across multiple camera views.

7. The computer-implemented method of claim 1 , further comprising exporting a composite image depicting recorded activities of the vehicle of interest across multiple camera views.

8. An image processing system comprising:

a processor; and

a memory operatively coupled to the processor, the memory having stored therein instructions that when executed by the processor cause the processor to:

access image data representing a plurality of images of a plurality of vehicles;

access a discriminative type-specific vehicle model calculated from training data representing a predefined vehicle attribute;

process, using the discriminative type-specific vehicle model, a portion of the image data to automatically detect a vehicle feature of a vehicle of interest from the plurality of vehicles represented in two or more images of the plurality of images based on the predefined vehicle attribute;

process the portion of the image data to automatically generate vehicle data representing the detected vehicle feature; and

reconstruct a path traveled by the vehicle of interest using the vehicle data.

9. The system of claim 8 , wherein the memory has further stored therein instructions that when executed by the processor cause the processor to:

receive a search query from a user;

process the vehicle data to search for the vehicle of interest in the plurality of images corresponding to the search query; and

display, using a graphical user interface operatively coupled to the processor, a composite view depicting recorded activities of the vehicle of interest across multiple camera views.

10. The system of claim 8 , wherein the memory has further stored therein instructions that when executed by the processor cause the processor to export a composite image depicting recorded activities of the vehicle of interest across multiple camera views.

11. The system of claim 8 , wherein the memory has further stored therein instructions that when executed by the processor cause the processor to process the image data representing the detected vehicle feature to generate a characterization of the vehicle of interest based at least in part on the discriminative type-specific vehicle model.

12. A computer-implemented image processing method, the computer including a processor and a memory operatively coupled to the processor, the method performed by the processor comprising:

accessing image data representing a plurality of images of a plurality of vehicles;

accessing a discriminative type-specific vehicle model calculated from training data representing a predefined vehicle attribute;

processing, using the discriminative type-specific vehicle model, a portion of the image data to automatically detect a vehicle feature of a vehicle of interest from the plurality of vehicles represented in two or more images of the plurality of images based on the predefined vehicle attribute;

processing the portion of the image data to automatically generate vehicle data representing the detected vehicle feature; and

determining a direction of motion of the vehicle of interest using the vehicle data.

13. The computer-implemented method of claim 12 , further comprising exporting a composite image depicting recorded activities of the vehicle of interest across multiple camera views.

14. The computer-implemented method of claim 12 , wherein the discriminative type-specific vehicle model is a part-based mixture model calculated from training data representing the predefined vehicle attribute and where the vehicle feature is detected in the portion of the image data using the part-based mixture model.

15. The computer-implemented method of claim 14 , wherein the part-based mixture model is learned using a latent support vector machine.

16. The computer-implemented method of claim 12 , further comprising processing the image data representing the detected vehicle feature to generate a characterization of the vehicle of interest based at least in part on the discriminative type-specific vehicle model.

17. The computer-implemented method of claim 16 , wherein the characterization of the vehicle includes at least one of a predefined vehicle type and a predefined vehicle color.

18. The computer-implemented method of claim 12 , further comprising:

receiving a search query from a user;

processing the vehicle data to search for a vehicle of interest in the plurality of images corresponding to the search query; and

displaying, using a graphical user interface operatively coupled to the processor, a composite view depicting recorded activities of the vehicle of interest across multiple camera views.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2017
From: CHAN, MICHAEL T.; THORNTON, JASON R.; YAHR, AARON Z.; ZWAHLEN, HEATHER
To: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Reel/Frame 040870/0408 →
Continuity (3)
Continuation 13800186 · Mar 13, 2013
Provisional Application 61610454 · Mar 13, 2012
Related Publication 20160321519A1 · Nov 3, 2016