IP Library Granted Patent US 8,692,885
Granted Patent B2
US 8,692,885 · App. 11/662,841 · Granted Apr 8, 2014

Method and apparatus for capture and distribution of broadband data

Inventors: Mark Alan Sartor (Princeton Junction, NJ); Philip Wayne Miller (Yardley, PA); Arthur Robert Pope (Vienna, VA); Peter L. Demers (Hopewell, NJ); Nikhil Gagvani (Sterling, VA); Vincent Paragano (Yardley, PA); Daniel Clement Williams (Elkins Park, PA)
Assignee: SRI International
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,692,885
App. No.
11/662,841
Granted
Apr 8, 2014
Kind
B2
Abstract

A system and method for preparing for distribution to, distributing to and/or use by one or more devices broadband data associated with intelligence information garnered from an aerial vehicle (“AV”): The method may include obtaining from sensors coupled to the AV video depicting an area of surveillance, obtaining metadata associated with the video, aligning, temporally, the video and metadata, using reference information to align, spatially, the video and metadata, forming for distribution to the at least one device enhanced metadata as a function of the video, metadata and reference information, wherein the enhanced metadata is operable to enable displaying at the devices at least a portion of the video, whereby after receiving a distribution of the enhanced metadata, the devices are operable to display such portion of the video.

Claims (36)

1. A method for distributing, to at least one remote device, broadband data associated with information garnered from at least one sensor, the method comprising:

aligning, temporally, video and metadata from the at least one sensor;

using the aligned metadata, spatially aligning at least a portion of the video from the at least one sensor with one or more reference images;

forming and distributing to the at least one remote device, enhanced metadata comprising a set of video processing and display parameters for the spatially aligned video and tracking parameters for performing object tracking, to enable generating and displaying, at the at least one remote device, at least a portion of the video in an enhanced manner in accordance with said alignment;

modifying, responsive to feedback, any of the enhanced metadata and the video so as to produce corresponding modified enhanced metadata and modified video, wherein the feedback is received from the at least one remote device; and

transmitting to the at least one remote device any of the modified enhanced metadata and modified video, whereby the least one remote device displays any of (i) the at least a portion of the modified video in accordance with the modified enhanced metadata, and (ii) the modified enhanced metadata.

2. The method of claim 1 , wherein the enhanced metadata further enables displaying, at the at least one remote device, at least a portion of the enhanced metadata.

3. The method of claim 1 , wherein at least a portion of each of the video and metadata from the at least one sensor is tagged with a given time, and wherein aligning, temporally, comprises aligning the portions of the video and metadata tagged with the given time.

4. The method of claim 1 , wherein the video and metadata from the at least one sensor are in a streaming format.

5. The method of claim 1 , further comprising transforming the video and metadata from the at least one sensor for storage in accordance with a capability of the at least one remote device.

6. The method of claim 1 , wherein any of aligning temporally, aligning spatially, forming enhanced metadata, and distributing to the at least one remote device the enhanced metadata is performed in any of real time, near real time, and/or substantially continuously with creation of the video and metadata from the at least one sensor.

7. The method of claim 1 , wherein aligning temporally comprises performing any of synchronization, refining, filtering, noise reduction and interpolation of the video and metadata from the at least one sensor.

8. The method of claim 1 , wherein generating and displaying at the at least one remote device at least a portion of the video in an enhanced manner further comprises performing any of stabilization and mosaicking to the at least a portion of the video.

9. The method of claim 1 , wherein the enhanced metadata is formatted in accordance with a thin-file format.

10. The method of claim 1 , further comprising distributing the modified video to the at least one remote device.

11. The method of claim 1 , wherein the feedback comprises manual georegistration of the data from the at least one sensor with geo-information.

12. The method of claim 1 , further comprising using the spatially aligned video, the metadata and the enhanced metadata to detect objects moving within an area of surveillance, wherein the at least one remote device includes a graphical user interface for displaying any of the spatially aligned video, the enhanced metadata, and the moving objects.

13. A method for using broadband data associated with intelligence information garnered from at least one sensor and for distributing the broadband data to at least one remote device, the method comprising:

aligning, temporally, video and metadata from the at least one sensor;

using the aligned metadata, spatially aligning at least a portion of the video from the at least one sensor with one or more reference images;

forming and distributing to the at least one remote device, enhanced metadata comprising a set of video processing and display parameters for the spatially aligned video and tracking parameters for performing object tracking;

distributing to the at least one remote device the enhanced metadata, to enable generating and displaying at the at least one remote device the at least a portion of the spatially aligned video in accordance with the alignment; and

modifying, responsive to feedback, any of the enhanced metadata and the video so as to produce corresponding modified enhanced metadata and modified video, wherein the feedback is received from the at least one remote device; and

transmitting to the at least one remote device any of the modified enhanced metadata and modified video, whereby the at least one remote device displays any of (i) the at least a portion of the modified video in accordance with the modified enhanced metadata, and (ii) the modified enhanced metadata.

14. The method of claim 13 , wherein any of aligning temporally, aligning spatially, forming enhanced metadata, associating the enhanced metadata and video, and distributing to the at least one remote device the enhanced metadata is performed in any of real time, near real time, and/or substantially continuous with creation of the video and metadata from the at least one sensor.

15. A system for distributing, to at least one remote device, broadband data associated with intelligence information garnered from at least one sensor, the system comprising:

memory for storing executable instructions; and

logic for obtaining from the memory the executable instructions and for causing the executable instructions to:

align, temporally, video and metadata from the at least one sensor;

using the aligned metadata to spatially align at least a portion of the video from the at least one sensor with one or more reference images;

form and distribute to the at least one remote device, enhanced metadata comprising a set of video processing and display parameters for the spatially aligned video and tracking parameters for performing object tracking;

distribute to the at least one remote device the enhanced metadata, whereby after receiving the enhanced metadata, the at least one remote device generates and displays the at least a portion of the video in an enhanced manner in accordance with the alignment;

modify, responsive to feedback, any of the enhanced metadata and the video so as to produce corresponding modified enhanced metadata and modified video, wherein the feedback is received from the at least one remote device; and

transmit to the at least one remote device any of the modified enhanced metadata and modified video, whereby the least one remote device displays any of (i) the at least a portion of the modified video in accordance with the modified enhanced metadata, and (ii) the modified enhanced metadata.

16. The system of claim 15 , wherein the enhanced metadata further enables displaying at the at least one remote device at least a portion of the enhanced metadata, and wherein after receiving the enhanced metadata, the at least one remote device displays the at least a portion of the enhanced metadata.

17. The system of claim 15 , wherein the logic executes any of the executable instructions to align temporally, align spatially, form enhanced metadata, distribute to the at least one remote device the enhanced metadata in any of real time, near real time, and/or substantially continuously with creation of the video and metadata.

Assignments (2)
MERGER Recorded Sep 21, 2011
From: SARNOFF CORPORATION
To: SRI INTERNATIONAL
Reel/Frame 026939/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2007
From: SARTOR, MARK; MILLER, PHILIP WAYNE; POPE, ARTHUR ROBERT; DEMERS, PETER L.; GAGVANI, NIKHIL; PARAGANO, VINCENT; WILLIAMS, DANIEL CLEMENT
To: SARNOFF CORPORATION
Reel/Frame 020278/0280 →
Continuity (3)
Provisional Application 60654700 · Feb 18, 2005
Provisional Application 60665461 · Mar 25, 2005
Related Publication 20090012995A1 · Jan 8, 2009