IP Library Granted Patent US 7,781,717
Granted Patent B2
US 7,781,717 · App. 12/110,508 · Granted Aug 24, 2010

System and method for manipulating real-time video playback time-synchronized with millimeter wave imagery

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,781,717
App. No.
12/110,508
Granted
Aug 24, 2010
Kind
B2
Abstract

A system and method for manipulating real-time video playback time-synchronized with millimeter wave imagery is disclosed. In a particular embodiment, millimeter wave imagery and visible spectrum video images are combined to form composite images in real-time to detect concealed objects on a person. A graphical user interface (GUI) manipulates the displayed millimeter wave imagery, video images and composite images and controls displaying user selected portions of the synchronized recorded images. The composite images are automatically encoded with event data when a concealed object is detected and an alert is generated, or that information is accessed from a datafile or database structure. The GUI controls the playback and viewing of those composite images having encoded event data.

Claims (32)

1. A method for manipulating real-time video playback time-synchronized with millimeter wave imagery, the method comprising:

receiving input signals from at least one millimeter wave camera to generate real-time millimeter wave imagery;

receiving input signals from at least one video camera to generate real-time visible spectrum video images spatially and temporally relative to the millimeter wave imagery;

synchronizing the millimeter wave imagery with the video images to a substantially identical time base; and

displaying the millimeter wave imagery and video images in real-time.

2. The method of claim 1 further comprising:

combining the millimeter wave imagery and video images to generate real-time composite images of the millimeter wave imagery and video images; and

displaying the composite images in real-time.

3. The method of claim 2 further comprising displaying a graphical user interface (GUI) to manage and manipulate the displayed millimeter wave imagery, video images and composite images.

4. The method of claim 3 further comprising automatically encoding the composite image with event data when a threat is detected, or storing said event data in a datafile or database structure.

5. The method of claim 3 further comprising recording the millimeter wave imagery, video images and composite images to a memory device.

6. The method of claim 5 further comprising accessing the memory device for selectively displaying portions of the recorded millimeter wave imagery, video images and composite images.

7. The method of claim 5 wherein the GUI controls displaying and reviewing user selected portions of the recorded millimeter wave imagery, video images and composite images.

8. The method of claim 4 wherein the threat is a detected explosive object, threat object, contraband object, stolen object or otherwise concealed object.

9. The method of claim 4 further comprising generating an alert when the threat is detected.

10. The method of claim 4 further comprising selectively displaying time frames of millimeter wave imagery, video images and composite images either encoded with data when a threat is detected or having stored the data in a datafile or database structure.

11. A system for manipulating real-time video playback time-synchronized with millimeter wave imagery, the system comprising:

a millimeter wave receiver for receiving input signals received by at least one millimeter wave camera to generate millimeter wave imagery;

a video receiver for receiving input signals received by at least one visible spectrum video camera to generate video images spatially and temporally relative to the millimeter wave imagery;

a synchronization software module for synchronizing the millimeter wave imagery with the video images to a substantially identical time base; and

a means for displaying the millimeter wave imagery and video images in real-time.

12. The system of claim 11 further comprising:

a processing software module for combining the millimeter wave imagery and video images to generate real-time composite images of the millimeter wave imagery and video images; and

displaying the composite images in real-time.

13. The system of claim 12 further comprising a graphical user interface (GUI) to manage and manipulate the displayed millimeter wave imagery, video images and composite images.

14. The system of claim 13 further comprising an encoding software module for automatically encoding the composite image with event data when a threat is detected, or storing the event data in a datafile or database structure.

15. The system of claim 13 further comprising a memory device for recording the millimeter wave imagery, video images and composite images.

16. The system of claim 15 further comprising a control software module for accessing the memory device for selectively displaying and replaying portions of the recorded millimeter wave imagery, video images and composite images.

17. The system of claim 15 wherein the control software module controls displaying user selected portions of the recorded millimeter wave imagery, video images and composite images.

18. The system of claim 14 wherein the threat is a detected explosive object.

19. The system of claim 14 further comprising an alert when the threat is detected.

20. The system of claim 14 wherein the GUI further comprising a plurality of windows for viewing real-time and recorded millimeter wave imagery, video images and composite images.

Assignments (11)
RELEASE OF SECURITY INTEREST Recorded Mar 9, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 059358/0001 →
RELEASE OF SECURITY INTEREST Recorded Feb 25, 2022
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 059333/0222 →
SECURITY INTEREST Recorded Sep 18, 2018
From: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 047103/0206 →
SECURITY INTEREST Recorded Jun 25, 2018
From: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 046426/0001 →
RELEASE OF SECURITY INTEREST Recorded May 29, 2018
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: MICROSEMI CORPORATION; MICROSEMI SEMICONDUCTOR (U.S.), INC.; MICROSEMI FREQUENCY AND TIME CORPORATION; MICROSEMI COMMUNICATIONS, INC.; MICROSEMI SOC CORP.; MICROSEMI CORP. - POWER PRODUCTS GROUP; MICROSEMI CORP. - RF INTEGRATED SOLUTIONS
Reel/Frame 046251/0391 →
PATENT SECURITY AGREEMENT Recorded Feb 3, 2016
From: MICROSEMI CORPORATION; MICROSEMI SEMICONDUCTOR (U.S.) INC. (F/K/A LEGERITY, INC., ZARLINK SEMICONDUCTOR (V.N.) INC., CENTELLAX, INC., AND ZARLINK SEMICONDUCTOR (U.S.) INC.); MICROSEMI FREQUENCY AND TIME CORPORATION (F/K/A SYMMETRICON, INC.); MICROSEMI COMMUNICATIONS, INC. (F/K/A VITESSE SEMICONDUCTOR CORPORATION); MICROSEMI SOC CORP. (F/K/A ACTEL CORPORATION); MICROSEMI CORP. - POWER PRODUCTS GROUP (F/K/A ADVANCED POWER TECHNOLOGY INC.); MICROSEMI CORP. - RF INTEGRATED SOLUTIONS (F/K/A AML COMMUNICATIONS, INC.)
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037691/0697 →
RELEASE OF SECURITY INTEREST Recorded Jan 19, 2016
From: BANK OF AMERICA, N.A.
To: MICROSEMI CORPORATION; MICROSEMI CORP.-ANALOG MIXED SIGNAL GROUP, A DELAWARE CORPORATION; MICROSEMI SOC CORP., A CALIFORNIA CORPORATION; MICROSEMI SEMICONDUCTOR (U.S.) INC., A DELAWARE CORPORATION; MICROSEMI FREQUENCY AND TIME CORPORATION, A DELAWARE CORPORATION; MICROSEMI COMMUNICATIONS, INC. (F/K/A VITESSE SEMICONDUCTOR CORPORATION), A DELAWARE CORPORATION; MICROSEMI CORP.-MEMORY AND STORAGE SOLUTIONS (F/K/A WHITE ELECTRONIC DESIGNS CORPORATION), AN INDIANA CORPORATION
Reel/Frame 037558/0711 →
NOTICE OF SUCCESSION OF AGENCY Recorded Apr 9, 2015
From: ROYAL BANK OF CANADA (AS SUCCESSOR TO MORGAN STANLEY & CO. LLC)
To: BANK OF AMERICA, N.A., AS SUCCESSOR AGENT
Reel/Frame 035657/0223 →
SUPPLEMENTAL PATENT SECURITY AGREEMENT Recorded Nov 11, 2011
From: MICROSEMI CORPORATION; MICROSEMI CORP. - ANALOG MIXED SIGNAL GROUP; MICROSEMI CORP. - MASSACHUSETTS; ACTEL CORPORATION
To: MORGAN STANLEY & CO. LLC
Reel/Frame 027213/0611 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2011
From: BRIJOT IMAGING SYSTEMS, INC.
To: MICROSEMI CORPORATION
Reel/Frame 026691/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2010
From: REINPOLDT, WILLEM H., III
To: BRIJOT IMAGING SYSTEMS, INC.
Reel/Frame 024707/0023 →