IP Library Granted Patent US 10,701,289
Granted Patent B2
US 10,701,289 · App. 16/109,555 · Granted Jun 30, 2020

Method and system for providing scene data in a video stream

Inventors: David C. Hutchison (Plano, TX); Ralph K. Williamson (Plano, TX)
Assignee: DRS Network & Imaging Systems, LLC
H04N5/33G01J5/025G01J5/0806G01J5/10G06T3/40G06T5/001G06T5/007H04N19/46H04N21/23439H04N21/23605H04N21/23614H04N21/4348G01J2005/0077G01J2005/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,701,289
App. No.
16/109,555
Granted
Jun 30, 2020
Kind
B2
Abstract

Methods of and systems for providing temperature data in a video stream are provided. The method includes receiving a video stream having a plurality of video frames with a first frame rate and receiving temperature data including a temperature map associated with the video stream and having a plurality of temperature frames with a second frame rate, which can be slower than the first frame rate. To interlace the temperature data, a subset of temperature frames in the plurality of temperature frames can be extracted. The method further includes transmitting each temperature frame in the subset of temperature frames with the plurality of video frames in a data stream.

Claims (48)

1. A method of de-interlacing a data stream, the method comprising:

receiving an interlaced data stream comprising a plurality of video frames at a first frame rate and a plurality of reduced data frames at a second frame rate, wherein each of the plurality of reduced data frames comprises a subset of data lines;

separating the plurality of video frames from the plurality of reduced data frames;

for each reduced data frame in the plurality of reduced data frames:

identifying one or more missing data lines associated with the subset of data lines,

correlating the plurality of reduced data frames with the plurality of video frames,

generating the one or more missing data lines based on the correlation of the plurality of reduced data frames with the plurality of video frames, and

creating a reconstructed data frame including the one or more missing data lines and the subset of data lines of the reduced data frame;

generating a plurality of reconstructed data frames using the reconstructed data frame created for each reduced data frame; and

transmitting the plurality of reconstructed data frames.

2. The method of claim 1 , further comprising transmitting the plurality of reconstructed data frames with the plurality of video frames to an external display.

3. The method of claim 1 , wherein the plurality of reconstructed data frames have a frame rate that is equal to the first frame rate.

4. The method of claim 3 , wherein the second frame rate is lower than the first frame rate.

5. The method of claim 3 , wherein the first frame rate ranges from 9 Hz to 30 Hz and the second frame rate ranges from 1 Hz to 120 Hz.

6. The method of claim 1 , wherein the interlaced data stream includes a plurality of packets, each packet including one reduced data frame of the plurality of reduced data frames and a subset of video frames of the plurality of video frames.

7. A method of de-interlacing an interlaced data stream, the method comprising:

receiving an interlaced data stream comprising a plurality of video frames at a first frame rate and a plurality of reduced data frames at a second frame rate, wherein each reduced data frame comprises a subset of data lines;

separating the plurality of video frames from the plurality of reduced data frames;

for each reduced data frame in the plurality of reduced data frames:

identifying one or more missing data lines associated with the subset of data lines;

correlating the plurality of reduced data frames with the plurality of video frames;

responsive to determining that the correlation is lower than a threshold, generating the one or more missing data lines by interpolating between two or more data lines in the subset of data lines of the reduced data frame;

responsive to determining that the correlation is greater than the threshold, generating the one or more missing data lines by extracting lines from the subset of data lines of a predetermined number of recent reduced data frames; and

creating a reconstructed data frame including the one or more missing data lines and the subset of data lines of the reduced data frame;

generating a plurality of reconstructed data frames using the reconstructed data frame created for each reduced data frame; and

transmitting the plurality of reconstructed data frames.

8. The method of claim 7 , further comprising transmitting the plurality of reconstructed data frames with the plurality of video frames to an external display.

9. The method of claim 7 , wherein the interlaced data stream includes the plurality of video frames at a first frame rate and the plurality of reduced data frames at a second frame rate.

10. The method of claim 9 , wherein the second frame rate is lower than the first frame rate.

11. The method of claim 10 , wherein the first frame rate ranges from 9 Hz to 30 Hz and the second frame rate ranges from 1 Hz to 120 Hz.

12. The method of claim 11 , wherein the predetermined number of recent reduced data frames represents a ratio of video frames to reduced data frames in the interlaced data stream.

13. The method of claim 9 , wherein the interlaced data stream includes a plurality of packets, each packet including one reduced data frame in the plurality of reduced data frames and a subset of video frames in the plurality of video frames.

14. The method of claim 9 , wherein the plurality of reconstructed data frames have a frame rate that is equal first frame rate.

15. A system for de-interlacing a video stream, the system comprising:

a receiver configured to receive a data stream and separate a plurality of video frames from a plurality of reduced thermal data frames, wherein each reduced data frame comprises a subset of thermal data lines;

a frame reconstruction module configured to:

for each reduced thermal data frame in the plurality of reduced thermal data frames:

identify one or more missing data lines in the subset of thermal data lines,

correlate the plurality of reduced thermal data frames with the plurality of video frames,

generate the one or more missing data lines based on the correlation of the plurality of reduced thermal data frames with the plurality of video frames, and

create a reconstructed thermal data frame including the one or more missing data lines and the subset of thermal data lines of the reduced thermal data frame; and

generate a plurality of reconstructed thermal data frames using the reconstructed thermal data frame created for each reduced thermal data frame; and

a second transmitter configured to transmit the plurality of reconstructed thermal data frames.

16. The system of claim 15 , wherein the second transmitter is operable to transmit, to an external display, the plurality of reconstructed thermal data frames with the plurality of video frames.

17. The system of claim 15 , wherein the data stream includes the plurality of video frames at a first frame rate and the plurality of reduced thermal data frames at a second frame rate.

18. The system of claim 17 , wherein a second frame rate is lower than the first frame rate.

19. The system of claim 15 , wherein the data stream includes a plurality of packets, each packet including one reduced thermal data frame in the plurality of reduced thermal data frames and a subset of video frames in the plurality of video frames.

20. The system of claim 15 , wherein the plurality of reconstructed thermal data frames have a frame rate that is equal to a first frame rate of the plurality of video frames.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2018
From: HUTCHISON, DAVID C.; WILLIAMSON, RALPH K.
To: DRS RSTA, INC.
Reel/Frame 047097/0474 →
CHANGE OF NAME Recorded Oct 8, 2018
From: DRS RSTA, INC.
To: DRS NETWORK & IMAGING SYSTEMS, LLC
Reel/Frame 047206/0050 →
Continuity (5)
Continuation 15462432 · Mar 17, 2017
Continuation 14206341 · Mar 12, 2014
Provisional Application 61786077 · Mar 14, 2013
Provisional Application 61785856 · Mar 14, 2013
Related Publication 20190014272A1 · Jan 10, 2019