IP Library › Granted Patent US 12,211,237
Granted Patent B2
US 12,211,237 · App. 17/250,035 · Granted Jan 28, 2025

Correlation of thermal satellite image data for generating thermal maps at high spatial resolution

Inventor: Max Gulde (Freiburg, DE)
Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
G06T7/97G01J5/00G06T3/4053G06T5/50G01J2005/0077G06T2207/10032G06T2207/10048G06T2207/20212G06T2207/30181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,237
App. No.
17/250,035
Granted
Jan 28, 2025
Kind
B2
Abstract

The invention relates to a method and a device for producing a thermal map of an area, wherein the thermal map is generated by a combination of two thermal images of different properties, and both thermal images comprise pixels associated with the area and have been recorded by satellites. The two thermal images are recorded at different times using different recording devices. Furthermore, a radiometric precision of the first thermal image is higher than that of the second thermal image, and a spatial resolution of the second thermal image is higher than that of the first thermal image. The two thermal images are used to determine a measurement value offset of a first pixel group belonging to the second thermal image and spatially associated with the area, and then corrected absolute measurement values of the pixels belonging to the second thermal image and spatially associated with the area are determined. A precise thermal map of the area is then created on this basis. The invention also relates to a method for determining a time series of thermal maps and a computer programme product for carrying out the method described.

Claims (50)

1. A method for determining a heat map of a territory, the method comprising:

receiving a first thermal image of a first landscape including the territory, wherein the first thermal image is recorded by a recording device included on a first satellite, wherein the first thermal image comprises multiple pixels that are spatially associated with the territory, and wherein the recording device included on the first satellite, pixel by pixel, assigns and includes on the first thermal image, a respective first measured value to the territory;

receiving a second thermal image of a second landscape including the territory, wherein the second thermal image is recorded by a recording device included on a second satellite, wherein the second thermal image comprises multiple pixels that are spatially associated with the territory, and wherein the recording device included on the second satellite, pixel by pixel, in each case assigns and includes on the second thermal image, a second measured value to the territory,

wherein a temporal offset exists between a time at which the first thermal image is recorded and a time at which the second thermal image is recorded, wherein the temporal offset is below an established limit, wherein a radiometric precision of the first thermal image is higher than a radiometric precision of the second thermal image, and wherein a spatial resolution of the second thermal image is higher than a spatial resolution of the first thermal image;

determining, for a first pixel group of the second thermal image, the first pixel group being spatially associated with the territory, and the first pixel group comprising multiple pixels, a measured value offset of the first pixel group using a comparison of relative measured values of at least two pixels of the multiple pixels of the first pixel group of the second thermal image to the first measured value of the at least one pixel of the first thermal image which is at least partially spatially associated with the first pixel group of the second thermal image;

determining a corrected absolute measured value of the pixels of the first pixel group which are associated with the territory, wherein the corrected absolute measured value is based on a second measured value of the at least two pixels of the multiple pixels of the first pixel group and the measured value offset, and

creating a precise heat map of the territory based on the corrected absolute measured value of the pixels of the first pixel group which are associated with the territory.

2. The method according to claim 1 , further comprising:

determining the measured value offset of the first pixel group of the second thermal image using a comparison of relative measured values of at least one pixel of the first pixel group of the second thermal image to the first measured value of the at least one pixel of the first thermal image which is spatially associated with the first pixel group of the second thermal image.

3. The method according to claim 1 , further comprising:

determining a land surface temperature of the territory based on the precise heat map and at least one of a land surface model or an emission model.

4. The method according to claim 1 , wherein at least one of the first thermal image or the second thermal image is an infrared image.

5. The method according to claim 1 , wherein the spatial resolution of the second thermal image is at least one of: one order of magnitude higher or two orders of magnitude higher than the spatial resolution of the first thermal image.

6. The method according to claim 1 , wherein the first measured value and the second measured value are temperature values, wherein a radiometric deviation of the first thermal image per pixel is less than 2 K, and wherein a radiometric deviation of the second thermal image is, on average, greater than 2 K.

7. The method according to claim 1 , wherein the recording device included on the first satellite is calibrated so as to increase radiometric precision of the recording device included on the first satellite.

8. The method according to claim 1 , wherein the first thermal image is recorded by the recording device included on at least one of a geostationary satellite in a high Earth orbit or a non-geostationary satellite in a low Earth orbit.

9. The method according to claim 1 , wherein the second thermal image is recorded by the recording device included on a satellite smaller in size than the satellite on which the recording device that records the first thermal image is included.

10. The method according to claim 1 , further comprising:

determining a first heat map of the territory at a first point in time using a first received thermal image and a second received thermal image;

determining a second heat map of the territory at a second point in time using a third received thermal image and a fourth received thermal image; and

creating a time series of a temperature of the territory based on the first and second heat maps.

11. The method according to claim 10 , wherein the first and second points in time are within an established time period, wherein the first thermal image and third thermal image each have a higher radiometric precision than at least one of the second thermal image or the fourth thermal image, wherein the first thermal image and the third thermal image are each recorded by a recording device included on a first satellite platform, wherein the second thermal image has a higher spatial resolution than at least one of the first thermal image or the third thermal image and recorded by a recording device included on a second satellite, wherein the fourth thermal image has a higher spatial resolution than at least one of the first thermal image or the third thermal image and is recorded by a recording device included on a third satellite, and wherein the second satellite and the third satellite are each smaller than the first satellite platform.

12. The method according to claim 10 , further comprising:

determining multiple additional heat maps of the territory at additional points in time, wherein two consecutive points in time of the additional points in time are in each case within an established time period; and

creating a time series of a temperature of the territory based on the first heat map, the second heat map, and the additional heat maps.

13. A device for creating a heat map of a territory, comprising:

at least one receiving unit configured to:

receive a first thermal image of a first landscape including the territory, recorded by a recording device included on a first satellite, wherein the first thermal image comprises multiple pixels that are spatially associated with the territory, and wherein the recording device included on the first satellite, pixel by pixel, assigns and includes on the first thermal image, a respective first measured value to the territory; and

receive a second thermal image of a second landscape including the territory, recorded by a recording device of a second satellite, wherein the second thermal image comprises multiple pixels that are spatially associated with the territory, and the recording device included on the second satellite, pixel by pixel, assigns and includes on the second thermal image, a second measured value to the territory, wherein a temporal offset exists between a time at which the first thermal image is recorded and a time at which the second thermal image is recorded, the temporal offset being below an established limit, wherein a radiometric precision of the first thermal image is higher than a radiometric precision of the second thermal image, and wherein and a spatial resolution of the second thermal image is higher than a spatial resolution of the first thermal image; and

a determination unit configured to:

determine, for a first pixel group of the second thermal image, the first pixel group being spatially associated with the territory, the first pixel group comprising multiple pixels, a measured value offset of the first pixel group using a comparison of relative measured values of at least two pixels of the multiple pixels of the first pixel group to the first measured value of the at least one pixel of the first thermal image, which is at least partially spatially associated with the first pixel group of the second thermal image;

determine corrected absolute measured values of the pixels of the first pixel group, based on a second measured value of the at least two pixels of the multiple pixels of the first pixel group and the measured value offset; and

create the heat map of the territory based on the corrected absolute measured values.

14. The device according to claim 13 , wherein the determination unit is further configured to:

determine a land surface temperature of the territory based on the heat map and at least one of a land surface model or an emission model.

15. The device according to claim 13 , wherein at least one of the first thermal image or the second thermal image is an infrared image.

16. The device according to claim 13 , wherein the spatial resolution of the second thermal image is at least one of one order of magnitude higher or two orders of magnitude higher than the spatial resolution of the first thermal image.

17. The device according to claim 13 , wherein the first measured value and the second measured value are temperature values.

18. The device according to claim 13 , wherein the recording device included on the first satellite is calibrated to increase radiometric precision of the recording device included on the first satellite, wherein a radiometric deviation of the first thermal image per pixel is less than 2 K, and wherein a radiometric deviation of the second thermal image is, on average, greater than 2 K.

19. A device for creating a heat map of a territory, the device comprising:

at least one receiving unit configured to:

receive a first thermal image of a first landscape including the territory recorded by a recording device included on a first satellite, wherein the first thermal image comprises multiple pixels that are spatially associated with the territory and wherein the recording device included on the first satellite, pixel by pixel, assigns and includes on the first thermal image, a respective first measured value of the territory; and

receive a second thermal image of a second landscape including the territory, recorded by a recording device of a second satellite, wherein the second thermal image comprises multiple pixels that are spatially associated with the territory, and the recording device included on the second satellite, pixel by pixel, assigns and includes on the second thermal image, a second measured value to the territory, wherein a temporal offset exists between a time at which the first thermal image is recorded, the temporal offset being below an established limit, where a radiometric precision of the first thermal image is higher than a radiometric precision of the second thermal image, and wherein a spatial resolution of the second thermal image is higher than a spatial resolution of the first thermal image; and

a determination unit configured to:

determine, for a first pixel group of the second thermal image, the first pixel group being spatially associated with the territory, the first pixel group comprising multiple pixels, a measured value offset of the first pixel group using a comparison of relative measured values of at least two pixels of the multiple pixels of the first pixel group to the first measured value of the at least one pixel of the first thermal image, which is at least partially spatially associated with the first pixel group of the second thermal image;

determine corrected absolute measured values of the pixels of the first pixel group, based on a second measured value of the at least two pixels of the multiple pixels of the first pixel group and the measured value offset;

create the heat map of the territory based on the corrected absolute measured values; and

determine a land surface temperature of the territory based on the heat map and at least one of a land surface model or an emission model;

wherein at least one of the first thermal image or the second thermal image is an infrared image, and wherein the spatial resolution of the second thermal image is at least one of: one order of magnitude higher or two orders of magnitude higher than the spatial resolution of the first thermal image.

20. The device according to claim 19 , wherein the recording device included on the first satellite is calibrated to increase radiometric precision of the recording device included on the first satellite, wherein a radiometric deviation of the first thermal image per pixel is less than 2 K, and wherein a radiometric deviation of the second thermal image is, on average, greater than 2 K.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2024
From: GULDE, MAX
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 068234/0327 →
Priority Claims (1)
DE 10 2018 207 265 U · May 9, 2018 · national
Continuity (1)
Related Publication 20210319590A1 · Oct 14, 2021
References Cited (26)
US 7194107B2 · Turner et al. · 2007 [cited by applicant]
US 20030152292A1 · Scott et al. · 2003 [cited by applicant]
US 20130250104A1 · Williams · 2013 [cited by applicant]
US 20140027576A1 · Boshuizen et al. · 2014 [cited by applicant]
WO 2014012070 · 2014 [cited by applicant]
Bai, Yang, et al. “Advancing of land surface temperature retrieval using extreme learning machine and spatio-temporal adaptive data fusion algorithm.” Remote sensing 7.4 (2015): 4424-4441. (Year: 2015). [cited by examiner]
Weng, Qihao, Peng Fu, and Feng Gao. “Generating daily land surface temperature at Landsat resolution by fusing Landsat and MODIS data.” Remote sensing of environment 145 (2014): 55-67. (Year: 2014). [cited by examiner]
Liu, Kai, et al. “Quantifying spatial-temporal pattern of urban heat island in Beijing: An improved assessment using land surface temperature (LST) time series observations .” IEEE Journal of Selected Topics in Applied … [cited by examiner]
“German Application Serial No. 10 2018 207 265.5, Office Action mailed Apr. 24, 2019”, (Apr. 24, 2019), 10 pgs. [cited by applicant]
“International Application Serial No. PCT/EP2019/061790, International Search Report mailed Aug. 2, 2019”, w/ English Translation, (Aug. 2, 2019), 8 pgs. [cited by applicant]
“International Application Serial No. PCT/EP2019/061790, Written Opinion mailed Aug. 2, 2019”, (Aug. 2, 2019), 7 pgs. [cited by applicant]
Bhaskar, Ranjit, “A Study of techniques to improve the effective resolution of thematic mapper thermal infrared imagery.”, Thesis, Rochester Institute of Technology, (Nov. 1, 1993). [cited by applicant]
Munechika, Curtis K., “Merging panchromatic and multispectral images for enhanced image analysis”, M.S. Degree Thesis, Center for Imaging Science, College of Graphic Arts and Photography, Rochester Institute of Technolo… [cited by applicant]
Pohl, Cle, et al., “Review article multisensor image fusion in remote sensing: concepts, methods and applications”, International journal of remote sensing 19.5, (1998), 823-854. [cited by applicant]
Schlingmeier, David, et al., “Resolution enchancement of thermal infrared images via high-resolution class-map and statistical methods”, Thesis, Rochester Institute of Technology, (May 8, 1997), 234 pgs. [cited by applicant]
Spinhime, James D., et al., “Performance and results from a space borne, uncooled microbolometer array spectral radiometric imager”, 2000 IEEE Aerospace Conference. Proceedings (Cat. No. 00TH8484). vol. 3. IEEE, (Mar. 1… [cited by applicant]
Zhan, Wenfeng, et al., “Sharpening thermal imageries: A generalized theoretical framework from an assimilation perspective”, IEEE Transactions on Geoscience and Remote Sensing 49.2, (2010), 773-789. [cited by applicant]
Zhukov, Boris, et al., “Unmixing-based multisensor multiresolution image fusion”, IEEE Transactions on Geoscience and Remote Sensing 37.3, (1999), 1212-1226. [cited by applicant]
“Indian Application Serial No. 202017048798, Office Action dated Sep. 2, 2022”, (Sep. 2, 2022), 8 pgs. [cited by applicant]
D'Errico, Marco, “Distributed space missions for earth system monitoring”, ISBN 978-1-4614-4540-1.New York; Heidelberg; Dordrecht; London: Springer Science+Business Media, 2013.Part IV, Chapter 12:, (2012), pp. 375-386. [cited by applicant]
Ghassemian, Hassan, “A review of remote sensing image fusion methods”, Information Fusion 32, (2016), 75-89. [cited by applicant]
Gwinner, Klaus, “The High Resolution Stereo Camera (HRSC) of Mars Express and its approach to science analysis and mapping for Mars and its satellites”, Planetary and Space Science 126, (2016), 93-138. [cited by applicant]
Hulley, Glynn C., “Generating consistent land surface temperature and emissivity products between ASTER and MODIS data for earth science research”, IEEE Transactions on Geoscience and Remote Sensing 49.4, (2010), 1304-1… [cited by applicant]
NASA, “Formation Flying: The Afternoon “A-Train” Satellite Constellation.”, National Aeronautics and Space Administration, Goddard Space Flight Center, NASA Facts FS-2003-1-053-GSFC., (Mar. 2003). [cited by applicant]
Zhukov, Boris, “TM LANDSAT thermal image unmixing”, Algorithms for Multispectral and Hyperspectral Imagery II. vol. 3071. International Society for Optics and Photonics, (Aug. 4, 1997). [cited by applicant]
“Japanese Application Serial No. 2020-562185, Office Action dated Feb. 6, 2023”, w English Translation, (Feb. 6, 2023), 4 pgs. [cited by applicant]