IP Library Granted Patent US 12,607,771
Granted Patent B2
US 12,607,771 · App. 18/200,050 · Granted Apr 21, 2026

Dynamically forecasting high resolution air temperature in real-time using multiple sources

Inventors: Ismail Yunus Akhalwaya (Johannesburg, ZA); Etienne Eben Vos (Johannesburg, ZA); Sibusisiwe Audrey Makhanya (Pretoria, ZA); Tamara Rosemary Govindasamy (Cape Town, ZA); Zubeida Patel (Cape Town, ZA); Dedricks Monyai Morake (Pretoria, ZA); Craig Mahlasi (Johannesburg, ZA); Muaaz Bhamjee (Johannesburg, ZA)
Assignee: International Business Machines Corporation
G01W1/10G06T3/4046G06T11/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,607,771
App. No.
18/200,050
Granted
Apr 21, 2026
Kind
B2
Abstract

Techniques for dynamically forecasting high spatial resolution air temperature in real-time using a multiplicity of data sources and advanced machine learning models are provided. In one aspect, a system for generating air temperature forecasts includes: a spatial downscaling module for providing air temperature data from a multiplicity of sources as input to a generative adversarial network, conditioning the input to the generative adversarial network on at least one conditioning variable, and generating high resolution air temperature maps; and a temporal forecasting module for providing the high resolution air temperature maps along with real-time air temperature data from a sensor network as input to a physics-informed neural network with extended Kalman filter, and generating high temporal and spatial resolution air temperature forecasts. A method for generating air temperature forecasts using the present system is also provided.

Claims (47)

1 . A computer system comprising:

a processor set;

one or more computer readable storage media; and

program instructions stored on the one or more computer readable storage media to cause the processor set to perform operations comprising:

providing air temperature data from a multiplicity of sources as a first input to a generative adversarial network;

conditioning the first input to the generative adversarial network on at least one conditioning variable;

training the generative adversarial network with the air temperature data and the conditioning the first input to the generative adversarial network on the at least one conditioning variable;

generating high resolution air temperature maps as a first output from the generative adversarial network, wherein the high resolution air temperature maps are generated at a higher spatial resolution than the air temperature data from the multiplicity of sources;

providing the high resolution air temperature maps along with real-time air temperature data from a sensor network as a second input to a physics-informed neural network with extended Kalman filter; and

generating high temporal and spatial resolution air temperature forecasts as a second output from the physics-informed neural network with the extended Kalman filter.

2 . The computer system of claim 1 , wherein the high resolution air temperature maps have a spatial resolution of 100 meters×100 meters or finer.

3 . The computer system of claim 1 , wherein the multiplicity of sources is selected from a group consisting of: global climate model forecasts, regional climate model forecasts, and urban climate model datasets.

4 . The computer system of claim 1 , wherein the first input to the generative adversarial network comprises a first timeseries of the air temperature data from the multiplicity of sources, and wherein the first output from the generative adversarial network comprises a second timeseries of the high resolution air temperature maps.

5 . The computer system of claim 1 , wherein the at least one conditioning variable is obtained from a dataset selected from a group consisting of: a satellite imagery dataset, a land cover dataset, and an elevation dataset.

6 . The computer system of claim 1 , wherein the operations further comprise:

generating the high resolution air temperature maps; and

feeding the high resolution air temperature maps to a discriminator sub-model along with urban climate model datasets corrected using the real-time air temperature data from the sensor network.

7 . The computer system of claim 6 , wherein the urban climate model datasets have a spatial resolution of 100 meters×100 meters or coarser.

8 . The computer system of claim 1 , wherein the high temporal and spatial resolution air temperature forecasts are generated at a real-time (t) or a near real-time, wherein the near real-time comprises a delay in the real-time (t) of less than about 15 minutes.

9 . The computer system of claim 1 , wherein the high temporal and spatial resolution air temperature forecasts are generated at a spatial resolution of 100 meters×100 meters or finer.

10 . A computer system comprising:

a processor set;

one or more computer readable storage media; and

program instructions stored on the one or more computer readable storage media to cause the processor set to perform operations comprising:

providing air temperature data from a multiplicity of sources as first input to a generative adversarial network;

conditioning the first input to the generative adversarial network on at least one conditioning variable;

training the generative adversarial network with the air temperature data and the conditioning the first input to the generative adversarial network on the at least one conditioning variable;

generating high resolution air temperature maps having a spatial resolution of 100 meters×100 meters or finer as a first output from the generative adversarial network, wherein the high resolution air temperature maps are generated at a higher spatial resolution than the air temperature data from the multiplicity of sources;

providing the high resolution air temperature maps along with real-time air temperature data from a sensor network as a second input to a physics-informed neural network with extended Kalman filter; and

generating high temporal and spatial resolution air temperature forecasts as a second output from the physics-informed neural network with the extended Kalman filter, wherein a loss function of the physics-informed neural network computes loss L as L=L b +L o +L e +L i , wherein L e is a residual loss, L b is a boundary condition loss, L o is an initial condition loss, and L i is a loss term defined by an innovation vector and Kalman gain in the extended Kalman filter.

11 . The computer system of claim 10 , wherein the multiplicity of sources is selected from a first group consisting of: global climate model forecasts, regional climate model forecasts, urban climate model datasets, and combinations thereof, and wherein the at least one conditioning variable is obtained from a dataset selected from a second group consisting of: a satellite imagery dataset, a land cover dataset, and an elevation dataset.

12 . The computer system of claim 10 , wherein the high temporal and spatial resolution air temperature forecasts are generated at a real-time (t) or a near real-time, wherein the near real-time comprises a delay in the real-time (t) of less than about 15 minutes.

13 . The computer system of claim 10 , wherein the high temporal and spatial resolution air temperature forecasts are generated at the spatial resolution of 100 meters×100 meters or finer.

14 . A method for generating air temperature forecasts, the method comprising:

providing air temperature data from a multiplicity of sources as a first input to a generative adversarial network;

conditioning the first input to the generative adversarial network on at least one conditioning variable;

training the generative adversarial network with the air temperature data and the conditioning the first input to the generative adversarial network on the at least one conditioning variable;

generating high resolution air temperature maps having a spatial resolution of 100 meters×100 meters or finer as a first output from the generative adversarial network, wherein the high resolution air temperature maps are generated at a higher spatial resolution than the air temperature data from the multiplicity of sources;

providing the high resolution air temperature maps along with real-time air temperature data from a sensor network as a second input to a physics-informed neural network with extended Kalman filter; and

generating high temporal and spatial resolution air temperature forecasts as a second output from the physics-informed neural network with the extended Kalman filter, wherein a loss function of the physics-informed neural network computes loss L as L=L b +L o +L e +L i , wherein L e is a residual loss, L b is a boundary condition loss, L o is an initial condition loss, and L i is a loss term defined by an innovation vector and Kalman gain in the extended Kalman filter.

15 . The method of claim 14 , wherein the multiplicity of sources is selected from a first group consisting of: global climate model forecasts, regional climate model forecasts, urban climate model datasets, and combinations thereof, and wherein the at least one conditioning variable is obtained from a dataset selected from a second group consisting of: a satellite imagery dataset, a land cover dataset, and an elevation dataset.

16 . The method of claim 14 , wherein the first input to the generative adversarial network comprises a first timeseries of the air temperature data from the multiplicity of sources, and wherein the first output from the generative adversarial network comprises a second timeseries of the high resolution air temperature maps.

17 . The method of claim 14 , further comprising:

generating the high resolution air temperature maps using a generator sub-model; and

feeding the high resolution air temperature maps to a discriminator sub-model along with urban climate model datasets having the spatial resolution of 100 meters×100 meters or coarser which are corrected using the real-time air temperature data from the sensor network.

18 . The method of claim 14 , wherein the high temporal and spatial resolution air temperature forecasts are generated at a real-time (t) or a near real-time, wherein the near real-time comprises a delay in the real-time (t) of less than about 15 minutes.

19 . The method of claim 14 , wherein the high temporal and spatial resolution air temperature forecasts are generated at the spatial resolution of 100 meters×100 meters or finer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2023
From: AKHALWAYA, ISMAIL YUNUS; VOS, ETIENNE EBEN; MAKHANYA, SIBUSISIWE AUDREY; GOVINDASAMY, TAMARA ROSEMARY; PATEL, ZUBEIDA; MORAKE, DEDRICKS MONYAI; MAHLASI, CRAIG; BHAMJEE, MUAAZ
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 063713/0514 →
Continuity (1)
Related Publication 20240393498A1 · Nov 28, 2024
References Cited (31)
US 7027834B2 · Soini et al. · 2006 [cited by applicant]
US 7200491B1 · Rose, Jr. et al. · 2007 [cited by applicant]
US 9876890B2 · Shi et al. · 2018 [cited by applicant]
US 10036671B2 · Phan Le et al. · 2018 [cited by applicant]
US 10197706B1 · Cai · 2019 [cited by examiner]
US 11734798B2 · Shpalensky · 2023 [cited by examiner]
US 20080096609A1 · Lam et al. · 2008 [cited by applicant]
US 20140188287A1 · Sabata · 2014 [cited by applicant]
US 20170256033A1 · Tuzel · 2017 [cited by examiner]
US 20210041598A1 · Tocornal et al. · 2021 [cited by applicant]
US 20210064802A1 · Albert et al. · 2021 [cited by applicant]
US 20220035073A1 · Mehtab et al. · 2022 [cited by applicant]
US 20220113448A1 · Watson · 2022 [cited by examiner]
US 20230010164A1 · Cowan · 2023 [cited by examiner]
US 20230143145A1 · Price · 2023 [cited by examiner]
US 20230152487A1 · Erinjippurath · 2023 [cited by examiner]
US 20230244191A1 · Honkote · 2023 [cited by examiner]
CN 112734648A · 2021 [cited by applicant]
ZA 202309448B · 2024 [cited by applicant]
K. Kashinath et al., “Physics-informed machine learning: case studies for weather and climate modelling,” Philosophical Transactions R. Soc. A 379: 20200093 (Feb. 2021) (36 pages). [cited by applicant]
Kun Song et al., “Potential Application of Using Smartphone Sensor for Estimating Air Temperature: Experimental Study,” IEEE Internet of Things Journal, vol. 9, No. 16 (Aug. 2022) (8 pages). [cited by applicant]
American Geophysical Union, “Crowdsourcing weather using smartphone batteries,” ScienceDaily, Aug. 2013 (3 pages). [cited by applicant]
Zander S. Venter et al., “Hyperlocal mapping of urban air temperature using remote sensing and crowdsourced weather data,” Remote Sensing of Environment 242 (Mar. 2020) (14 pages). [cited by applicant]
Linwei Chen et al., “DeepUrbanDownscale: A physics informed deep learning framework for high-resolution urban surface temperature estimation via 3D point clouds,” International Journal of Applied Earth Observations and … [cited by applicant]
Shengze Cai et al., “Physics-Informed Neural Networks for Heat Transfer Problems,” ASME Journal of Heat Transfer, vol. 143 (Jun. 2021) (15 pages). [cited by applicant]
Yuxin Meng et al., “Physics-Guided Generative Adversarial Networks for Sea Subsurface Temperature Prediction,” arXiv:2111.03064v1 (Nov. 2021) (13 pages). [cited by applicant]
Jochen Stiasny et al., “Physics-Informed Neural Networks for Non-linear System Identification for Power System Dynamics,” arXiv:2004.04026v2 (Apr. 2021) (6 pages). [cited by applicant]
Alexandra Puchko et al., “DeepClimGAN: A High-Resolution Climate Data Generator,” arXiv:2011.11705v1 (Nov. 2020) (5 pages). [cited by applicant]
Erik Kusch et al., “KrigR—a tool for downloading and statistically downscaling climate reanalysis data,” Environ. Res. Lett. 17 (Jan. 2022) (10 pages). [cited by applicant]
Zongyi Li et al., “Neural Operator: Graph Kernel Network for Partial Differential Equations,” arXiv:2003.03485v1 (Mar. 2020) (21 pages). [cited by applicant]
Zongyi Li et al., “Fourier Neural Operator for Parametric Partial Differential Equations,” arXiv:2010.08895v3 (May 2021) (16 pages). [cited by applicant]