IP Library Granted Patent US 12,524,583
Granted Patent B2
US 12,524,583 · App. 18/706,243 · Granted Jan 13, 2026

Property modeling using attentive neural processes

Inventors: Suhas Suresha (Menlo Park, CA); Anatoly Aseev (Menlo Park, CA); Alfredo De La Fuente (Menlo Park, CA)
Assignee: Schlumberger Technology Corporation
G06F30/13G06N5/022
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,524,583
App. No.
18/706,243
Granted
Jan 13, 2026
Kind
B2
Abstract

A method implements property modeling using attentive neural processes. The method includes receiving sparse context input comprising a plurality of context locations corresponding to a plurality of geological property values for a geological property and selecting a plurality of target locations in a space of the plurality of context locations. The method further includes generating a predicted mean image for the geological property by an attentive neural process model using the plurality of target locations and the sparse context input and presenting the predicted mean image.

Claims (63)

1 . A method comprising:

retrieving a plurality of sparse context inputs comprising a plurality of context locations corresponding to a plurality of geological property values for a geological property;

generating, via an attentive neural process model, a predicted mean image for the geological property using a plurality of target locations in a space and the plurality of sparse context inputs, wherein generating the predicted mean image comprises:

encoding, by a latent attention layer of an encoder, the plurality of sparse context inputs to obtain an internal representation, wherein the encoder comprises a deterministic attention layer and the latent attention layer;

parameterizing a distribution of a latent variable using the internal representation;

concatenating the plurality of target locations, an additional internal representation, and the distribution to obtain a concatenated input; and

decoding the concatenated input to generate one or more predicted mean pixels of the predicted mean image and one or more predicted variance pixels of a predicted variance image, wherein each pixel of the predicted mean image comprises a respective target location of the plurality of target locations; and

presenting the predicted mean image.

2 . The method of claim 1 , further comprising:

generating the predicted variance image for the geological property by the attentive neural process model using the plurality of target locations and the plurality of sparse context inputs.

3 . The method of claim 1 , further comprising:

encoding, by the deterministic attention layer of the encoder, the plurality of sparse context inputs to obtain the additional internal representation, the plurality of sparse context inputs comprising the plurality of context locations; and

obtaining weights, by a cross-attention layer, for the plurality of context locations, wherein the weights focus a subset of the plurality of context locations to the plurality of target locations.

4 . The method of claim 1 , further comprising:

processing the predicted mean image and the predicted variance image to generate a predicted sample image.

5 . The method of claim 1 , further comprising:

presenting one or more of the predicted mean image, the predicted variance image, and a predicted sample image generated from the predicted mean image and the predicted variance image.

6 . The method of claim 1 , further comprising:

training the attentive neural process model, wherein training the attentive neural process model comprises:

receiving an original image, wherein the original image comprises a plurality of pixels corresponding to a plurality of geological properties the original image;

generating a plurality of training context locations from the original image, wherein the plurality of training context locations corresponds to a subset of the plurality of pixels of the original image;

processing the original image with the plurality of training context locations;

generating a masked image, wherein the masked image comprises respective geological properties at pixels corresponding to the plurality of training context locations; and

outputting a trained attentive neural process model.

7 . The method of claim 6 , further comprising:

processing the masked image to generate a training mean image and a training variance image;

processing the training mean image and the training variance image to generate a training sample image; and

updating the attentive neural process model based on the training sample image and an original image.

8 . The method of claim 1 , wherein the geological property values are indicative of one or more features of a well comprising an acoustic impedance, a density, a porosity, one or more additional features, or a combination thereof.

9 . The method of claim 1 , further comprising:

generating the predicted variance image, wherein each pixel of the predicted variance image corresponds to a respective target location of the plurality of target locations and a variance value from a mean value for the geological property.

10 . A system comprising:

one or more processors;

memory, accessible by the one or more processors, the memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

retrieving a plurality of sparse context inputs comprising a plurality of context locations comprising a plurality of geological property values for a geological property;

using an attentive neural process model to process the plurality of sparse context inputs using a plurality of target locations; and

generating, via the attentive neural process model, a predicted mean image for the geological property by the attentive neural process model using the plurality of target locations in a space and the plurality of sparse context inputs, wherein generating the predicted mean image comprises:

encoding, by a latent attention layer of an encoder, the plurality of sparse context inputs to obtain an internal representation, wherein the encoder comprises a deterministic attention layer and the latent attention layer;

parameterizing a distribution of a latent variable using the internal representation;

concatenating the plurality of target locations, an additional internal representation, and the distribution to obtain a concatenated input; and

decoding the concatenated input to generate one or more predicted mean pixels of the predicted mean image and one or more predicted variance pixels of a predicted variance image, and wherein each pixel of the predicted mean image comprises a respective target location of the plurality of target locations.

11 . The system of claim 10 , wherein operations further comprise:

generating the predicted variance image for the geological property by the attentive neural process model using the plurality of target locations and the plurality of sparse context inputs.

12 . The system of claim 10 , wherein operations further comprise:

encoding, by the deterministic attention layer of the encoder, the plurality of sparse context inputs to obtain the additional internal representation, the plurality of sparse context inputs comprising the plurality of context locations; and

obtaining weights, by a cross-attention layer, for the plurality of context locations, wherein the weights focus a subset of the plurality of context locations to the plurality of target locations.

13 . The system of claim 10 , wherein operations further comprise:

processing the predicted mean image and the predicted variance image to generate a predicted sample image.

14 . The system of claim 10 , wherein operations further comprise:

presenting one or more of the predicted mean image, the predicted variance image and a predicted sample image generated from the predicted mean image and the predicted variance image.

15 . The system of claim 10 , wherein operations further comprise:

processing with the attentive neural process model, wherein the attentive neural process model is trained by:

receiving an original image;

selecting a plurality of training context locations from the original image; and

processing the original image with the training context locations to generate a masked image.

16 . A non-transitory computer readable medium comprising instructions that, when executed by one or more processors, are configured for:

retrieving a plurality of sparse context inputs comprising a plurality of context locations corresponding to a plurality of geological property values for a geological property;

generating, via an attentive neural process model, a predicted mean image for the geological property using a plurality of target locations and the plurality of sparse context inputs, wherein generating the predicted mean image comprises:

encoding, by a latent attention layer of an encoder, the plurality of sparse context inputs to obtain an internal representation, wherein the encoder comprises a deterministic attention layer and the latent attention layer;

parameterizing a distribution of a latent variable using the internal representation;

concatenating the plurality of target locations, an additional internal representation, and the distribution to obtain a concatenated input; and

decoding the concatenated input to generate one or more predicted mean pixels of the predicted mean image and one or more predicted variance pixels of a predicted variance image, wherein each pixel of the predicted mean image comprises a respective target location of the plurality of target locations; and

presenting the predicted mean image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2024
From: SURESHA, SUHAS; ASEEV, ANATOLY; DE LA FUENTE, ALFREDO
To: SCHLUMBERGER TECHNOLOGY CORPORATION
Reel/Frame 067297/0464 →
Continuity (2)
Provisional Application 63284606 · Nov 30, 2021
Related Publication 20240330524A1 · Oct 3, 2024
References Cited (43)
US 11115645B2 · Yang · 2021 [cited by examiner]
US 11520077B2 · Denli · 2022 [cited by examiner]
US 20100254463A1 · Narroschke · 2010 [cited by examiner]
US 20110205844A1 · Maucec · 2011 [cited by examiner]
US 20110272161A1 · Kumaran · 2011 [cited by examiner]
US 20120095741A1 · Jin · 2012 [cited by examiner]
US 20130013202A1 · Som · 2013 [cited by examiner]
US 20130215961A1 · Nakagawa · 2013 [cited by examiner]
US 20140278115A1 · Bas · 2014 [cited by examiner]
US 20160145991A1 · Yarus · 2016 [cited by examiner]
US 20160146973A1 · Johnson · 2016 [cited by examiner]
US 20160203386A1 · Porecki · 2016 [cited by examiner]
US 20170228925A1 · Drinovsky · 2017 [cited by examiner]
US 20170301116A1 · Zhu · 2017 [cited by applicant]
US 20180336309A1 · Shi · 2018 [cited by examiner]
US 20190073580A1 · Dzhulgakov · 2019 [cited by examiner]
US 20190361147A1 · Frambati · 2019 [cited by examiner]
US 20200020098A1 · Odry · 2020 [cited by examiner]
US 20200183047A1 · Denli · 2020 [cited by applicant]
US 20200257979A1 · Luo · 2020 [cited by examiner]
US 20200301036A1 · Ramfjord · 2020 [cited by examiner]
US 20200372327A1 · Qiu · 2020 [cited by examiner]
US 20210090239A1 · Pattnaik · 2021 [cited by applicant]
US 20210256358A1 · Deng et al. · 2021 [cited by applicant]
US 20210286270A1 · Middlebrooks · 2021 [cited by examiner]
US 20210350555A1 · Fischetti · 2021 [cited by examiner]
US 20220147818A1 · Zhang · 2022 [cited by examiner]
US 20220366246A1 · Danihelka · 2022 [cited by examiner]
US 20230032044A1 · Li · 2023 [cited by examiner]
US 20230086355A1 · Wichern · 2023 [cited by examiner]
Neural Attention Models in Deep Learning: Survey and Taxonomy Correia et al. (Year: 2021). [cited by examiner]
A Simple Neural Attentive Meta-Learner Mishra et al. (Year: 2018). [cited by examiner]
Subject Category Classification of Scholarly Papers Using Deep Attentive Neural Networks Bharath Kandimalla (Year: 2020). [cited by examiner]
An Evaluation of Image Noise Variance for Time-of-Flight PET Charles C. Watson, Senior Member, IEEE (Year: 2007). [cited by examiner]
Evaluation of Image Signal-to-Noise Ratio in Time-of-flight PET Clementel et al. (Year: 2010). [cited by examiner]
Recurrent Attentive Neural Process for Sequential Data Qin et al. (Year: 2019). [cited by examiner]
Conditional Neural Processes Garnelo et al. (Year: 2018). [cited by examiner]
Attentive Neural Processes Kim et al. (Year: 2019). [cited by examiner]
Implicit Structural Modeling of Geological Structures with Deep Learning Bi et al. (Year: 2021). [cited by examiner]
Search Report and Written Opinion of International Patent Application No. PCT/US2022/051393 dated Apr. 4, 2023, 7 pages. [cited by applicant]
Garnelo, M. et al., “Neural Processes”, arXiv:1807.01622v1, Presented at the ICML 2018 workshop on Theoretical Foundations and Applications of Deep Generative Models, 11 pages. [cited by applicant]
Kim, H. et al., “Attentive Neural Processes”, arXiv:1901.05761v2, Published as a conference paper: Presented at the 2019 International Conference on Learning Representations, 18 pages. [cited by applicant]
Abubakar, Aria et al., SPE-205985-MS, Automating Well Log Correlation Workflow Using Soft Attention Convolutional Neural Networks, Sep. 21, 2021, pp. 1-11. [cited by applicant]