IP Library › Granted Patent US 12,651,143
Granted Patent B2
US 12,651,143 · App. 17/609,946 · Granted Jun 9, 2026

Automated method and system for categorising and describing thin sections of rock samples obtained from carbonate rocks

Inventors: Hesham Shebl (Abu Dhabi, AE); Douglas Alexander Boyd (Abu Dhabi, AE); Hani Abdulla Nehaid (Abu Dhabi, AE)
Assignee: Abu Dhabi National Oil Company
G06N3/045G06F40/30G06N3/044G06N3/0442G06N3/0464G06N3/08G06N20/00G06V10/764G06V10/82G01V2210/1216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,651,143
App. No.
17/609,946
Filed
Nov 9, 2021
Granted
Jun 9, 2026
Kind
B2
Art Unit
2124
USPC
706/20
Abstract

An automated method for categorising and describing rock samples includes: (i) capturing images of samples to generate image data; (ii) classifying the samples by applying convolutional neural network processing to the image data to identify attributes of the samples; (iii) extracting, using a module based on a trained convolution deconvolution neural network, salient features from the attributes to generate salient feature data; (iv) applying, using a module based on a trained recurrent neural network generated from supervised learning, semantic text processing to the salient feature data to generate sample text data indicative of the attributes; (v) storing the sample text data; (vi) searching an image database for categorised images that are similar to the captured images; and (vii) generating output data dependent upon a degree of similarity between the sample text data and the database text data to indicate petrophysical properties of the rocks.

Claims (43)

1 . An automated method for categorizing and describing thin sections of reservoir rock samples obtained from carbonate rocks, the method comprising:

capturing, using an input image data module, optical or microscopic images of one or more thin sections of one or more input rock samples obtained from reservoir carbonate rocks so as to generate input rock image data;

classifying, using a classifying module based on a trained convolutional neural network generated from supervised learning, the one or more input rock samples into lithological and quality categories of carbonate thin sections by applying convolutional neural network processing to the input rock image data to identify one or more attributes of the input rock samples;

extracting, using a trained salient feature extraction module based on a trained convolution deconvolution neural network, salient features from the one or more attributes of the input rock samples so as to generate salient feature data;

applying, using a semantic text processing module based on a trained recurrent neural network generated from supervised learning, semantic text processing to the salient feature data using learned associations between salient-feature data and geological descriptive terminology so as to generate input rock sample text data indicative of the one or more attributes of the input rock samples;

storing, using a storage module, the input rock sample text data;

searching, using a search module, a rock image database for categorized images that are similar to the captured images based on the stored rock sample text data and database text data associated with the categorized images stored in the rock image database, in which the rock image database comprises categorized images of categorized rock samples and the database text data, and the database text data is indicative of one or more attributes of the categorized rock samples and is associated with petrophysical measurements of the categorized rock samples; and

generating output data dependent upon a degree of similarity between the rock sample text data and the database text data so that the output data indicates petrophysical properties of the carbonate rocks associated with the thin sections of input rock samples that are identified as being within a selected degree of similarity to the categorized rock samples in the rock image database based on a comparison of the stored rock sample text data with the database text data, and in which the output data is based on the petrophysical measurements of the categorized rock samples identified as being within a selected degree of similarity to the input rock samples.

2 . The method according to claim 1 , in which the output data comprises a textual description of the petrophysical properties of the input rock sample.

3 . The method according to claim 1 , in which extracting the salient features comprises performing image semantic segmentation using deconvolution neural network processing.

4 . The method according to claim 1 , in which the semantic text processing comprises applying recurrent neural network processing to the salient feature data.

5 . The method according to claim 4 , in which the recurrent neural network processing comprises applying a long short term memory (LTSM) stacked network to the salient feature data to generate a textual summary of image content of the image data.

6 . The method according to claim 1 , in which the degree of similarity is user selectable.

7 . The method according to claim 1 , in which the convolutional neural network comprises using an intermediate layer between two convolutional layers.

8 . The method according to claim 7 , in which the intermediate layer comprises using a rectified linear units (ReLU) nonlinear activation function.

9 . The method according to claim 7 , in which the convolutional neural network processing comprising using two or more of: a convolution layer; a max pooling layer; and a fully connected layer.

10 . The method according to claim 7 , in which the intermediate layer comprises a max pooling layer.

11 . The method according to claim 1 , comprising:

generating a labelled image training database based on observing and labelling a plurality of carbonate reservoir rock samples including providing qualitative assessment of salient feature abundance;

generating a semantic text training database comprising text data comprising text data relating to descriptions of carbonate reservoir rock samples;

generating a measured rock properties database comprising rock property data associated with labelled and unlabeled rock training images;

generating the trained convolutional neural network for the classifying module by using supervised learning based on a first subset of the labelled image training database so as to classify the rock training images;

generating the trained convolution deconvolution neural network for the trained salient feature extraction module using supervised learning based on a second subset of the labelled image training database so as to recognize carbonate reservoir rock features and their abundance; and

generating the trained recurrent neural network for the semantic text processing module by using supervised learning based on seed words from the trained convolutional neural network and the trained convolution deconvolution neural network.

12 . A non-transitory computer-readable medium storing a computer program comprising computer readable instructions which, when executed by one or more processors, cause the one or more processors to:

capture, using an input image data module, images of one or more thin sections of one or more input rock samples obtained from reservoir carbonate rocks so as to generate input rock image data;

classify, using a classifying module based on a trained convolutional neural network generated from supervised learning, the one or more input rock samples by applying convolutional neural network processing to the input rock image data to identify one or more attributes of the input rock samples;

extract, using a trained salient feature extraction module based on a trained convolution deconvolution neural network, salient features from the one or more attributes of the input rock samples so as to generate salient feature data;

apply, using a semantic text processing module based on a trained recurrent neural network generated from supervised learning, semantic text processing to the salient feature data so as to generate input rock sample text data indicative of the one or more attributes of the input rock samples;

store, using a storage module, the input rock sample text data;

search, using a search module, a rock image database for categorized images that are similar to the captured images based on the stored rock sample text data and database text data associated with the categorized images stored in the rock image database, in which the rock image database comprises categorized images of categorized rock samples and the database text data, and the database text data is indicative of one or more attributes of the categorized rock samples and is associated with petrophysical measurements of the categorized rock samples; and

generate output data dependent upon a degree of similarity between the rock sample text data and the database text data so that the output data indicates petrophysical properties of the carbonate rocks associated with the thin sections of input rock samples that are identified as being within a selected degree of similarity to the categorized rock samples in the rock image database based on a comparison of the stored rock sample text data with the database text data, and in which the output data is based on the petrophysical measurements of the categorized rock samples identified as being within a selected degree of similarity to the input rock samples.

13 . The non-transitory computer-readable medium of claim 12 , wherein the computer-executable instructions further cause the one or more processors to:

apply recurrent neural network processing to the salient feature data,

wherein the recurrent neural network processing comprises applying a long short term memory (LTSM) stacked network to the salient feature data to generate a textual summary of image content of the image data.

14 . An automated system for categorizing and describing thin sections of reservoir rock samples obtained from carbonate rocks, the system comprising a processor in communication with memory storing instructions executable by the processor to:

capture optical or microscopic images of one or more thin sections of one or more input rock samples obtained from reservoir carbonate rocks so as to generate input rock image data;

classify, based on a trained convolution neural network generated from supervised learning, the one or more rock samples into lithological and quality categories of carbonate thin sections by applying convolutional neural network processing to the input rock image data to identify one or more attributes of the rock samples;

extract, based on a trained convolution deconvolution neural network, salient features from the one or more attributes of the rock samples so as to generate salient feature data;

apply semantic text processing, based on a trained recurrent neural network generated from supervised learning, to the salient feature data using learned associations between salient-feature data and geological descriptive terminology so as to generate input rock sample text data indicative of the one or more attributes of the rock samples;

store the input rock sample text data in a storage module;

search a rock image database for categorized images that are similar to the captured images based on the stored rock sample text data and database text data associated with the categorized images stored in the rock image database, in which the rock image database comprises categorized images of categorized rock samples and the database text data, and the database text data is indicative of one or more attributes of the categorized rock samples and is associated with petrophysical measurements of the categorized rock samples; and

generate output data dependent upon a degree of similarity between the rock sample text data and the database text data so that the output data indicates petrophysical properties of the carbonate rocks associated with the thin sections of input rock samples that are identified as being within a selected degree of similarity to the categorized rock samples in the rock image database based on a comparison of the stored rock sample text data with the database text data, and in which the output data is based on the petrophysical measurements of the categorized rock samples identified as being within a selected degree of similarity to the input rock samples.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2022
From: SHEBL, HESHAM; ALEXANDER BOYD, DOUGLAS; ABDULLA NEHAID, HANI
To: ABU DHABI NATIONAL OIL COMPANY (ADNOC)
Reel/Frame 060369/0712 →
Continuity (1)
Related Publication 20220207079A1 · Jun 30, 2022
References Cited (53)
US 11068722B2 · Cricri · 2021 [cited by examiner]
US 20090110242A1 · Touati et al. · 2009 [cited by applicant]
US 20120275658A1 · Hurley et al. · 2012 [cited by applicant]
US 20180268548A1 · Lin · 2018 [cited by examiner]
US 20190012791A1 · Tchoumou et al. · 2019 [cited by applicant]
US 20190064378A1 · Liu · 2019 [cited by examiner]
US 20190087939A1 · Hakimuddin · 2019 [cited by examiner]
US 20190147125A1 · Yu · 2019 [cited by examiner]
US 20190368316A1 · Bize-Forest · 2019 [cited by examiner]
US 20190378179A1 · Cleverley · 2019 [cited by examiner]
US 20200097754A1 · Tawari · 2020 [cited by examiner]
US 20200183031A1 · Denli · 2020 [cited by examiner]
US 20200226400A1 · Corring · 2020 [cited by examiner]
US 20200301036A1 · Ramfjord · 2020 [cited by examiner]
US 20200356822A1 · Starostin · 2020 [cited by examiner]
US 20210166115A1 · Yu · 2021 [cited by examiner]
US 20210223427A1 · Dorrington · 2021 [cited by examiner]
US 20220099855A1 · Li · 2022 [cited by examiner]
US 20220146705A1 · Gkortsas · 2022 [cited by examiner]
US 20220179111A1 · Xue · 2022 [cited by examiner]
US 20220207079A1 · Shebl · 2022 [cited by examiner]
CN 103207999A · 2013 [cited by applicant]
CN 107133630A · 2017 [cited by applicant]
CN 107633255A · 2018 [cited by applicant]
KR 1020190012791A · 2019 [cited by applicant]
WO 2017079178A1 · 2017 [cited by applicant]
WO WO2019236339A1 · 2019 [cited by examiner]
Dorrington et al., “Geological Feature Search Engine” Jun. 6, 2018, U.S. Appl. No. 62/681,632. (Year: 2018). [cited by examiner]
Wei et al., “Characterizing Rock Facies using Machine Learning Algorithm Based on a Convolutional Neural Network and Data Padding Strategy” Mar. 25, 2019, pp. 1-13. (Year: 2019). [cited by examiner]
Hu et al., “Segmentation from Natural Language Expressions” Mar. 20, 2016, arXiv: 1603.06180v1, pp. 1-25. (Year: 2016). [cited by examiner]
Qi et al., “Life-long Cross-media Correlation Learning” Oct. 2018, pp. 528-536. (Year: 2018). [cited by examiner]
Babakhin et al., “Semi-Supervised Segmentation of Salt Bodies in Seismic Images using an Ensemble of Convolutional Neural Networks” Apr. 9, 2019, arXiv: 1904.04445v1, pp. 1-9. (Year: 2019). [cited by examiner]
Nag et al., “Offline Extraction of Indic Regional Language from Natural Scene Image using Text Segmentation and Deep Convolutional Sequence” 2018, pp. 1-15. (Year: 2018). [cited by examiner]
Avalos et Ortiz, “Geological modeling using Recursive Convolutional Neural Networks” Apr. 27, 2019, arXiv: 1904.12190v1, pp. 1-8. (Year: 2019). [cited by examiner]
Alaudah et al., “Structure label prediction using similarity-based retrieval and weakly supervised label mapping” Dec. 13, 2018, pp. V67-V79. (Year: 2018). [cited by examiner]
Alaudah et al., “A Machine Learning Benchmark for Facies Classification” Apr. 10, 2019, pp. 1-13. (Year: 2019). [cited by examiner]
Tschannen et al., “Facies classification from well logs using an inception convolutional network” Jun. 2, 2017, arXiv: 1706.00613v1, pp. 1-5. (Year: 2017). [cited by examiner]
Li et al., “Multi-Modal Gated Recurrent Units for Image Description” Apr. 20, 2019, arXiv: 1904.09421v1, pp. 1-25. (Year: 2019). [cited by examiner]
Jiang et al., “Predicting Video Saliency with Object-to-Motion CNN and Two-layer Convolutional LSTM” Jan. 14, 2019, arXiv: 1709.06316v3, pp. 1-13. (Year: 2019). [cited by examiner]
Liu et al., “Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification” Mar. 23, 2017, arXiv: 1703.07910v1, pp. 1-18. (Year: 2017). [cited by examiner]
Mandya et al., “Combining Long Short-Term Memory and Convolutional Neural Network for Cross-Sentence n-ary Relation Extraction” Nov. 2, 2018, arXiv: 1811.00845v1, pp. 1-9. (Year: 2018). [cited by examiner]
Pfeiffer et al., “Semantic Segmentation of Video Sequence with Convolutional LSTM” May 3, 2019, arXiv: 1905.01058v1, pp. 1-7. (Year: 2019). [cited by examiner]
Pontes et al., “Predicting the Semantic Textual Similarity with Siamese CNN and LSTM” Oct. 24, 2018, arXiv: 1810.10641v1, pp. 1-9. (Year: 2018). [cited by examiner]
Nabavi et al., “Future Semantic Segmentation with Convolutional LSTM” Jul. 20, 2018, arXiv: 1807.07946v1, pp. 1-12. (Year: 2018). [cited by examiner]
Office Action for corresponding Saudi Patent application No. 521430790 dated Oct. 29, 2023, with English Translation. [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority for corresponding International Patent Application No. PCT/IB2019/053811, dated Feb. 7, 2020. [cited by applicant]
T.J. Jobe, E. Vital-Brazil, M. Khait, “Geological Feature Prediction Using Image-Based Machine Learning”, SPWLA Petrophysics Journal, vol. 59, No. 6, pp. 750-760, Dec. 2018. [cited by applicant]
Vasser R. Busaleh; Abdulazeez Abdulraheem; Taha Okasha, “Prediction of Capillary Pressure for Oil Carbonate Reservoirs by Artificial Intelligence Technique”, Paper SPE-182173-MS, presented at the SPE Asia Pacific Oil & … [cited by applicant]
Semen Budennyy; Alexey Pachezhertsev; Alexander Bukharev; Artem Erofeev; Dimitry Mitrushkin; Boris Belozerov; Oct. 16-18, 2017, “Image Processing and Machine Learning Approaches for Petrographic Thin Section Analysis”, … [cited by applicant]
Zheng Ma; Shichen Gao; Apr. 17-20, 2017, “Image analysis of rock thin section based on machine learning”, presented at the Chinese Geophysical Society / Society of Exploration Geophysicists (CGS/SEG) International Geoph… [cited by applicant]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox, 2015, U-Net: Convolutional Networks for Biomedical Image Segmentation, paper arXiv:1505.04597. [cited by applicant]
VGG 16—Open Source VGG16 Deep Convolution Neural Net, Karen Simonyan, Andrew Zisserman, 2014. Very Deep ConvNets for Large-Scale Image Recognition, ILSVRC Sep. 14, 2014 Workshop and arXi pre-print, arxiv.org/pdf/1409.15… [cited by applicant]
Zheng Ma; Shichen Gao; “Image analysis of rock thin section based on machine learning”, presented at the Chinese Geophysical Society / Society of Exploration Geophysicists (CGS/SEG) International Geophysical Conference … [cited by applicant]