IP Library › Granted Patent US 12,241,369
Granted Patent B2
US 12,241,369 · App. 17/647,412 · Granted Mar 4, 2025

Systems and methods for performing lithological classification of cuttings based on calibrated photographs of rock particles

Inventors: Tetsushi Yamada (Cambridge, MA); Simone Di Santo (Dhahran, SA)
Assignee: SCHLUMBERGER TECHNOLOGY CORPORATION
E21B49/005G01N15/0227G01N15/1433G01N33/24G06T7/40E21B21/066E21B44/00E21B2200/20G06T2207/10004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,241,369
App. No.
17/647,412
Granted
Mar 4, 2025
Kind
B2
Abstract

Systems and methods are configured to receive one or more photographs depicting a plurality of cuttings, to identify one or more individual cuttings of the plurality of cuttings depicted in the one or more photographs, to extract morphological, color, texture, grain size, and grain distribution data from each individual cutting of the one or more individual cuttings, to perform lithological classification of the one or more individual cuttings at a plurality of hierarchical levels based at least in part on the extracted morphological, color, texture, grain size, and grain distribution data or based at least in part on features directly extracted from the one or more individual cuttings that represent the morphological, color, texture, grain size, and grain distribution data, and to present a consolidated results summary of the lithological classification of the one or more individual cuttings at the plurality of hierarchical levels via the analysis and control system.

Claims (38)

1. A method, comprising:

calibrating, via an analysis and control system, one or more photographs that depict a plurality of cuttings;

identifying, via the analysis and control system, one or more individual cuttings of the plurality of cuttings depicted in the one or more calibrated photographs;

extracting, via the analysis and control system, morphological, color, texture, grain size, and grain distribution data from each individual cutting of the one or more individual cuttings;

performing, via the analysis and control system, lithological classification of the one or more individual cuttings at a plurality of hierarchical levels based at least in part on the extracted morphological, color, texture, grain size, and grain distribution data; and

presenting, via the analysis and control system, a consolidated results summary of the lithological classification of the one or more individual cuttings at the plurality of hierarchical levels via the analysis and control system.

2. The method of claim 1 , comprising automatically adjusting, via the analysis and control system, one or more operating parameters of a drilling operation from which the plurality of cuttings were generated based at least in part on the lithological classification of the one or more individual cuttings.

3. The method of claim 1 , wherein calibrating, via the analysis and control system, the one or more photographs comprises calibrating the one or more photographs with one or more previously analyzed photographs with respect to color, illumination, and resolution.

4. The method of claim 1 , comprising retraining, via the analysis and control system, a lithological classification model based at least in part on one or more annotations added by a user of the analysis and control system.

5. The method of claim 1 , wherein the lithological classification is based at least in part on stratigraphic geological sequences, while-drilling logs, 3D model properties, cutting physical analysis, ultraviolet images, infrared images, near-infrared images, or some combination thereof.

6. The method of claim 1 , wherein identifying the one or more individual cuttings comprises identifying a set of pixels in the one or more calibrated photographs that correspond to each individual cutting of the one or more individual cuttings.

7. The method of claim 1 , wherein the plurality of hierarchical levels comprises some combination of: an individual cutting level, a sample level, a particular depth interval within a borehole, a geological formation level, a well level, and a well field level.

8. The method of claim 1 , wherein identifying the one or more individual cuttings of the plurality of cuttings depicted in the one or more calibrated photographs comprises extracting a plurality of features of each individual cutting of the one or more individual cuttings, and wherein the plurality of features comprises a color and a texture of each individual cutting of the one or more individual cuttings.

9. The method of claim 8 , comprising:

grouping, via the analysis and control system, the plurality of cuttings into subsets of the plurality of cuttings based on shared features among the subsets of the plurality of cuttings; and

performing, via the analysis and control system, lithological classification of the subsets of the plurality of cuttings at the plurality of hierarchical levels based at least in part on the plurality of features extracted from the one or more individual cuttings.

10. The method of claim 8 , comprising:

displaying, via a display of the analysis and control system, the plurality of cuttings in a multi-dimensional map, wherein each axis of the multi-dimensional map corresponds to a feature of the plurality of features; and

enabling, via the analysis and control system, a user to annotate the lithological classification of one or more individual cuttings on the multi-dimensional map.

11. An analysis and control system configured to:

calibrate one or more photographs that depict a plurality of cuttings;

identify one or more individual cuttings of the plurality of cuttings depicted in the one or more calibrated photographs;

extract morphological, color, texture, grain size, and grain distribution data from each individual cutting of the one or more individual cuttings;

perform lithological classification of the one or more individual cuttings at a plurality of hierarchical levels based at least in part on the extracted morphological, color, texture, grain size, and grain distribution data; and

present a consolidated results summary of the lithological classification of the one or more individual cuttings at the plurality of hierarchical levels via the analysis and control system.

12. The analysis and control system of claim 11 , wherein the analysis and control system is configured to automatically adjust one or more operating parameters of a drilling operation from which the plurality of cuttings were generated based at least in part on the lithological classification of the one or more individual cuttings.

13. The analysis and control system of claim 11 , wherein the analysis and control system is configured to calibrate the one or more photographs with one or more previously analyzed photographs with respect to color, illumination, and resolution.

14. The analysis and control system of claim 11 , wherein the analysis and control system is configured to retrain a lithological classification model based at least in part on one or more annotations added by a user of the analysis and control system.

15. The analysis and control system of claim 11 , wherein the lithological classification is based at least in part on stratigraphic geological sequences, while-drilling logs, 3D model properties, cutting physical analysis, ultraviolet images, infrared images, near-infrared images, or some combination thereof.

16. The analysis and control system of claim 11 , wherein identifying the one or more individual cuttings comprises identifying a set of pixels in the one or more calibrated photographs that correspond to each individual cutting of the one or more individual cuttings.

17. The analysis and control system of claim 11 , wherein the plurality of hierarchical levels comprises some combination of: an individual cutting level, a sample level, a particular depth interval within a borehole, a geological formation level, a well level, and a well field level.

18. The analysis and control system of claim 11 , wherein identifying the one or more individual cuttings of the plurality of cuttings depicted in the one or more calibrated photographs comprises extracting a plurality of features of each individual cutting of the one or more individual cuttings, and wherein the plurality of features comprises a color and a texture of each individual cutting of the one or more individual cuttings.

19. The analysis and control system of claim 18 , wherein the analysis and control system is configured to:

group the plurality of cuttings into subsets of the plurality of cuttings based on shared features among the subsets of the plurality of cuttings; and

perform lithological classification of the subsets of the plurality of cuttings at the plurality of hierarchical levels based at least in part on the plurality of features extracted from the one or more individual cuttings.

20. The analysis and control system of claim 18 , wherein the analysis and control system is configured to:

display the plurality of cuttings in a multi-dimensional map, wherein each axis of the multi-dimensional map corresponds to a feature of the plurality of features; and

enable a user to annotate the lithological classification of one or more individual cuttings on the multi-dimensional map.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2022
From: YAMADA, TETSUSHI; DI SANTO, SIMONE
To: SCHLUMBERGER TECHNOLOGY CORPORATION
Reel/Frame 059029/0527 →
Continuity (1)
Related Publication 20230220770A1 · Jul 13, 2023
References Cited (76)
US 7936374B2 · Cutler · 2011 [cited by examiner]
US 9412023B1 · Hurley · 2016 [cited by applicant]
US 9507047B1 · Dvorkin · 2016 [cited by examiner]
US 9652684B2 · Keskes et al. · 2017 [cited by applicant]
US 10927671B1 · Tonner · 2021 [cited by examiner]
US 11188794B2 · Yao et al. · 2021 [cited by applicant]
US 11719089B2 · Affleck · 2023 [cited by examiner]
US 20050276513A1 · Ojanen · 2005 [cited by applicant]
US 20100128932A1 · Dvorkin · 2010 [cited by examiner]
US 20120123756A1 · Wang · 2012 [cited by applicant]
US 20130073207A1 · Ganz · 2013 [cited by examiner]
US 20130120763A1 · Grenet · 2013 [cited by applicant]
US 20130259190A1 · Walls · 2013 [cited by examiner]
US 20140046628A1 · Ligneul et al. · 2014 [cited by applicant]
US 20150043787A1 · Fredrich · 2015 [cited by examiner]
US 20160370274A1 · Rowe · 2016 [cited by examiner]
US 20170085860A1 · Zhang · 2017 [cited by applicant]
US 20180101962A1 · Takizawa · 2018 [cited by applicant]
US 20180180524A1 · François · 2018 [cited by examiner]
US 20190212272A1 · Scoullar · 2019 [cited by examiner]
US 20190338637A1 · Francois · 2019 [cited by examiner]
US 20200025667A1 · Allo · 2020 [cited by examiner]
US 20200143205A1 · Yao · 2020 [cited by applicant]
US 20200150307A1 · Myers · 2020 [cited by applicant]
US 20200157929A1 · Torrione · 2020 [cited by examiner]
US 20210041588A1 · Chen · 2021 [cited by examiner]
US 20210254457A1 · Anifowose · 2021 [cited by applicant]
US 20210312674A1 · Abrol et al. · 2021 [cited by applicant]
US 20210319257A1 · Francois · 2021 [cited by examiner]
US 20230184992A1 · Albahrani · 2023 [cited by examiner]
US 20230220761A1 · Yamada et al. · 2023 [cited by applicant]
US 20230351580A1 · Di Santo · 2023 [cited by applicant]
US 20240054766A1 · Yu · 2024 [cited by examiner]
CN 111141698A · 2020 [cited by applicant]
EP 3896496A1 · 2021 [cited by applicant]
WO 2019167030A1 · 2019 [cited by applicant]
Becerra et al., Generating a labeled data set to train machine learning algorithms for lithologic classification of drill cuttings, Special section: Machine learning for image-based geologic interpretation, May 2022, pp… [cited by examiner]
Abbireddy, C.O.R. et al., “A method of estimating the form of fine particulates”, Geotechnique, 2009, 59(6), pp. 503-511. [cited by applicant]
Barrett, P. J. “The shape of rock particles, a critical review”, Sedimentology, 1980, 27, pp. 291-303. [cited by applicant]
Caicedo, J. C. et al., “Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl”, Nature Methods, 2019, 16, pp. 1247-1253. [cited by applicant]
Dunlop, H. et al., “Multi-scale Features for Detection and Segmentation of Rocks in Mars Images”, 2007, 10.1109/CVPR.2007.383257, 7 pages. [cited by applicant]
Feng, L. et al., “Robust Nucleus Detection with Partially Labeled Exemplars”, IEEE Access (7), 2019, pp. 162169-162178. [cited by applicant]
Gaetano, R. et al., “Hierarchical Texture-Based Segmentation of Multiresolution Remote-Sensing Images”, IEEE Transactions on Geoscience and Remote Sensing, 2009, 47(7), pp. 2129-2141. [cited by applicant]
He, K. et al., “Mask R-CNN”, Computer Vision (ICCV), IEEE International Conference on Computer Vision, 2017, pp. 2980-2988. [cited by applicant]
He, K. et al., “Deep Residual Learning for Image Recognition”, 2016 IEEE International Conference on Computer Vision, 2016, pp. 770-778. [cited by applicant]
Huo, F. et al., “Novel lithology identification method for drilling cuttings under PDC bit condition”, Journal of Petroleum Science and Engineering, 2021, 205, 15 pages. [cited by applicant]
Jung, H. et al., “An automatic nuclei segmentation method based on deep convolutional neural networks for histopathology images”, BMC Biomedical Engineering, 2019, 1:24, 12 pages. [cited by applicant]
Lin, T. Y. et al., “Microsoft COCO: Common Objects in Context”, ECCV 2014: Computer Vision—ECCV 2014, pp. 740-755. [cited by applicant]
Lin, T.-Y. et al., “Feature Pyramid Networks for Object Detection”, Computer Vision and Pattern Recognition (CVPR), IEEE International Conference on Computer Vision 2017, pp. 936-944. [cited by applicant]
Rahmani, H. et al., “Automated segmentation of gravel particles from depth images of gravel-soil mixtures”, Compute and Geosciences, 2019, 128, pp. 1-10. [cited by applicant]
Ravali, K. et al., “Graph-Based High Resolution Satellite Image Segmentation for Object Recognition”, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2014, vol. XL-8, p… [cited by applicant]
Sanxo-Scope HD U4 Express: Industrial Microscope downloaded from the internt at [https://sanxo.eu/sanxo-scope-hd-u4-express-industrial-microscope/] on Apr. 21, 2022, 8 pages. [cited by applicant]
Shi, J. et al., “Normalized Cuts and Image Segmentation”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8), pp. 888-905. [cited by applicant]
Thurley, M. J., “Automated Image Segmentation and Analysis of Rock Piles in an Open-Pit Mine”, International Conference on Digital Image Computing: Techniques and Applications (DICTA), 2013, 10.1109/DICTA.2013.6691484, … [cited by applicant]
Ting, G. et al., “Rock Particle Image Segmentation Based on Improved Normalized Cut”, International Journal of Control and Automation, 2017, 10(4), pp. 271-286. [cited by applicant]
Wang, W., “Rock Particle Image Segmentation and Systems”, in Pattern Recognition Techniques, Technology and Applications, Book edited by: Peng-Yeng Yin, Nov. 2008, I-Tech, Vienna, Austria, 10.5772/6242, 30 pages. [cited by applicant]
Wikipedia “Semi Supervised Learning” downloaded from the internet at [https://en.wikipedia.org/wiki/Semi-supervised_learning] retrieved on Apr. 21, 2022, 7 pages. [cited by applicant]
Wikipedia “Transfer Learning” downloaded from the internet at [https://en.wikipedia.org/wiki/Transfer_learning] retrieved on Apr. 21, 2022, 5 pages. [cited by applicant]
Wikipedia “Run-length encoding”, downloaded from the internet at [https://en.wikipedia.org/wiki/Run-length_encoding] retrieved on Apr. 21, 2022, 3 pages. [cited by applicant]
“Pytorch/vision” downloaded from the internet at [https://github.com/pytorch/vision] retrieved on Apr. 21, 2022, 6 pages. [cited by applicant]
“Mongoose Pro Dynamic dual-motion shaker”, retrieved from the internet: [https://www.slb.com/drilling/drilling-fluids-and-well-cementing/solids-control/shale-shakers/mongoose-pro-shale-shaker] Apr. 19, 2022, 9 pages. [cited by applicant]
Search Report and Written Opinion of International Patent Application No. PCT/US2021/044883 dated Nov. 16, 2021, 10 pages. [cited by applicant]
Using colorcheck. Imatest, Retrieved Mar. 4, 2022, from https://www.imatest.com/docs/colorcheck/, 26 pages. [cited by applicant]
Sharpness: What is it and how it is measured. Imatest, Retrieved Mar. 4, 2022, from https://www.imatest.com/docs/sharpness/, 17 pages. [cited by applicant]
Beard et al., Influence of texture on porosity and permeability of unconsolidated sand. American Association of Petroleum Geologists Bulletin, vol. 27, No. 2, Feb. 1973, p. 349-369. [cited by applicant]
Ameen et al., The function of fractures and in-situ stresses in the Khuff reservoir performance, onshore fields, Saudi Arabia, American Association of Petroleum Geologists Bulletin, vol. 94, No. 1, Jan. 2010, pp. 27-60. [cited by applicant]
Blaschke et al., Object-Based Image Analysis. Springer. p. 37. ISBN: 978-3-540-77057-2, 2008, 30 pages. [cited by applicant]
International Preliminary Report on Patentability issued in the PCT Application No. PCT/US2021/044883 mailed Feb. 16, 2023, 7 pages. [cited by applicant]
International Search Report and Written Opinion issued in PCT Application No. PCT/US2022/053454 dated Apr. 25, 2023, 10 pages. [cited by applicant]
International Search Report and Written Opinion issued in PCT Application No. PCT/US2022/060240 dated Apr. 28, 2023, 10 pages. [cited by applicant]
Liang, Z. et al., “A particle shape extraction and evaluation method using a deep convolutional neural network and digital image processing”, Powder Technology, 2019, 353, pp. 156-170. [cited by applicant]
International Search Report and Written Opinion issued in PCT Application No. PCT/US2023/015998 dated Jul. 11, 2023, 11 pages. [cited by applicant]
International Search Report and Written Opinion issued in PCT Application No. PCT/US2023/070658 dated Nov. 8, 2023, 12 pages. [cited by applicant]
Office Action issued in U.S. Appl. No. 17/647,407 dated Jun. 25, 2024, 22 pages. [cited by applicant]
International Preliminary Report on Patentability issued in International Patent application PCT/US2023/060240, dated Jun. 20, 2024, 6 pages. [cited by applicant]
International Preliminary Report on Patentability issued in International Patent application PCT/US2022/053454, dated Jun. 20, 2024, 6 pages. [cited by applicant]
Cited By (1)
US 12,454,887