IP Library Granted Patent US 12,373,955
Granted Patent B2
US 12,373,955 · App. 17/872,865 · Granted Jul 29, 2025

System and method for storage management of images

Inventors: Ofir Ezrielev (Be′er Sheva, IL); Amihai Savir (Newton, MA); Avitan Gefen (Lehavim, IL); Nicole Reineke (Northborough, MA)
Assignee: Dell Products L.P.
G06T7/11G06F3/0685G06F16/185G06F16/55G06T7/0012G06T3/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,955
App. No.
17/872,865
Granted
Jul 29, 2025
Kind
B2
Abstract

Methods and systems for managing storage of data are disclosed. To manage storage of data, images may be stored across a number of storages that provide varying levels of storage performance and have correspondingly varying costs for storing data. To store the images across the storages, the images may be segmented into image segments and a likelihood of each of the image segments being used in the future may be identified. The image segments that are more likely to be used in the future may be stored in higher performance storages while the image segments that are less likely to be used in the future may be stored in lower performance storages. To identify the likelihood of each of the image segments being used in the future, the image segments may be classified based on their membership in one or more areas of interest within the images.

Claims (58)

1. A method for managing storage of images in different storage tiers, the method comprising:

obtaining an image of the images;

identifying areas of interest in the image;

segmenting the image into segments to obtain image segments;

classifying the image segments based on the areas of interest in the image to obtain image segment classifications corresponding to the image segments comprises at least, for an image segment of the image segments:

determining a first quantity of the image segment that falls within the areas of interest in the image and classifying the first quantity as a first portion of the image segment;

determining a second quantity of the image segment that falls outside of the areas of interest in the image and classifying the second quantity as a second portion of the image segment; and

obtaining an access likelihood value for the image segment by at least multiplying a size of the first portion by a first weight associated with the areas of interest and treating the second portion as having no value, wherein an image segment classification of the image segment is based on the access likelihood value and the image segment classification being one of the image segment classifications;

obtaining a storage tier allocation for each of the image segments on a corresponding image segment classification of the image segment classifications to obtain storage tier allocations; and

for each of the image segments, storing the image segment in a storage of a storage tier of the storage tiers, the storage tier of the storage tiers being based on a storage tier allocation of the storage tier allocations associated with the image.

2. The method of claim 1 , wherein each of the areas of interest in the image define a group of pixels of the image that are diagnostically relevant to a medical condition.

3. The method of claim 2 , wherein each of the areas of interest in the image are identified as part of a medical investigation into the medical condition, the medical investigation being performed by a subject matter expert.

4. The method of claim 3 , wherein the subject matter expert is an inference model or a medical professional.

5. The method of claim 1 , wherein storing the image segment in the storage comprises:

identifying an image fidelity level associated with the storage tier of the storage tiers;

conforming the image segment to the image fidelity level to obtain a conformed image segment; and

storing the conformed image segment in the storage.

6. The method of claim 5 , wherein each of the storage tiers has an associated image fidelity level.

7. The method of claim 1 , wherein each of the areas of interest in the image are identified as part of a medical investigation into the medical condition, the medical investigation being performed by a subject matter expert.

8. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for managing storage of images in different storage tiers, the operations comprising:

obtaining an image of the images;

identifying areas of interest in the image;

segmenting the image into segments to obtain image segments;

classifying the image segments based on the areas of interest in the image to obtain image segment classifications corresponding to the image segments comprises at least, for an image segment of the image segments:

determining a first quantity of the image segment that falls within the areas of interest in the image and classifying the first quantity as a first portion of the image segment;

determining a second quantity of the image segment that falls outside of the areas of interest in the image and classifying the second quantity as a second portion of the image segment; and

obtaining an access likelihood value for the image segment by at least multiplying a size of the first portion by a first weight associated with the areas of interest and treating the second portion as having no value, wherein an image segment classification of the image segment is based on the access likelihood value and the image segment classification being one of the image segment classifications;

obtaining a storage tier allocation for each of the image segments on a corresponding image segment classification of the image segment classifications to obtain storage tier allocations; and

for each of the image segments, storing the image segment in a storage of a storage tier of the storage tiers, the storage tier of the storage tiers being based on a storage tier allocation of the storage tier allocations associated with the image.

9. The non-transitory machine-readable medium of claim 8 , wherein each of the areas of interest in the image define a group of pixels of the image that are diagnostically relevant to a medical condition.

10. The non-transitory machine-readable medium of claim 9 , wherein each of the areas of interest in the image are identified as part of a medical investigation into the medical condition, the medical investigation being performed by a subject matter expert.

11. The non-transitory machine-readable medium of claim 10 , wherein the subject matter expert is an inference model or a medical professional.

12. The non-transitory machine-readable medium of claim 8 , wherein storing the image segment in the storage comprises:

identifying an image fidelity level associated with the storage tier of the storage tiers;

conforming the image segment to the image fidelity level to obtain a conformed image segment; and

storing the conformed image segment in the storage.

13. The non-transitory machine-readable medium of claim 8 , wherein each of the storage tiers has an associated image fidelity level.

14. A data processing system, comprising:

a processor; and

a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations for managing storage of images in different storage tiers, the operations comprising:

obtaining an image of the images;

identifying areas of interest in the image;

segmenting the image into segments to obtain image segments;

classifying the image segments based on the areas of interest in the image to obtain image segment classifications corresponding to the image segments comprises at least, for an image segment of the image segments:

determining a first quantity of the image segment that falls within the areas of interest in the image and classifying the first quantity as a first portion of the image segment;

determining a second quantity of the image segment that falls outside of the areas of interest in the image and classifying the second quantity as a second portion of the image segment; and

obtaining an access likelihood value for the image segment by at least multiplying a size of the first portion by a first weight associated with the areas of interest and treating the second portion as having no value, wherein an image segment classification of the image segment is based on the access likelihood value and the image segment classification being one of the image segment classifications;

obtaining a storage tier allocation for each of the image segments on a corresponding image segment classification of the image segment classifications to obtain storage tier allocations; and

for each of the image segments, storing the image segment in a storage of a storage tier of the storage tiers, the storage tier of the storage tiers being based on a storage tier allocation of the storage tier allocations associated with the image.

15. The data processing system of claim 14 , wherein each of the areas of interest in the image define a group of pixels of the image that are diagnostically relevant to a medical condition.

16. The data processing system of claim 15 , wherein each of the areas of interest in the image are identified as part of a medical investigation into the medical condition, the medical investigation being performed by a subject matter expert.

17. The data processing system of claim 16 , wherein the subject matter expert is an inference model or a medical professional.

18. The data processing system of claim 14 , wherein storing the image segment in the storage comprises:

identifying an image fidelity level associated with the storage tier of the storage tiers;

conforming the image segment to the image fidelity level to obtain a conformed image segment; and

storing the conformed image segment in the storage.

19. The data processing system of claim 18 , wherein each of the storage tiers has an associated image fidelity level.

20. The data processing system of claim 14 , wherein each of the areas of interest in the image are identified as part of a medical investigation into the medical condition, the medical investigation being performed by a subject matter expert.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2022
From: EZRIELEV, OFIR; SAVIR, AMIHAI; GEFEN, AVITAN; REINEKE, NICOLE
To: DELL PRODUCTS L.P.
Reel/Frame 060610/0110 →
Continuity (1)
Related Publication 20240029262A1 · Jan 25, 2024
References Cited (119)
US 6246804B1 · Sato et al. · 2001 [cited by applicant]
US 8576238B1 · Brandt · 2013 [cited by applicant]
US 8600143B1 · Kulkarni · 2013 [cited by examiner]
US 8862741B1 · Tegtmeier · 2014 [cited by applicant]
US 8873836B1 · Dietrich · 2014 [cited by examiner]
US 8935474B1 · Todd · 2015 [cited by examiner]
US 9324145B1 · Cherevatsky · 2016 [cited by examiner]
US 9665799B1 · Munteanu · 2017 [cited by applicant]
US 10109051B1 · Natesh · 2018 [cited by examiner]
US 11393575B1 · Ceballos Lentini · 2022 [cited by examiner]
US 11948687B2 · Jaber · 2024 [cited by examiner]
US 12144551B1 · Farley · 2024 [cited by examiner]
US 20010030667A1 · Kelts · 2001 [cited by applicant]
US 20040100476A1 · Morita · 2004 [cited by examiner]
US 20040101176A1 · Mendonca · 2004 [cited by examiner]
US 20040117358A1 · Von Kaenel et al. · 2004 [cited by applicant]
US 20060112334A1 · Endrikhovski · 2006 [cited by applicant]
US 20060159367A1 · Zeineh · 2006 [cited by examiner]
US 20070064981A1 · Meijer · 2007 [cited by applicant]
US 20070160274A1 · Mashiach · 2007 [cited by examiner]
US 20070263915A1 · Mashiach · 2007 [cited by examiner]
US 20080184068A1 · Mogi · 2008 [cited by applicant]
US 20080242968A1 · Claus · 2008 [cited by applicant]
US 20090074275A1 · O Ruanaidh · 2009 [cited by examiner]
US 20090210427A1 · Eidler · 2009 [cited by applicant]
US 20090290811A1 · Imai · 2009 [cited by examiner]
US 20110002555A1 · Sodagar · 2011 [cited by examiner]
US 20110110568A1 · Vesper · 2011 [cited by applicant]
US 20130022251A1 · Chen · 2013 [cited by examiner]
US 20130162664A1 · Peacock · 2013 [cited by applicant]
US 20140002466A1 · Paragios · 2014 [cited by applicant]
US 20150030231A1 · Porikli · 2015 [cited by examiner]
US 20150073909A1 · Peden · 2015 [cited by applicant]
US 20150134661A1 · Circlaeys · 2015 [cited by applicant]
US 20150278249A1 · Akiyama et al. · 2015 [cited by applicant]
US 20150332111A1 · Kisilev · 2015 [cited by examiner]
US 20160062689A1 · Cherubini · 2016 [cited by examiner]
US 20160284103A1 · Huang · 2016 [cited by examiner]
US 20170249744A1 · Wang · 2017 [cited by examiner]
US 20170273651A1 · Behrooz · 2017 [cited by examiner]
US 20180245979A1 · Park · 2018 [cited by examiner]
US 20180276815A1 · Xu · 2018 [cited by examiner]
US 20180315193A1 · Paschalakis · 2018 [cited by examiner]
US 20190011703A1 · Robaina · 2019 [cited by applicant]
US 20190244346A1 · Schafer · 2019 [cited by examiner]
US 20190333197A1 · Kask · 2019 [cited by examiner]
US 20200043600A1 · Glottmann · 2020 [cited by examiner]
US 20200092571A1 · Tourapis · 2020 [cited by examiner]
US 20200143171A1 · Lee · 2020 [cited by examiner]
US 20200175324A1 · Takahashi · 2020 [cited by examiner]
US 20200184252A1 · Syeda-Mahmood · 2020 [cited by examiner]
US 20200193608A1 · Sato · 2020 [cited by examiner]
US 20200193609A1 · Dharur · 2020 [cited by examiner]
US 20200234451A1 · Holzer · 2020 [cited by applicant]
US 20200285880A1 · Sedai · 2020 [cited by examiner]
US 20200342595A1 · Jia · 2020 [cited by examiner]
US 20200372718A1 · Molyneaux · 2020 [cited by applicant]
US 20200373013A1 · Cao · 2020 [cited by examiner]
US 20200410669A1 · Psota · 2020 [cited by examiner]
US 20200411164A1 · Donner · 2020 [cited by applicant]
US 20210035342A1 · Glaser · 2021 [cited by examiner]
US 20210068778A1 · Morley · 2021 [cited by examiner]
US 20210073449A1 · Segev · 2021 [cited by applicant]
US 20210090261A1 · Sugimoto · 2021 [cited by examiner]
US 20210142559A1 · Yousefhussien · 2021 [cited by examiner]
US 20210150682A1 · Sytnik · 2021 [cited by applicant]
US 20210209488A1 · Li · 2021 [cited by applicant]
US 20210223150A1 · Yoon · 2021 [cited by examiner]
US 20210233213A1 · Mejjati · 2021 [cited by applicant]
US 20210295528A1 · Fuchs · 2021 [cited by examiner]
US 20210345955A1 · Jones · 2021 [cited by examiner]
US 20210366145A1 · Yamamoto · 2021 [cited by examiner]
US 20210374965A1 · Richter · 2021 [cited by examiner]
US 20210383242A1 · Ostyakov · 2021 [cited by applicant]
US 20210383535A1 · Li · 2021 [cited by examiner]
US 20220076411A1 · Georgescu · 2022 [cited by examiner]
US 20220091259A1 · Hucks · 2022 [cited by examiner]
US 20220101533A1 · Hufford · 2022 [cited by examiner]
US 20220116549A1 · Neofytou · 2022 [cited by applicant]
US 20220138931A1 · Palma · 2022 [cited by examiner]
US 20220138933A1 · Wang · 2022 [cited by examiner]
US 20220139531A1 · Wang · 2022 [cited by examiner]
US 20220147768A1 · Thermos · 2022 [cited by examiner]
US 20220157063A1 · Bronicki · 2022 [cited by examiner]
US 20220172464A1 · Ross · 2022 [cited by examiner]
US 20220284118A1 · Kaul · 2022 [cited by applicant]
US 20220284570A1 · Tan · 2022 [cited by examiner]
US 20220318995A1 · Chen · 2022 [cited by examiner]
US 20220343493A1 · Katekari · 2022 [cited by examiner]
US 20220354356A1 · Weeks · 2022 [cited by examiner]
US 20220358775A1 · Hantehzadeh · 2022 [cited by examiner]
US 20220391615A1 · Machefer · 2022 [cited by examiner]
US 20230051436A1 · Ahmad · 2023 [cited by examiner]
US 20230069310A1 · Myronenko · 2023 [cited by examiner]
US 20230206447A1 · Kobayashi et al. · 2023 [cited by applicant]
US 20230252638A1 · Hotson · 2023 [cited by examiner]
US 20230329607A1 · Huttunen · 2023 [cited by examiner]
US 20230340759A1 · Bruflodt · 2023 [cited by examiner]
US 20240029241A1 · Ezrielev · 2024 [cited by examiner]
US 20240029242A1 · Ezrielev · 2024 [cited by examiner]
US 20240029263A1 · Ezrielev · 2024 [cited by examiner]
US 20240249415A1 · Aslan · 2024 [cited by examiner]
WO 2008012717A2 · 2008 [cited by applicant]
WO 2010051037A1 · 2010 [cited by applicant]
WO 2015015341A1 · 2015 [cited by applicant]
WO 2017213244A1 · 2017 [cited by applicant]
WO 2022064409A1 · 2022 [cited by applicant]
WO 2022070528A1 · 2022 [cited by applicant]
Lena Oden, Comparing Data Staging Techniques for Large Scale Brain Images, Dec. 6, 2021, IEEE, 12 pages (Year: 2021). [cited by examiner]
Goodfellow, Ian J., et al. “Generative Adversarial Nets”, Departement d'informatique et de recherche operationnelle, Universite de Montreal, Montreal, QC H3C 3J7, Canada. arXiv:1406.2661v1 [stat.ML] Jun. 10, 2014. 9 pag… [cited by applicant]
Radford, Alec, et al. “Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks”, indico Research, Boston, MA. Under review as a conference paper at ICLR 2016. arXiv:1511.06434v2 [cs.… [cited by applicant]
Goodfellow, Ian, “NIPS 2016 Tutorial: Generative Adversarial Networks”, OpenAI. arXiv:1701.00160v4 [cs.LG] Apr. 3, 2017. 57 pages. [cited by applicant]
Allwardt, Vanessa, et al. “Translational Roadmap for the Organs-on-a-Chip Industry toward Broad Adoption”, Bioengineering 2020, 7, 112; Sep. 16, 2020. 27 pages. [cited by applicant]
Kilic, Tugba, et al. “Organs-on-chip monitoring: sensors and other strategies”, Microphysiological Systems, 2018; 2:5; Sep. 5, 2018. 32 pages. [cited by applicant]
“Causal Discovery from Spatio-Temporal Data with Applications to Climate Science”, Ebert-Uphoff, Imme, School of Electrical and Computer Engineering, Colorado State University, Fort Collins, CO; and Deng, Yi, School of … [cited by applicant]
ZEN Microscopy Software, “Your Complete Solution from Sample to Knowledge”, Zeiss; Carl Zeiss Microscopy GmbH, 07745 Jena, Germany. Jul. 2021. 28 pages. [cited by applicant]
ZEN Data Storage and Data Explorer, “Smart data management in life sciences”, Zeiss; updated: Oct. 2020; Carl Zeiss Microscopy GmbH, 07745 Jena, Germany; Oct. 2020. 4 pages. [cited by applicant]
Torfi, Amirsina, et al. “Differentially Private Synthetic Medical Data Generation using Convolutional GANs”, arXiv Submission Version. arXiv:2012.11774v1 [cs.LG] Dec. 22, 2020. 13 pages. [cited by applicant]
Vignesh Raghunath et al., “Mouse cursor movement and eye tracking data as an indicator of pathologists' attention when viewing digital whole slide images”, J Pathol Inform, 2012, vol. 3, No. 43 (8 pages). [cited by applicant]