IP Library Granted Patent US 12,243,206
Granted Patent B2
US 12,243,206 · App. 17/558,016 · Granted Mar 4, 2025

System and methods for qualifying medical images

Inventors: Michael D. Abramoff (University Heights, IA); Ben Clark (Cedar Rapids, IA); Eric Talmage (Byron Center, MI); John Casko (Iowa City, IA); Warren Clarida (Cedar Rapids, IA); Meindert Niemeijer (Coralville, IA); Timothy Dinolfo (Coralville, IA); Tay Stutts (Iowa City, IA)
Assignee: Digital Diagnostics Inc.
G06T7/0002G16H30/20G16H30/40G06T2207/10101G06T2207/30041G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,206
App. No.
17/558,016
Granted
Mar 4, 2025
Kind
B2
Abstract

Disclosed is a system for qualifying medical images submitted by user for diagnostic analysis comprising: an image input module, configured to receive one or more image input by a user; an image protocol conformation module, configured to receive the one or more images from the image input module, and further configured to analyze each of the one or more images for conformity with a predefined protocol and wherein images that do not conform to the predefined protocol are flagged as non-conforming images; an image output module, configured to identify to the user each of the one or more images flagged as non-conforming and prompting the user to resubmit a new image for each of the non-conforming images; and an image resubmission module, configured to receive the user resubmitted image and provide the resubmitted image to the image protocol conformation module.

Claims (46)

1. A system for qualifying medical images submitted by a user for diagnostic analysis comprising:

a non-transitory computer-readable medium comprising memory with instructions encoded thereon; and

one or more processors configured to, when executing the instructions, perform operations comprising:

receiving a plurality of retinal images input by a user, each of the plurality of retinal images capturing a different portion of a retina, each different portion of a retina corresponding to a respective predefined protocol requiring an anatomical object to be at a particular location within the respective retinal image, the respective predefined protocol being of a plurality of predefined protocols;

determining that a retinal image of the plurality of retinal images is a non-conforming image based on the retinal image not conforming to its respective predefined protocol, while determining that other ones of the plurality of retinal images conform to their respective predefined protocols;

generating for display a graphical interface to the user, the graphical interface comprising:

for each respective predefined protocol of the plurality of predefined protocols, a respective section comprising a description of the respective predefined protocol and an area for an image corresponding to the respective predefined protocol;

for each of the other ones of the plurality of retinal images that conform to their respective predefined protocols, a copy of the retinal respective retinal image in its respective area of its respective section;

for the retinal image that is determined to be a non-conforming image, omitting the retinal image from its respective section and instead including a generic placeholder cell in its respective area that excludes any retinal image;

receiving a resubmitted image; and

replacing the placeholder cell with the resubmitted image responsive to determining that the resubmitted image conforms to the respective predefined protocol corresponding to the captured portion of the retina.

2. The system of claim 1 , wherein each respective predefined protocol requires its respective anatomical object to be at a center within the respective image.

3. The system of claim 1 , wherein the anatomical object is an optic disk or a fovea.

4. The system of claim 1 , wherein each retinal image is at least one of a fundus camera image or an optical coherence tomography (OCT) image.

5. The system of claim 1 , wherein each respective protocol comprises one or more retinal image parameters including image quality, field size, and/or retinal coverage.

6. The system of claim 1 , wherein the operations further comprise guiding the user in selecting or generating the user resubmitted image that corrects the non-conformity of the non-conforming image.

7. The system of claim 6 , wherein the system is configured to perform the guiding iteratively through multiple candidate replacement images.

8. The system of claim 1 , wherein determining that the retinal image is a non-conforming image comprises implementing machine learning from example protocols and determining non-conformity with the respective predefined protocol based on output from the implemented machine learning.

9. The system of claim 1 , wherein determining that a retinal image is a non-conforming image comprises utilizing rule based heuristics.

10. The system of claim 1 , wherein the one or more processors are at least partially housed in a server.

11. A non-transitory computer-readable medium comprising memory with instructions encoded thereon for qualifying medical images submitted by a user for diagnostic analysis, the instructions, when executed, causing one or more processors to perform operations, the instructions comprising instructions to:

receive a plurality of retinal images input by a user, each of the plurality of retinal images capturing a different portion of a retina, each different portion of a retina corresponding to a respective predefined protocol requiring an anatomical object to be at a particular location within the respective retinal image, the respective predefined protocol being of a plurality of predefined protocols;

determine that a retinal image of the plurality of retinal images is a non-conforming image based on the retinal image not conforming to its respective predefined protocol, while determining that other ones of the plurality of retinal images conform to their respective predefined protocols;

generate for display a graphical interface to the user, the graphical interface comprising:

for each respective predefined protocol of the plurality of predefined protocols, a respective section comprising a description of the respective predefined protocol and an area for an image corresponding to the respective predefined protocol;

for each of the other ones of the plurality of retinal images that conform to their respective predefined protocols, a copy of the retinal respective retinal image in its respective area of its respective section;

for the retinal image that is determined to be a non-conforming image, omitting the retinal image from its respective section and instead including a generic placeholder cell that excludes any retinal image;

receive a resubmitted image; and

replace the placeholder cell with the resubmitted image responsive to determining that the resubmitted image conforms to the respective predefined protocol corresponding to the captured portion of the retina.

12. The non-transitory computer-readable medium of claim 11 , wherein each respective predefined protocol requires its respective anatomical object to be at a center within the respective image.

13. The non-transitory computer-readable medium of claim 11 , wherein the anatomical object is an optic disk or a fovea.

14. The non-transitory computer-readable medium of claim 11 , wherein each retinal image is at least one of a fundus camera image or an optical coherence tomography (OCT) image.

15. The non-transitory computer-readable medium of claim 11 , wherein each respective protocol comprises one or more retinal image parameters including image quality, field size, and/or retinal coverage.

16. A method for qualifying medical images submitted by a user for diagnostic analysis, the method comprising:

receiving a plurality of retinal images input by a user, each of the plurality of retinal images capturing a different portion of a retina, each different portion of a retina corresponding to a respective predefined protocol requiring an anatomical object to be at a particular location within the respective retinal image, the respective predefined protocol being of a plurality of predefined protocols;

determining that a retinal image of the plurality of retinal images is a non-conforming image based on the retinal image not conforming to its respective predefined protocol, while determining that other ones of the plurality of retinal images conform to their respective predefined protocols;

generating for display a graphical interface to the user, the graphical interface comprising:

for each respective predefined protocol of the plurality of predefined protocols, a respective section comprising a description of the respective predefined protocol and an area for an image corresponding to the respective predefined protocol;

for each of the other ones of the plurality of retinal images that conform to their respective predefined protocols, a copy of the retinal respective retinal image in its respective area of its respective section;

for the retinal image that is determined to be a non-conforming image, omitting the retinal image from its respective section and instead including a generic placeholder cell that excludes any retinal image;

receiving a resubmitted image; and

replacing the placeholder cell with the resubmitted image responsive to determining that the resubmitted image conforms to the respective predefined protocol corresponding to the captured portion of the retina.

17. The method of claim 16 , wherein the method further comprises guiding the user in selecting or generating the user resubmitted image that corrects the non-conformity of the non-conforming image.

18. The method of claim 17 , wherein further comprising performing the guiding iteratively through multiple candidate replacement images.

19. The method of claim 16 , wherein determining that the retinal image is a non-conforming image comprises implementing machine learning from example protocols and determining non-conformity with the respective predefined protocol based on output from the implemented machine learning.

20. The method of claim 16 , wherein determining that a retinal image is a non-conforming image comprises utilizing rule based heuristics.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2023
From: ABRAMOFF, MICHAEL D.; CLARK, BEN; TALMAGE, ERIC; CASKO, JOHN; CLARIDA, WARREN; NIEMEIJER, MEINDERT; DINOLFO, TIMOTHY; STUTTS, TAY
To: IDX, LLC
Reel/Frame 062663/0584 →
CHANGE OF NAME Recorded Feb 10, 2023
From: IDX, LLC
To: IDX TECHNOLOGIES INC.
Reel/Frame 062663/0620 →
CHANGE OF NAME Recorded Feb 10, 2023
From: IDX TECHNOLOGIES INC.
To: DIGITAL DIAGNOSTICS INC.
Reel/Frame 063027/0164 →
Continuity (3)
Continuation 15466636 · Mar 22, 2017
Provisional Application 62311660 · Mar 22, 2016
Related Publication 20220114719A1 · Apr 14, 2022
References Cited (30)
US 7532942B2 · Reiner · 2009 [cited by applicant]
US 10013639B1 · Schurman · 2018 [cited by examiner]
US 20040221855A1 · Ashton · 2004 [cited by examiner]
US 20050157848A1 · Miyauchi · 2005 [cited by examiner]
US 20060119622A1 · Kariathungal · 2006 [cited by examiner]
US 20060238546A1 · Handley · 2006 [cited by examiner]
US 20070237308A1 · Reiner · 2007 [cited by examiner]
US 20080044069A1 · DuGal · 2008 [cited by examiner]
US 20100021027A1 · Hartkens · 2010 [cited by examiner]
US 20100303363A1 · Fedorovskaya · 2010 [cited by examiner]
US 20110054266A1 · Dinino · 2011 [cited by examiner]
US 20110188718A1 · Hill · 2011 [cited by examiner]
US 20110242306A1 · Bressler · 2011 [cited by examiner]
US 20130182220A1 · Naba · 2013 [cited by examiner]
US 20130190600A1 · Gupta · 2013 [cited by examiner]
US 20130322711A1 · Schultz · 2013 [cited by examiner]
US 20140029828A1 · Schwartz · 2014 [cited by examiner]
US 20150029464A1 · Jayasundera · 2015 [cited by examiner]
US 20150104087A1 · Katuwal · 2015 [cited by examiner]
US 20160155229A1 · Shinoda · 2016 [cited by examiner]
WO WO2008050222A2 · 2008 [cited by examiner]
WO WO2014140258A2 · 2014 [cited by examiner]
Fairbanks, A. et al. “Ocular Ultrasound: A Quick Reference Guide for the On-Call Physician.” EyeRounds.org, Opthalmology and Visual Sciences, Feb. 4, 2016, 5 pages, [Online] [Retrieved Nov. 23, 2020], Retrieved from the… [cited by applicant]
United States Office Action, U.S. Appl. No. 15/466,636, Mar. 2, 2018, 12 pages. [cited by applicant]
United States Office Action, U.S. Appl. No. 15/466,636, Dec. 10, 2018, 15 pages. [cited by applicant]
United States Office Action, U.S. Appl. No. 15/466,636, Sep. 10, 2019, 10 pages. [cited by applicant]
United States Office Action, U.S. Appl. No. 15/466,636, Feb. 7, 2020, 10 pages. [cited by applicant]
United States Office Action, U.S. Appl. No. 15/466,636, Apr. 30, 2020, 11 pages. [cited by applicant]
United States Office Action, U.S. Appl. No. 15/466,636, Nov. 23, 2020, 10 pages. [cited by applicant]
United States Office Action, U.S. Appl. No. 15/466,636, Jul. 9, 2021, 12 pages. [cited by applicant]