IP Library › Granted Patent US 12,333,087
Granted Patent B2
US 12,333,087 · App. 18/047,256 · Granted Jun 17, 2025

Interactive 3D cursor

Inventors: Kathleen M. Douglas (Winter Park, FL); Robert E. Douglas (Winter Park, FL); David Byron Douglas (Winter Park, FL)
Assignee: D3D Technologies, Inc.
G06F3/0346A61B5/489A61B6/466G06F3/03543G06F3/04812G06F3/04842G06T7/0012G06T7/0014G06T7/62G06T19/00G06T19/006H04N13/183H04N13/344G06T2207/10072G06T2207/10081G06T2207/10104G06T2207/20104G06T2207/30096G06T2207/30204G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,087
App. No.
18/047,256
Filed
Oct 17, 2022
Granted
Jun 17, 2025
Kind
B2
Art Unit
2628
USPC
345/163
Abstract

An interactive 3D cursor facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image. The selected volume image may be transparency-adjusted and filtered to remove selected tissues from view. Qualitative and quantitative analysis of tissues in a selected volume may be performed. Location indicators, annotations, and registration markers may be overlaid on selected volume images.

Claims (56)

1. A method comprising:

generating a three-dimensional cursor that has a non-zero volume;

selecting a three-dimensional image volume designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the selected volume;

and

displaying the three-dimensional cursor including measurement markings that serve as constituent unit measurement indicators of a size of an element within the selected volume.

2. The method claim 1 , further comprising presenting a modified version of the selected volume.

3. The method of claim 2 wherein presenting the modified version of the selected volume comprises removing an un-selected volume of the three-dimensional image volume from view by making the un-selected volume transparent.

4. The method of claim 2 wherein presenting the modified version of the selected volume comprises subtracting an un-selected volume of the three-dimensional image volume from view by eliminating voxels comprising the un-selected volume.

5. The method of claim 2 wherein presenting the modified version of the selected volume comprises presenting inputted location indicators on the at least one edge, surface or side of the three-dimensional cursor.

6. The method of claim 2 wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting inputted annotations on the at least one edge, surface or side of the three-dimensional cursor.

7. The method of claim 1 further comprising changing the volume inside of the three-dimensional cursor by moving the three-dimensional cursor to a different position within the three-dimensional image.

8. The method of claim 1 further comprising changing the volume inside of the three-dimensional cursor by changing the three-dimensional cursor's shape.

9. The method of claim 1 further comprising presenting a statistical representation of the selected volume of the three-dimensional image to a user.

10. The method of claim 2 wherein presenting the modified version of the selected volume comprises presenting a subset of voxels with false color based on the subset of voxels' composition.

11. The method of claim 1 further comprising:

wherein said volume of said three-dimensional image is from a first imaging examination;

using the three-dimensional cursor for an additional imaging examination; and

wherein presenting the modified version of the selected volume comprises presenting volumetric changes of a structure within the three-dimensional cursor from said first imaging examination to said additional imaging examination with false color.

12. The method of claim 11 further comprising performing and presenting a quantitative analysis of said volumetric changes of the structure within the three-dimensional cursor.

13. The method of claim 1 further comprising:

wherein said volume of said three-dimensional image is from a first imaging examination;

using the three-dimensional cursor for an additional imaging examination; and

registering a structure using registration markers within the three-dimensional cursor at the first imaging examination with the structure within the three-dimensional cursor of the additional imaging examination.

14. The method of claim 13 further comprising automatically calculating volumetric change of the structure based on the registration markers.

15. The method of claim 13 further comprising automatically re-orienting the selected volume based on the registration markers.

16. The method of claim 2 further comprising presenting the modified version of the selected volume inside the three-dimensional cursor in an augmented reality headset.

17. The method of claim 1 further comprising:

wherein the selecting is responsive to a user input; and

wherein the presenting is automatic.

18. The method of claim 1 further comprising:

wherein the selecting is responsive to a user input; and

wherein the presenting is responsive to said user input.

19. The method of claim 1 further comprising

wherein the selecting is automatic; and

wherein the presenting is automatic.

20. The method of claim 1 further comprising

wherein the selecting is automatic; and

wherein the presenting is responsive to said user input.

21. An apparatus comprising:

a headset;

a computing device; and

a human-machine interface comprising a three-dimensional cursor that has a non-zero volume;

the human-machine interface configured to select a three-dimensional image volume designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the selected volume responsive to an input; and

the human-machine interface configured to display the three-dimensional cursor including measurement markings that serve as constituent unit measurement indicators of a size of an element within the selected volume.

22. A non-transitory computer-readable medium storing instructions that, when executed, cause performance of:

generating a three-dimensional cursor that has a non-zero volume;

selecting a three-dimensional image volume designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the selected volume; and

displaying the three-dimensional cursor with measurement markings that serve as constituent unit measurement indicators of a size of an element within the selected volume.

23. The method of claim 1 , wherein displaying comprises displaying the three-dimensional cursor with measurement markings on at least one edge, surface or side of the three-dimensional cursor.

24. The apparatus of claim 21 , wherein displaying comprises displaying the three-dimensional cursor with measurement markings on at least one edge, surface or side of the three-dimensional cursor.

25. The computer-readable medium of claim 22 , wherein displaying comprises displaying the three-dimensional cursor with measurement markings on at least one edge, surface or side of the three-dimensional cursor.

26. The computer-readable medium of claim 22 , wherein the measurement markings enable a viewer to determine a total measurement of the selected volume.

27. The computer-readable medium of claim 22 , wherein the measurement markings include first markings representing a first magnitude and second markings representing a second magnitude different from the first magnitude.

28. The computer-readable medium of claim 22 , wherein the measurement markings serve as constituent unit measurement indicators of only a size of the three-dimensional cursor or one or more respective sizes of one or more elements within the cursor.

29. The computer-readable medium of claim 22 , wherein the measurement markings serve as constituent unit measurement indicators of only one or more respective sizes of one or more elements within the cursor.

30. The computer-readable medium of claim 22 , wherein the measurement markings are not placed outside the cursor.

Assignments (1)
CONFIRMATORY ASSIGNMENT Recorded Oct 27, 2023
From: DOUGLAS, KATHLEEN MARY; DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON
To: D3D TECHNOLOGIES, INC.
Reel/Frame 065382/0477 →
Continuity (5)
Continuation 17339341 · Jun 4, 2021
Continuation 17122518 · Dec 15, 2020
Continuation 17021548 · Sep 15, 2020
Continuation 15878463 · Jan 24, 2018
Related Publication 20230341952A1 · Oct 26, 2023
References Cited (67)
US 5371778A · Yanof · 1994 [cited by examiner]
US 5488952A · Schoolman · 1996 [cited by applicant]
US 6692441B1 · Poland · 2004 [cited by examiner]
US 8384771B1 · Douglas · 2013 [cited by applicant]
US 9600929B1 · Young · 2017 [cited by examiner]
US 10795457B2 · Douglas et al. · 2020 [cited by applicant]
US 20030142144A1 · Balakrishnan · 2003 [cited by examiner]
US 20120306849A1 · Steen · 2012 [cited by examiner]
US 20130245375A1 · DiMaio et al. · 2013 [cited by applicant]
US 20160246923A1 · Rooyen et al. · 2016 [cited by applicant]
US 20180232951A1 · Alterovitz · 2018 [cited by examiner]
WO 2007059477A2 · 2007 [cited by applicant]
IPR2021-00647 Final Written Decision in [cited by applicant]
IPR2021-00647 Petition for Inter Partes Review of U.S. Pat. No. 8,384,771 Pursuant to 35 U.S.C. §§ 311-319, 37 C.F.R. § 42; United States Patent and Trademark Office—Before the Patent Trial and Appeal Board, Case No. IP… [cited by applicant]
IPR2021-00647 Petitioner's Reply to Patent Owner's Response in [cited by applicant]
IPR2021-01325 Final Written Decision Determining Some Challenged Claim Unpatentable in [cited by applicant]
IPR2021-01325 Petition for Inter Partes Review of U.S. Pat. No. 10,795,457 Pursuant to 35 U.S.C. §§ 311-319, 37 C.F.R. § 42; United States Patent and Trademark Office—Before the Patent Trial and Appeal Board, Case No. I… [cited by applicant]
IPR2021-01325 Petitioner's Reply to Patent Owner's Response in [cited by applicant]
Non-Final Office Action mailed Dec. 19, 2023 in U.S. Appl. No. 18/049,272 (193 pages). [cited by applicant]
Reissue U.S. Appl. No. 18/049,272, filed Oct. 24, 2022 (100 pages). [cited by applicant]
United States Court of Appeals for the Federal Circuit; Case No. 23-1011; Appeal from the United States Patent and Trademark Office, Patent Trial and Appeal Board in No. IPR2021-00647; [cited by applicant]
United States Court of Appeals for the Federal Circuit; Case No. 23-1462; Appeal from the United States Patent and Trademark Office, Patent Trial and Appeal Board in No. IPR2021-00878; [cited by applicant]
Defendant Microsoft Corporation's Fifth Supplemental Invalidity Contentions for [cited by applicant]
Defendant Microsoft Corporation's Fourth Supplemental Invalidity Contentions for [cited by applicant]
Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Defendant Microsoft Corporation's Second Supplemental Invalidity Contentions for [cited by applicant]
Defendant Microsoft Corporation's Supplemental Invalidity Contentions for [cited by applicant]
Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit A: “Moreira DA, Hage C, Luque Ef, ”3D Markup of Radiological Images in ePAD, A Web-Based Image Annotation Tool,“ 2015 IEEE 28th International Symposium on Computer-Based Medical Systems, 97-102 (2015)” from Defe… [cited by applicant]
Exhibit A-1: “U.S. Pat. No. 8,384,771 Invalidity Chart Based On The 3D Slicer Prior Art System” from Defendant Microsoft Corporation's Fifth Supplemental Invalidity Contentions for [cited by applicant]
Exhibit A-1: “U.S. Pat. No. 8,384,771 Invalidity Chart Based On The 3D Slicer Prior Art System” from Defendant Microsoft Corporation's Fourth Supplemental Invalidity Contentions for [cited by applicant]
Exhibit A-1: “U.S. Pat. No. 8,384,771 Invalidity Chart Based On the OSIRIX 2005 System” from Defendant Microsoft Corporation's Second Supplemental Invalidity Contentions for [cited by applicant]
Exhibit A-1: “U.S. Pat. No. 8,384,771 Invalidity Chart Based On The Siemens 3D Prior Art System” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit A-13: “U.S. Patent No. 9,349, 183 is Anticipated By and/or Rendered Obvious In View of Bauch” from Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Exhibit A-2: “U.S. Pat. No. 8,384,771 is Anticipated By and/or Rendered Obvious In View of Kniss” from Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Exhibit A-3: “U.S. Pat. No. 8,384,771 is Anticipated By and/or Rendered Obvious In View of Lima” from Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Exhibit A-4: “U.S. Pat. No. 8,384,771 is Anticipated By and/or Rendered Obvious In View of Tooyama” from Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Exhibit A-6: “U.S. Pat. No. 8,384,771 is Anticipated By and/or Rendered Obvious In View of Kratz” from Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Exhibit A-7: “U.S. Pat. No. 8,384,771 is Anticipated By and/or Rendered Obvious In View of Schoolman '952” from Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Exhibit A-8: “U.S. Pat. No. 9,349,183 is Anticipated By and/or Rendered Obvious In View of Schoolman '595” from Defendant Microsoft Corporation's Preliminary Invalidity Contentions for [cited by applicant]
Exhibit B: “U.S. Pat. No. 9,980,691 is Anticipated By and/or Rendered Obvious In View of Moreira” from Defendant Microsoft Corporation's Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-1: “International Application No. PCT/US2007/074689 to Anderson et al., filed on Jul. 30, 2007 (”Anderson“)” from Defendant Microsoft Corporation's Second Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-1: “U.S. Pat. No. 8,384,771 Invalidity Chart Based On the OSIRIX 2005 System” from Defendant Microsoft Corporation's Fifth Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-10: “U.S. Patent Publication No. 2004/0238732 A1 to State et al., issued May 11, 2010 (”State“)” from Defendant Microsoft Corporation's Second Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-2: “Ronald T. Azuma, ”A Survey of Augmented Reality“ In Presence: Teleoperators and Virtual Environments 6, 4 (Aug. 1997) (”Azuma“)” from Defendant Microsoft Corporation's Second Supplemental Invalidity Conten… [cited by applicant]
Exhibit B-3: “Siemens, Operating Instructions, InSpace3Dflash, Neurostar/Angiostar/Multistar T.O.P./ Plus” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-4: “Siemens, SCT and MR Workstation, The Power To See It All, 3DVirtuoso” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-5: “Siemens, 510(k) Summary, Siemens Realtime 3D Software Package” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-7: “OsiriX User Manual The Complete Reference, Revision 5.0.0 (Last Updated Apr. 24, 2017) (”User Manual“)” from Defendant Microsoft Corporation's Second Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-8: “OsiriX Quick Manual, Version 1.0 (”Quick Manual“)” from Defendant Microsoft Corporation's Second Supplemental Invalidity Contentions for [cited by applicant]
Exhibit B-9: “Antoine Rosset, MD et al., ”OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images“ (Sep. 2004) (”Rosset“)” from Defendant Microsoft Corporation's Second Supplemental Invalidity Co… [cited by applicant]
Exhibit C: “U.S. Pat. No. 10,795,457 Is Anticipated By and/or Rendered Obvious In View of Moreira” from Defendant Microsoft Corporation's Supplemental Invalidity Contentions for [cited by applicant]
Exhibit C-1: “U.S. Pat. No. 8,384,771 Invalidity Chart Based On the Siemens 3D Prior Art System” from Defendant Microsoft Corporation's Fifth Supplemental Invalidity Contentions for [cited by applicant]
Exhibit C-1: “U.S. Pat. No. 8,384,771 is Anticipated By and/or Rendered Obvious In View of the VIEW system” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit D-1: “S.S. Fisher, et al., Virtual Environment Display System, Proceedings of the 1986 workshop on Interactive 3D graphics, Jan. 1987, at 77, https://doi.org/10.1145/319120.319127” from Defendant Microsoft Corpo… [cited by applicant]
Exhibit D-10: “Scott Fisher, Telepresence in Dataspace NASA Ames VIEWlab, 1987, https://youtu.be/guOUfhoNhDY. (”1987 Demo“)” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit D-11: “Scott Fisher, NASA Ames VIEWlab VR demo reel 1989, https://youtu.be/3LON7CKvOBA (”1989 Demo“)” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit D-12: “ACM SIGCHI, View: The Ames Virtual Environment Workstation, https://youtu.be/HOE16KLnnSE (”1990 Demo“)” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit D-2: “S.S. Fisher, E.M. Wenzel, C. Coler, M.W. McGreevy, Virtual Interface Environment Workstations, 32 Proc. Hum. Factors Soc'y Ann. Meeting, Feb. 1988, at 91, http://doi.org/10.1177/154193128803200219” from De… [cited by applicant]
Exhibit D-3: “A New Continent of Ideas, Spinoff 1990, Jan. 1, 1990, at 88, https://ntrs.nasa.gov/citations/20020086961” from Defendant Microsoft Corporation's Third Supplemental Invalidity Contentions for [cited by applicant]
Exhibit D-4: “Scott S. Fisher, Virtual Environments, Personal Simulation & Telepresence, in Virtual Reality: Theory, Practice and Promise (S. Helsel and J.Roth, ed., Meckler Publishing, 1991)” from Defendant Microsoft C… [cited by applicant]
Exhibit D-5: “Steven D. Pieper et al., A Virtual Environment System for Simulation of Leg Surgery, Proc. SPIE 1457, Stereoscopic Displays and Applications II, Aug. 1, 1991, at 188, https://doi.org/10.1117/12.46307 (”Pie… [cited by applicant]
Exhibit D-6: “Richard H. Jacoby and Stephen R. Ellis, Using Virtual Menus in a Virtual Environment, Proc. SPIE 1668, Visual Data Interpretation, (Jun. 1, 1992); https://doi.org/10.1117/12.59654 (”Jacoby 1992“)” from Def… [cited by applicant]
Exhibit D-7: “Stephen R. Ellis, What Are Virtual Environments, 14 IEEE Computer Graphics & Applications, Jan. 1994, at 17, https://doi.org/10.1109/38.250914 (”Ellis 1994“)” from Defendant Microsoft Corporation's Third S… [cited by applicant]
Exhibit D-8: “Scott S. Fisher, The NASA Ames VIEWlab Project-A Brief History, 25 Presence 339 (2016), https://doi. org/10.1162/PRES_a_00277 (”Fisher 2016“)” from Defendant Microsoft Corporation's Third Supplemental Inva… [cited by applicant]
Exhibit D-9: “MDx media, NASA Ames—virtual environment display system, NASA's research into VR from the 1980s, https://youtu.be/gd6_eojjTMU (”1985 Demo“)” from Defendant Microsoft Corporation's Third Supplemental Invali… [cited by applicant]
Final Office Action mailed Aug. 23, 2024 in U.S. Appl. No. 18/049,272 (78 pages). [cited by applicant]
Cited By (1)
US 12,693,774