Granted Patent B2

US 12,444,141 · App. 15/703,239 · Granted Oct 14, 2025

Inventors: John R. White (Winona Lake, IN); Seth Anderson Nash (Fort Wayne, IN); Annelise Galloway (Winona Lake, IN); Jody L. Claypool (Warsaw, IN); J. Scott Owens (East Sparta, OH)

Assignee: Zimmer, Inc.

G06T19/006A61B34/25A61B50/20A61B50/30A61B50/33A61B90/36A61B90/94A61B90/96A61B90/98G06F3/011G06F3/017G06F3/0304G06T11/00G06T11/003G06T11/60A61B34/10A61B2034/107A61B2034/252A61B2034/254A61B2034/256A61B50/00A61B2050/3008A61B2050/311A61B2090/365A63F2300/69G02B2027/0138G02B2027/014G02B27/017G06F3/014G06F3/016G09G2340/125

Abstract

Claims (15)

1. An augmented reality device for use during a surgical procedure comprising:

an augmented reality display, the augmented reality display including a head-mounted display lens allowing aspects of a surrounding environment to be visible while projecting light on the head-mounted display lens to make virtual elements visible to a wearer of the augmented reality display, the augmented reality display to:

present, within a surgical field while permitting the surgical field to be viewed through the augmented reality display, a virtual indication on the augmented reality display identifying a location of a physical surgical instrument among a plurality of surgical instruments present within the surgical field to be retrieved for use during a step within a surgical procedure, wherein the virtual indication is continuously maintained in a set position relative to and spatially registered with the location of the physical surgical instrument;

a processor to:

determine whether the physical surgical instrument within the surgical field has been moved; and

cause the virtual indication to be removed from the augmented reality display in response to determining that the physical surgical instrument has been moved and determining that the physical surgical instrument remains visible within in the field of view of the augmented reality display.

2. The augmented reality device of claim 1 , further comprising a detection device to identify the physical surgical instrument from at least one of: a plurality of surgical instruments, a box including the physical surgical instrument, and a tray including the physical surgical instrument.

3. The augmented reality device of claim 2 , wherein the detection device includes at least one of a camera, an optical imaging device, and an electronic identification device.

4. The augmented reality device of claim 1 , further comprising a proximity detector, a motion sensor, or a button on the physical surgical instrument to identify the physical surgical instrument.

5. The augmented reality device of claim 1 , wherein the augmented reality device is to notify a second augmented reality device to instruct a user to obtain the physical surgical instrument or to alert a user that the physical surgical instrument has been obtained.

6. The augmented reality device of claim 1 , wherein the augmented reality display is further to display at least a portion of a view from a second augmented reality device.

7. The augmented reality device of claim 1 , wherein the augmented reality display is to include patient information in a heads-up portion of the augmented reality display.

8. The augmented reality device of claim 1 , wherein the augmented reality display is to present a series of virtual components to provide instruction for assembly of the physical surgical instrument.

9. The augmented reality device of claim 8 , wherein the series of virtual components are displayed in progression automatically in response to the processor detecting, automatically using a detection device or based on a user input, that an operation corresponding to one of the series of virtual components is complete.

10. The augmented reality device of claim 1 , wherein the virtual indication is not visible to a viewer outside a room containing the surgical field.

Assignments (2)

Continuity (3)

References Cited (168)