IP Library Granted Patent US 10,182,871
Granted Patent B2
US 10,182,871 · App. 15/601,800 · Granted Jan 22, 2019

Systems and methods for intra-operative image acquisition and calibration

Inventors: Noah D. Wollowick (Stamford, CT); Andrew J. Cooper (Largo, FL); Cameron Albert (Powhatan, VA)
Assignee: JointPoint, Inc.
A61B34/10A61B6/12A61B6/505G06F19/00G06F19/321G06T7/70G06T7/80G09G5/363A61B2034/108G06T2207/30004G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,182,871
App. No.
15/601,800
Granted
Jan 22, 2019
Kind
B2
Abstract

A system and method utilizing a camera device containing an inertial measuring unit or similar orientation mechanism to calibrate alignment of the camera device according to a primary image such as displayed on an imaging screen, and then utilizing this calibration data to guide the system or user in acquiring a spatially aligned digital image using the camera device. Steps include recording the spatial orientation of the camera in at least two spatial dimensions when aligned with the primary image, and guiding camera alignment relative to the imaging screen when taking a picture.

Claims (36)

1. A method for capturing a spatially aligned digital image of a primary image of anatomy of a patient, comprising:

selecting a primary image suitable for at least one of intraoperative surgical guidance and preoperative surgical planning;

selecting a computing device and a digital camera;

aligning the digital camera with the primary image;

determining and recording the spatial orientation of the digital camera in at least two axes, and communicating the spatial orientation to the computing device;

moving the digital camera away from the primary image until an acceptable field of view of the primary image is achieved; and

obtaining a digital image of the primary image after confirming that the digital camera is acceptably aligned spatially with the primary image, wherein the spatially aligned digital image is suitable for at least one of intraoperative surgical guidance and preoperative surgical planning.

2. The method of claim 1 wherein the primary image is displayed on a primary display screen, and aligning the digital camera includes placing the digital camera against the primary display screen.

3. The method of claim 1 wherein confirming that the digital camera is acceptably aligned spatially includes providing perceptible guidance to a user via a user interface to achieve acceptable alignment.

4. The method of claim 3 wherein the perceptible guidance includes visually representing real-time orientation of the digital camera relative to the at least two axes.

5. The method of claim 1 wherein spatial orientation is determined using an inertial measuring unit.

6. The method of claim 1 wherein the computing device is a portable computing device with integral digital camera.

7. A system capable of capturing a spatially aligned digital image from a primary image of anatomy of a patient, comprising:

a digital camera;

an orientation mechanism capable of determining the spatial orientation of the digital camera in at least two axes;

a computing device in communication with the digital camera and the orientation mechanism, the computing device having a user interface and including:

a device calibration module to guide a user to align the digital camera with the primary image;

a calibrated guidance module capable of interfacing with the orientation mechanism to determine and record the spatial orientation of the digital camera in at least two axes, and communicating the spatial orientation to the computing device; and an image acquisition module to guide the user to move the digital camera away from the primary image until an acceptable field of view of the primary image is achieved, and obtain a digital image of the primary image after confirming that the digital camera is acceptably aligned spatially with the primary image, wherein the spatially aligned digital image is suitable for at least one of intraoperative surgical guidance and preoperative surgical planning.

8. The system of claim 7 wherein the primary image is displayed on a primary display screen, and aligning the digital camera includes placing the digital camera against the primary display screen.

9. The system of claim 7 wherein confirming that the digital camera is acceptably aligned spatially includes providing perceptible guidance to a user via the user interface to achieve acceptable alignment.

10. The system of claim 9 wherein the perceptible guidance includes generating visually representations of real-time orientation of the digital camera relative to the at least two axes.

11. The system of claim 7 wherein spatial orientation is determined using an inertial measuring unit.

12. The system of claim 7 wherein the computing device is a portable computing device with integral digital camera and orientation mechanism.

13. A system capable of guiding a user to capture a spatially aligned digital image from a primary image of anatomy of a patient, comprising:

a digital camera;

an orientation mechanism capable of determining the spatial orientation of the digital camera in at least two axes;

a computing device having a user interface and a processor in communication with the digital camera and the orientation mechanism, wherein the processor is programmed to execute the following steps:

instructing a user to align the digital camera with the primary image;

determining and recording the spatial orientation of the digital camera in at least two axes, and communicating the spatial orientation to the computing device;

instructing the user to move the digital camera away from the primary image until an acceptable field of view of the primary image is achieved; and

confirming that the digital camera is acceptably aligned spatially with the primary image and signalling the user to obtain a digital image of the primary image, wherein the spatially aligned digital image is suitable for at least one of intraoperative surgical guidance and preoperative surgical planning.

14. The system of claim 13 wherein the primary image is displayed on a primary display screen, and aligning the digital camera includes placing the digital camera against the primary display screen.

15. The system of claim 13 wherein confirming that the digital camera is acceptably aligned spatially includes providing perceptible guidance to a user via the user interface to achieve acceptable alignment.

16. The system of claim 15 wherein the perceptible guidance includes generating visually representations of real-time orientation of the digital camera relative to the at least two axes.

17. The system of claim 13 wherein spatial orientation is determined using an inertial measuring unit.

18. The system of claim 13 wherein the computing device is a portable computing device with integral digital camera and orientation mechanism.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2019
From: JOINTPOINT INC.
To: DEPUY SYNTHES PRODUCTS, INC.
Reel/Frame 050628/0266 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2018
From: WOLLOWICK, NOAH D.; COOPER, ANDREW J.; ALBERT, CAMERON
To: JOINTPOINT, INC.
Reel/Frame 045707/0487 →
Continuity (2)
Provisional Application 62339926 · May 22, 2016
Related Publication 20170333134A1 · Nov 23, 2017
Cited By (5)
US 12,198,812 US 12,295,772 US 12,594,121 US 12,611,254 US 12,708,527