IP Library Granted Patent US 10,925,687
Granted Patent B2
US 10,925,687 · App. 16/510,040 · Granted Feb 23, 2021

System and method for optical axis calibration

Inventors: Gal Sela (Toronto, CA); Kamyar Abhari (Toronto, CA)
Assignee: Synaptive Medical Inc.
A61B90/361A61B34/20G06T7/80A61B2034/2057A61B2034/2065
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,925,687
App. No.
16/510,040
Granted
Feb 23, 2021
Kind
B2
Abstract

A method for calibrating an optical axis of a camera mounted to a movable structure is disclosed. The method includes: for each of two or more standoff distances for the camera: capture, using the camera, image data of a target marker while the movable structure is undergoing rotation about a fixed axis, the target marker being a grid of squares each including unique detectable features; determine a respective center of rotation based on the captured image data; determine a first axis which goes through the centers of rotation; and determine a transform between the first axis and a second axis through the center of output image of the camera.

Claims (31)

1. A method for calibrating an optical axis of a camera mounted to a movable structure, the method comprising:

for each of two or more standoff distances for the camera:

capture, using the camera, video data of a target marker while the movable structure is undergoing rotation about a fixed axis, the target marker being a grid of squares each including unique detectable features;

process the video data to identify unique identifiers associated with features of the grid squares;

identify a plurality of concentric tracking circles marked by the unique identifiers in the video frames as a result of rotation of the movable structure; and

determine a respective center of rotation based on the captured video data, the center of rotation being a center of the plurality of concentric tracking circles;

determine a first axis which goes through the centers of rotation;

determine a transform between the first axis and a second axis through the center of the camera screen; and

validating the calibration, wherein the validation is done by performing a rotation of the movable structure about the determined first axis at a standoff distance that is different from the two or more standoff distances and determining whether a distance between the center of rotation and the center of the camera screen is less than a threshold.

2. The method of claim 1 , wherein the movable structure is a robotic arm, and wherein the robotic arm is rotatable about a fixed wrist joint.

3. The method of claim 1 , wherein the two or more standoff distances are selected based on minimum and maximum focal lengths of optics of the camera.

4. The method of claim 1 , wherein the two or more standoff distances are selected from a range between 25 centimeters to 55 centimeters.

5. The method of claim 1 , wherein the validation further comprises measuring the distance in pixels between the center of the camera screen and the center of optical axis rotation.

6. The method of claim 1 , wherein the target marker comprises an Aruco marker.

7. An optical imaging system for imaging a target during a medical procedure, the system comprising:

a movable arm;

a camera mounted on the movable arm, the camera capturing a first image of the target; and

a processing unit for calibrating the camera, the processing unit being configured to:

for each of two or more standoff distances for the camera:

capture, using the camera, video data of a target marker while the movable arm is undergoing rotation about a fixed axis, the target marker being a grid of squares each including unique detectable features;

process the video data to identify unique identifiers associated with features of the grid squares;

identify a plurality of concentric tracking circles marked by the unique identifiers in the video frames as a result of rotation of the movable structure; and

determine a respective center of rotation based on the captured video data, the center of rotation being a center of the plurality of concentric tracking circles;

determine a first axis which goes through the centers of rotation;

determine a transform between the first axis and a second axis through the center of the camera screen; and

validate the calibration, wherein the validation is done by performing a rotation of the movable arm about the determined first axis at a standoff distance that is different from the two or more standoff distances and determining whether a distance between the center of rotation and the center of the camera screen is less than a threshold.

8. The optical imaging system of claim 7 , wherein the movable arm is a robotic arm, and wherein the robotic arm is rotatable about a fixed wrist joint.

9. The optical imaging system of claim 7 , wherein the two or more standoff distances are selected based on minimum and maximum focal lengths of optics of the camera.

10. The optical imaging system of claim 7 , wherein the two or more standoff distances are selected from a range between 25 centimeters to 55 centimeters.

11. The optical imaging system of claim 7 , wherein the validation further comprises measuring the distance in pixels between the center of the camera screen and the center of optical axis rotation.

12. The optical imaging system of claim 7 , wherein the target marker comprises an Aruco marker.

Assignments (4)
SECURITY INTEREST Recorded Jan 7, 2021
From: SYNAPTIVE MEDICAL INC.
To: ESPRESSO CAPITAL LTD.
Reel/Frame 054922/0791 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2020
From: SYNAPTIVE MEDICAL (BARBADOS) INC.
To: SYNAPTIVE MEDICAL INC.
Reel/Frame 054181/0599 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2020
From: SELA, GAL; ABHARI, KAMYAR
To: SYNAPTIVE MEDICAL (BARBADOS) INC.
Reel/Frame 054116/0991 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2020
From: SELA, GAL; ABHARI, KAMYAR
To: SYNAPTIVE MEDICAL (BARBADOS) INC.
Reel/Frame 053124/0650 →