Contact management mode for robotic imaging system using multiple sensors
A robotic imaging system includes a body with a head unit, a robotic arm and a coupling plate. A camera is positioned in the head unit and configured to record one or more images of a target site. The camera is operatively connected to one or more handles. A plurality of sensors is configured to transmit sensor data. The sensors include at least one primary sensor configured to detect respective force and/or respective torque applied at the body and at least one auxiliary sensor configured to detect the respective force and/or the respective torque applied at the one or more handles. A controller is configured to receive the sensor data and execute a contact management mode, including determining a contact location of the body with an external object based in part on the sensor data and determining a reverse trajectory for moving the body away from the contact location.
1 . A robotic imaging system comprising:
a body including a head unit, a robotic arm and a coupling plate coupling the head unit to the robotic arm, the robotic arm being adapted to selectively move the head unit;
a camera positioned in the head unit and configured to record one or more images of a target site, the camera being operatively connected to one or more handles;
a plurality of sensors configured to transmit sensor data, including:
at least one primary sensor configured to detect respective force and/or respective torque applied at the body, the at least one primary sensor being operatively coupled to the robotic arm; and
at least one auxiliary sensor configured to detect the respective force and/or the respective torque applied at the one or more handles, the at least one auxiliary sensor being operatively coupled to the one or more handles;
a controller configured to receive the sensor data, the controller having a processor and tangible, non-transitory memory on which instructions are recorded; and
wherein the controller is adapted to execute a contact management mode, including determining a contact location of the body with an external object based in part on the sensor data, and determining a reverse trajectory for moving the body away from the contact location.
2 . The robotic imaging system of claim 1 , wherein the camera is a stereoscopic camera configured to record a left image and a right image for producing at least one stereoscopic image of the target site.
3 . The robotic imaging system of claim 1 , wherein the plurality of sensors respectively includes a six-degrees-of-freedom haptic force-sensing device.
4 . The robotic imaging system of claim 1 , wherein the target site is an eye.
5 . The robotic imaging system of claim 1 , wherein the one or more handles include a first handle and a second handle rigidly affixed to and connected by a handlebar, the at least one auxiliary sensor being a single sensor positioned on the handlebar.
6 . The robotic imaging system of claim 1 , wherein the one or more handles include a first handle and a second handle, the at least one auxiliary sensor including a first auxiliary sensor affixed to the first handle and a second auxiliary sensor affixed to the second handle.
7 . The robotic imaging system of claim 1 , wherein the at least one primary sensor is located at a center point between the robotic arm and the camera.
8 . The robotic imaging system of claim 1 , wherein the plurality of sensors defines respective frames of reference, the controller being adapted to transform the respective frames of reference to a common frame.
9 . The robotic imaging system of claim 1 , wherein the controller is adapted to apply correction factors to the sensor data, including applying a low-pass filter.
10 . The robotic imaging system of claim 1 , wherein the controller is adapted to apply correction factors to the sensor data, including correcting for gravity for the plurality of sensors based on their respective location.
11 . The robotic imaging system of claim 1 , wherein the controller is adapted obtain a boundary plane extending through the contact location and perpendicular relative to a first direction.
12 . The robotic imaging system of claim 11 , wherein the reverse trajectory begins in a direction orthogonal to the boundary plane.
13 . The robotic imaging system of claim 12 , wherein the reverse trajectory is constrained to a surface of a virtual sphere.
14 . The robotic imaging system of claim 1 , wherein:
the sensor data provides a measured torque and a measured force at a measured location, the measured location and the contact location being connected by a displacement vector; and
the controller is adapted to determine the applied torque at the contact location as a difference between the measured torque and an applied force crossed with the displacement vector.
15 . A robotic imaging system comprising:
a body including a head unit, a robotic arm and a coupling plate coupling the head unit to the robotic arm, the robotic arm being adapted to selectively move the head unit;
a camera positioned in the head unit and configured to record one or more images of a target site, the camera being operatively connected to one or more handles;
a plurality of sensors configured to transmit sensor data, including:
at least one primary sensor configured to detect respective force and/or respective torque applied at the body, the at least one primary sensor being operatively coupled to the robotic arm; and
at least one auxiliary sensor configured to detect the respective force and/or the respective torque applied at the one or more handles, the at least one auxiliary sensor being operatively coupled to the one or more handles;
a controller configured to receive the sensor data, the controller having a processor and tangible, non-transitory memory on which instructions are recorded; and
wherein the controller is adapted to execute a contact management mode, including:
obtaining a contact location of the body with an external object based in part on the sensor data;
obtaining a boundary plane extending through the contact location, the boundary plane being perpendicular to a reference axis; and
determining a reverse trajectory for the body to move away from the contact location.
16 . The robotic imaging system of claim 15 , wherein the one or more handles include a first handle and a second handle rigidly affixed to and connected by a handlebar, the at least one auxiliary sensor being a single sensor positioned on the handlebar.
17 . The robotic imaging system of claim 15 , wherein the one or more handles include a first handle and a second handle, the at least one auxiliary sensor including a first auxiliary sensor affixed to the first handle and a second auxiliary sensor affixed to the second handle.
18 . The robotic imaging system of claim 15 , wherein the reverse trajectory is constrained to a surface of a virtual sphere.