Systems and methods for master/tool registration and control for intuitive motion
A robotic system comprises an input device movable by an operator and a processing unit. An operator reference frame is defined relative to the operator. The processing unit is configured to present, to the operator, a first image of a first tool captured by an imaging device, receive, from the operator, a first indication that a first axis of the input device is aligned with a corresponding axis of the first tool in the first image, and in response to the first indication, determine a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between the operator reference frame and the input device.
1. A robotic system comprising:
an input device movable by an operator, wherein an operator reference frame is defined relative to the operator;
a processing unit including one or more processors, the processing unit configured to:
present, to the operator, a first image of a first tool captured by an imaging device;
receive, from the operator, a first indication that a first axis of the input device is aligned with a corresponding axis of the first tool in the first image; and
in response to the first indication, determine a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between the operator reference frame and the input device.
2. The robotic system of claim 1 , wherein the processing unit is further configured to:
present, to the operator, a marker controlled by the input device based on the second alignment relationship to assist the operator to provide the first indication.
3. The robotic system of claim 2 , wherein the marker includes a synthetic presentation of the first tool for the operator to overlay the marker with a shaft and an end effector of the first tool in the first image, or
wherein the marker has an elongated shape for the operator to match the marker with a shaft of the first tool in the first image.
4. The robotic system of claim 1 , further comprising:
a first base having a first manipulator for coupling to the imaging device; and
a second base physically separated from the first base having a second manipulator for coupling to the first tool;
wherein, to determine the first alignment relationship, the processing unit is configured to:
determine a base alignment relationship between the first base and the second base using the second alignment relationship between the operator reference frame and the input device; and
determine the first alignment relationship using the base alignment relationship.
5. The robotic system of claim 4 , wherein the base alignment relationship is determined with a first rotational parameter.
6. The robotic system of claim 4 , wherein the base alignment relationship is determined with a first translational parameter.
7. The robotic system of claim 4 , wherein, to determine the first alignment relationship, the processing unit is configured to:
determine an imaging frame transformation from an imaging device reference frame of the imaging device to a first base frame associated with the first base;
determine a tool frame transformation from a second base frame associated with the second base to a tool reference frame associated with the first tool; and
determine the first alignment relationship using the imaging frame transformation, the base alignment relationship, and the tool frame transformation.
8. The robotic system of claim 7 , wherein the imaging frame transformation is determined using one or more sensors positioned along a first kinematic chain extending from the first base to the imaging device, or wherein the tool frame transformation is determined using one or more sensors positioned along a second kinematic chain extending from the second base to the first tool.
9. The robotic system of claim 1 , further comprising:
a first base having first and second manipulators,
wherein the first manipulator is configured to be coupled to the imaging device, and
wherein the second manipulator is configured to be coupled to the first tool.
10. A method comprising:
presenting, to an operator, a first image of a first tool captured by an imaging device;
receiving, from the operator, a first indication that a first axis of an input device movable by the operator is aligned with a corresponding axis of the first tool in the first image; and
in response to the first indication, determining a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between an operator reference frame and the input device,
wherein the operator reference frame is defined relative to the operator.
11. The method of claim 10 , further comprising:
presenting, to the operator, a marker controlled by the input device based on the second alignment relationship to assist the operator to provide the first indication.
12. The method of claim 11 , wherein the marker includes a synthetic presentation of the first tool for the operator to overlay the marker with a shaft and an end effector of the first tool in the first image, or
wherein the marker has an elongated shape for the operator to match the marker with a shaft of the first tool in the first image.
13. The method of claim 10 , wherein the determining the first alignment relationship comprises:
determining a base alignment relationship between a first base and a second base using the second alignment relationship between the operator reference frame and the input device,
wherein the first base has a first manipulator for coupling to the imaging device, and
wherein the second base is physically separated from the first base and has a second manipulator for coupling to the first tool.
14. The method of claim 13 , wherein the base alignment relationship is determined with a first rotational parameter.
15. The method of claim 13 , wherein the base alignment relationship is determined with a first translational parameter.
16. The method of claim 13 , wherein the determining the first alignment relationship includes:
determining an imaging frame transformation from an imaging device reference frame of the imaging device to a first base frame associated with the first base;
determining a tool frame transformation from a second base frame associated with the second base to a tool reference frame associated with the first tool; and
determining the first alignment relationship using the imaging frame transformation, the base alignment relationship, and the tool frame transformation.
17. A non-transitory machine-readable medium comprising a plurality of machine-readable instructions which, when executed by one or more processors, are adapted to cause the one or more processors to perform a method comprising:
presenting, to an operator, a first image of a first tool captured by an imaging device;
receiving, from the operator, a first indication that a first axis of an input device movable by the operator is aligned with a corresponding axis of the first tool in the first image; and
in response to the first indication, determining a first alignment relationship between the imaging device and the first tool based on a second alignment relationship between an operator reference frame and the input device,
wherein the operator reference frame is defined relative to the operator.
18. The machine-readable medium of claim 17 , wherein the method further comprises:
presenting, to the operator, a marker controlled by the input device based on the second alignment relationship to assist the operator to provide the first indication.
19. The machine-readable medium of claim 17 , wherein the determining the first alignment relationship comprises:
determining a base alignment relationship between a first base and a second base using the second alignment relationship between the operator reference frame and the input device,
wherein the base alignment relationship is determined with a first rotational parameter,
wherein the first base has a first manipulator for coupling to the imaging device, and
wherein the second base is physically separated from the first base and has a second manipulator for coupling to the first tool.
20. The machine-readable medium of claim 17 , wherein the determining the first alignment relationship comprises:
determining a base alignment relationship between a first base and a second base using the second alignment relationship between the operator reference frame and the input device,
wherein the base alignment relationship is determined with a first translational parameter,
wherein the first base has a first manipulator for coupling to the imaging device, and
wherein the second base is physically separated from the first base and has a second manipulator for coupling to the first tool.