Surgical system with voice control
View Patent ↗A surgical system includes a plurality of voice sensors located in a surgical environment and configured to detect sound and generate a first plurality of signals. The surgical system also includes a position indicator, in proximity to a designated user, configured to indicate a first position of the designated user and generate a second signal representative of the first position. The surgical system further includes a processor configured to receive the first plurality of signals and the second signal and determine, based on the first plurality of signals, a second position. The processor is also configured to compare the detected sound with registered voice command of the designated user stored in a memory to verify the designated user's credentials, and send a command signal to a surgical instrument to carry out an operation related to the voice command based on at least one of the verification of the designated user's credentials, the first position and the second position.
1. A surgical system, comprising:
a plurality of voice sensors located in a surgical environment and configured to detect sound and generate a first plurality of signals;
a position indicator, in proximity to a designated user, configured to indicate a first position of the designated user and generate a second signal representative of the first position; and
a processor configured to:
receive the first plurality of signals generated by the voice sensors and the second signal,
determine, based on the first plurality of signals, a second position,
compare the detected sound with a registered voice command of the designated user stored in a memory to verify the designated user's credentials, and
send a command signal to a surgical instrument to carry out an operation related to the voice command based on at least one of the verification of the designated user's credentials, the first position, and the second position.
2. The system of claim 1 , wherein the detected sound is a voice command generated by the designated user.
3. The system of claim 2 , wherein the voice command is detected by at least one voice sensor in a headset worn by the designated user.
4. The system of claim 3 , wherein the headset includes a camera configured to detect a motion of lips of the designated user during the generation of the voice command and to send a signal related to the detected motion of lips to the processor.
5. The system of claim 4 , wherein the processor is configured to determine whether the detected motion of lips of the designated user matches the generated voice commands and to send the command signal when the detected motion of lips of the designated user matches the generated voice commands.
6. The system of claim 2 , wherein the voice command is detected by at least one voice sensor disposed on the surgical instrument.
7. The system of claim 1 , wherein the second position is determined based on one or more delays in detection of the sound by one or more of the plurality of voice sensors.
8. The system of claim 1 , wherein the processor is configured to send the command signal when the difference between the first position and the second position is less than a predetermined value.
9. The system of claim 1 , wherein the processor is configured to compare the detected sound with the registered voice command using a voice recognition algorithm.
10. The system of claim 1 , wherein the surgical instrument includes a switch and the surgical instrument carries out the operation related to the voice command when the switch is actuated.
11. The system of claim 1 , wherein the processor is configured to send the command signal based on at least two of the verification of the designated user's credentials, the first position, and the second position.
12. A robotic surgical system, comprising:
a robotic arm;
a tool assembly removably coupled to the robotic arm and comprising a shaft extending distally from a housing and an end effector coupled to a distal end of the shaft, the end effector being configured to treat tissue;
a plurality of voice sensors located in a surgical environment housing the robotic arm and configured to detect sound and generate a first plurality of signals;
a position indicator, in proximity to a designated user, configured to indicate a first position of the designated user and generate a second signal representative of the first position; and
a processor configured to:
receive the first plurality of signals generated by the voice sensors and the second signal,
determine, based on the first plurality of signals, a second position,
compare the detected sound with a registered voice command of the designated user stored in a memory to verify the designated user's credentials, and
send a command signal to the tool assembly to carry out an operation related to the voice command based on at least one of the verification of the designated user's credentials, the first position, and the second position.
13. The robotic surgical system of claim 12 , wherein the second position is determined based on one or more delays in detection of the sound by one or more of the plurality of voice sensors.
14. A method of controlling a surgical instrument, comprising:
detecting, by a plurality of voice sensors, sound produced in a surgical environment;
generating, by the voice sensors, a first plurality of signals;
indicating, by a position sensor, a first position associated with a designated user;
determining, based on the first plurality of signals, a second position;
comparing the detected sound with registered voice commands stored in a memory to verify the designated user's credentials; and
enabling a surgical instrument to carry out an operation related to the voice command based on at least one of the verification of the user's credential, the first position, and the second position.
15. The method of claim 14 , further comprising registering the designated user's voice.
16. The method of claim 15 , wherein the registered voice is stored in memory.
17. The method of claim 14 , wherein the second position is determined based on one or more delays in detection of the sound by one or more of the plurality of voice sensors.
18. The method of claim 14 , wherein the processor sends the command signal when the difference between the first position and the second position is less than a predetermined value.
19. The method of claim 14 , wherein the processor sends the command signal based on at least two of the verification of the designated user's credentials, the first position, and the second position.