Voice-controlled surgical system
Certain aspects of the present disclosure provide a voice-controlled system for controlling devices and systems in a surgical setting. The voice-controlled system includes at least one microphone and at least one loudspeaker distributed within the surgical setting to receive and audibly respond to voice commands from operating staff. In certain aspects, the at least one microphone and at least one loudspeaker include a phased microphone array and a phased loudspeaker array that are coordinated and synchronized to perform active noise reduction, echo cancellation, and directional determination of sound sources. The voice-controlled system performs tasks, such as activation of surgical devices, based on verbal interactions with the operating staff through the at least one microphone and at least one loudspeaker. In certain aspects, the voice-controlled system is configured to recognize, decipher, and prioritize natural language commands from different operating staff, and further provides pre-programming of device settings and operating staff pre-sets.
1. A surgical command system, comprising:
one or more microphones coupled to a processor and configured to convert sound waves within a surgical operating environment to one or more audio input signals;
one or more loudspeakers coupled to the processor and configured to generate sound waves within the surgical operating environment based on one or more audio output signals received directly or indirectly from the processor;
a memory comprising executable instructions; and
the processor in data communication with the memory and configured to execute the instructions to cause the surgical command system to:
receive directly or indirectly the one or more audio input signals from the one or more microphones;
identify one or more speech commands in the one or more audio input signals;
map at least one of the one or more speech commands to a user in the surgical operating environment;
identify one or more actions associated with the at least one of the one or more speech commands;
indicate the one or more actions to a surgical device to cause the surgical device to perform the one or more actions;
cause the one or more audio output signals to be produced based on the one or more actions; and
cause the one or more loudspeakers to generate outgoing speech responses based on the one or more audio output signals.
2. The surgical command system of claim 1 , wherein the surgical command system is further configured to determine a location of a source of the one or more speech commands in the one or more audio input signal.
3. The surgical command system of claim 2 , wherein the location of the source is utilized to map the one or more speech commands to the user.
4. The surgical command system of claim 1 , wherein the surgical command system is further caused by the processor to actively reduce continuous ambient noise in the one or more audio input signals from the one or more microphones.
5. The surgical command system of claim 1 , wherein the surgical command system is further caused by the processor to perform echo cancellation on the one or more audio input signals from the one or more microphones.
6. The surgical command system of claim 1 , wherein the one or more actions comprise one or more of a surgical device selection, mode selection, and task selection.
7. The surgical command system of claim 1 , wherein the one or more actions are identified at least partially based on a user profile associated with the user and accessible to the processor.
8. The surgical command system of claim 7 , wherein the user profile comprises mappings of different actions to different speech commands, and wherein the mappings include a mapping between one or more of the different actions and one or more of the different speech commands.
9. The surgical command system of claim 1 , wherein:
the processor being configured to map the at least one of the one or more speech commands to the user further comprises the processor being configured to map each of the one or more speech commands to a corresponding user in a group of users including the user,
the processor further configured to prioritize the at least one of the one or more speech commands and/or the one or more actions based on a predetermined hierarchy of the group of users, wherein the predetermined hierarchy indicates a higher rank for the user compared to other users associated with the one or more speech commands.
10. The surgical command system of claim 1 , wherein the outgoing speech response comprises an announcement of the one or more actions indicated to the surgical device.
11. The surgical command system of claim 10 , wherein the outgoing speech response is relayed from the one or more loudspeakers in a direction of the user mapped to the identified one or more speech commands.
12. The surgical command system of claim 1 , wherein the one or more loudspeakers include a plurality of loudspeakers arranged in a phased loudspeaker array.
13. The surgical command system of claim 12 , wherein the phased loudspeaker array is arranged to perform transmit beamforming for transmitting soundwaves within the surgical operating environment.
14. The surgical command system of claim 1 , the one or more microphones include a plurality of microphones arranged in a phased array microphone array.
15. The surgical command system of claim 14 , wherein the phased microphone array is arranged to perform receive beamforming for receiving soundwaves within the surgical operating environment.
16. The surgical command system of claim 1 , wherein the one or more microphones are located in a surgical mask worn by the user in the surgical operating environment.