System and method for establishing dental treatment environment
A system for establishing a dental treatment environment, includes: a head-mounted device provided at a dental clinic to be mounted on a patient's head, the head-mounted device having an image display unit and an ear-mounted speaker, a microphone for converting a sound including the voice of the medical staff in charge of the patient into an electric signal; a voice recognition module for recognizing the voice of the medical staff in charge from the electric sound input from the microphone; a content module storing multiple image contents for relaxing the patient mentally physically; a user interface having a content selection unit configured such that the patient can select a play content provided to the image display unit from the multiple image contents; and an output signal generating module for generating an output signal that is output to the head-mounted device.
1. A system for establishing a dental treatment environment, the system comprising:
a head-mounted device provided at a dental clinic to be mounted on a patient's head, the head-mounted device having an image display unit and an ear-mounted speaker;
a microphone for converting a sound including a voice of a medical staff in charge of the patient into an electric signal; and
a controller having a user interface, the controller comprising one or more units and modules being configured and executed by a processor using algorithm, the algorithm which when executed, causing the processor to perform functions using the one or more units and modules, the one or more units comprising:
a voice recognition module for recognizing the voice of the medical staff in charge from the electric sound input from the microphone;
a content module for storing a plurality of image contents with sound for relaxing the patient mentally and physically, and a plurality of characters;
a content selection unit and a character selection unit being included in the user interface, wherein the content selection unit is configured such that the patient is able to select a play content provided to the image display unit and the ear-mounted speaker from the plurality of image contents, wherein the character selection unit is configured such that the patient is able to select one of the plurality of characters: and
an output signal generating module for generating an output signal that is output to the head-mounted device,
wherein the output signal generating module stops outputting the play content and generates the output signal including a voice signal of the medical staff in charge through the selected character when the voice of the medical staff in charge is recognized from the voice recognition module while the output signal is generated from the play content,
wherein in response to a predetermined specific sound of the medical staff in charge being recognized while the play content is stopped, the output signal generating module stops outputting the voice signal of the medical staff in charge through the selected character and resumes outputting the play content.
2. The system of claim 1 , further comprising a camera for capturing an image of the patient's treatment situation during dental treatment and transmitting the captured image to the output signal generating module, and the output signal generating module outputs the image captured by the camera as the output signal.
3. The system of claim 1 , further comprising a preprocessing module for preprocessing an electric sound signal transmitted from the microphone to transmit the electric sound signal to the voice recognition module, wherein the preprocessing module comprises a low pass filter (LPF) for outputting a primary processed signal in which high-frequency noise is reduced from the electric sound signal transmitted from the microphone, a speech enhancement for removing background noise from the primary processed signal to output a secondary processed signal, and a dynamic range compressor (DRC) for outputting a third processed signal in which voice intelligibility is enhanced from the secondary processed signal using a dynamic range compression technique.
4. The system of claim 1 , wherein the voice recognition module recognizes the voice of the medical staff in charge using deep learning.
5. The system of claim 1 , wherein the head-mounted device further comprises a motion sensor for measuring movement of the ear-mounted device, and the output signal generating module generates an output signal output to the head-mounted device in response to the movement of the head-mounted device to be measured from the motion sensor.
6. The system of claim 5 , wherein the output signal output to the head-mounted device in response to the movement of the head-mounted device comprises a description image for a dental treatment operation being executed by the medical staff in charge and an image relaxing the patient mentally and physically.
7. A method for establishing a dental treatment environment using a system for establishing a dental treatment environment, the system comprising a head-mounted device provided at a dental clinic to be mounted on a patient's head, the head-mounted device having an image display unit and an ear-mounted speaker, a microphone for converting a sound including a voice of a medical staff in charge of the patient into an electric signal, and a controller having a user interface, the controller comprising one or more units and modules being configured and executed by a processor using algorithm, the algorithm which when executed, causing the processor to perform functions using the one or more units and modules, the one or more units comprising a voice recognition module for recognizing the voice of the medical staff in charge from the electric sound input from the microphone, a content module for storing a plurality of image contents with sound for relaxing the patient mentally and physically, and a plurality of characters, a content selection unit and a character election unit being included in the user inter face, the content selection unit is configured such that the patient is able to select a play content provided to the image display unit and the ear-mounted speaker from the plurality of image contents, wherein the character selection unit is configured such that the patient is able to select one of the plurality of characters, and an output signal generating module for generating an output signal that is output to the head-mounted device, the method comprising:
an image selecting operation of selecting the play content provided to the image display unit and the ear-mounted speaker among the plurality of image contents through the content selection unit of the user interface;
a character selecting operation of selecting one of the plurality of characters through the character selection unit;
an image outputting operation of outputting the play content selected in the image selecting operation to the image display unit and the ear-mounted speaker through the output signal generating module;
a voice recognition checking operation of checking whether a voice of the medical staff in charge is recognized through the voice recognition module while the play content is output in the image outputting operation;
a voice signal outputting operation of stopping the output of the play content and generating the output signal to output the voice of the medical staff in charge through the selected character through the output signal generating module when it is checked that a voice of the medical staff in charge is recognized in the voice recognition checking operation; and
an operation of stopping outputting the voice signal of the medical staff in charge through the selected character and resuming outputting the play content in response to a predetermined specific sound of the medical staff in charge being recognized while the play content is stopped.
8. The method of claim 7 , wherein the head-mounted device further comprises a motion sensor for measuring movement of the head-mounted device, the method further comprising an output signal generating operation of generating an output signal that is output to the head-mounted device in response to the movement of the head-mounted device measured by the motion sensor by using the output signal generating module.