Remote operation system
A remote operation system includes an edge device that contacts a target, a motion operation transmission device that receives an operator operation for operating the edge device and outputs motion transmission information to the edge device, and a visual presentation device that displays an image of the target and the edge device. The edge device-includes a haptic sensing device that detects a haptic sensation to the target, a haptic optical converter that converts the haptic sensation detected by the haptic sensing device into a light intensity signal specifying the intensity of light, and a light intensity-controlled light emitter that emits light of an intensity corresponding to the light intensity signal.
1 . A remote operation system comprising:
an edge device to contact a target;
processing circuitry configured as a motion operation transmission device to receive an operator operation for operating the edge device and output motion transmission information corresponding to the operator operation to the edge device; and
a visual display device to display an image of the target and the edge device, wherein the edge device includes a haptic sensing device to detect a haptic sensation to the target, and
wherein the edge device further includes
processing circuitry configured as a haptic optical converter that converts the haptic information output from the haptic sensing devices into light intensity signals, and
a light intensity-controlled light emitter attached to a distal end portion of the edge device that emits light of an intensity corresponding to the light intensity signals obtained by the haptic optical converter.
2 . The remote operation system according to claim 1 , further comprising:
an imaging device to image the target and the edge device;
the processing circuitry further configured as a vision-based sensory transmission device; and
the processing circuitry further configured as an active marker control device to generate an active marker control signal for generating a detectable marker and to generate marker information based on imaging information obtained by the imaging device, wherein
the edge device further includes
an active marker controlled by the active marker control signal generated by the active marker control device, and
the vision-based sensory transmission device
identifies a position of the active marker,
generates visual haptic image information indicating an image corresponding to haptic information indicating the haptic sensation detected by the haptic sensing device, and
superimposes marker point identification information obtained by a marker point identification function, the visual haptic image information obtained by a visual haptic image generation function, and the imaging information obtained by the imaging device.
3 . The remote operation system according to claim 2 , wherein
the haptic sensing device and the active marker provided to the edge device are attached to a distal end portion to contact the target.
4 . The remote operation system according to claim 1 , wherein
the edge device further includes
a haptic optical converter to convert the haptic sensation detected by the haptic sensing device into a signal specifying an intensity of light corresponding to a magnitude of the detected haptic sensation, and
a light intensity-controlled light emitter to emit light of an intensity corresponding to the signal obtained by the haptic optical converter.
5 . The remote operation system according to claim 4 , wherein
the haptic sensing device provided to the edge device is attached to a distal end portion to contact the target.
6 . A remote operation system comprising:
an edge device to contact a target;
processing circuitry configured as a motion operation transmission device to receive an operator operation for operating the edge device and output motion transmission information corresponding to the operator operation to the edge device; and
a visual display device to display an image of the target and the edge device, wherein the edge device includes a haptic sensing device to detect a haptic sensation to the target,
an imaging device to image the target and the edge device; and
the processing circuitry further configured as a vision-based sensory transmission device, wherein
the edge device further includes a passive marker, and
the vision-based sensory transmission device
identifies a position of the passive marker,
generates visual haptic image information indicating an image corresponding to haptic information indicating the haptic sensation detected by the haptic sensing device, and
superimposes marker point identification information obtained by a marker point identification function, the visual haptic image information obtained by a visual haptic image generation function, and imaging information obtained by the imaging device,
the edge device includes a plurality of the passive markers, and
the vision-based sensory transmission device estimates a marker point that has disappeared, based on the imaging information and the marker point identification information, when one of the passive markers has been hidden by the target and disappeared from the imaging information, and another passive marker is present in the imaging information.
7 . The remote operation system according to claim 6 , wherein
the haptic sensing device and the passive marker provided to the edge device are attached to a distal end portion to contact the target.
8 . The remote operation system according to claim 7 , wherein
the vision-based sensory transmission device generates marker filter information for filtering the passive marker detected.
9 . The remote operation system according to claim 8 , wherein
the vision-based sensory transmission device generates, based on the imaging information, haptic image pattern selection information for selecting a haptic image pattern that is easy for a person to recognize, and marker filter image selection information for selecting a naturally harmonious image.
10 . The remote operation system according to claim 7 , wherein
the vision-based sensory transmission device generates, based on the imaging information, haptic image pattern selection information for selecting a haptic image pattern that is easy for a person to recognize, and marker filter image selection information for selecting a naturally harmonious image.
11 . The remote operation system according to claim 7 , wherein
the vision-based sensory transmission device includes an edge device model memory to store geometric information on a point at which the edge device contacts the target.
12 . The remote operation system according to claim 6 , wherein
the vision-based sensory transmission device generates marker filter information for filtering the passive marker detected.
13 . The remote operation system according to claim 12 , wherein
the vision-based sensory transmission device generates, based on the imaging information, haptic image pattern selection information for selecting a haptic image pattern that is easy for a person to recognize, and marker filter image selection information for selecting a naturally harmonious image.
14 . The remote operation system according to claim 6 , wherein
the vision-based sensory transmission device generates, based on the imaging information, haptic image pattern selection information for selecting a haptic image pattern that is easy for a person to recognize, and marker filter image selection information for selecting a naturally harmonious image.
15 . The remote operation system according to claim 6 , wherein
the vision-based sensory transmission device includes an edge device model memory to store geometric information on a point at which the edge device contacts the target.