Visual-tactile virtual telepresence
View Patent ↗A system for remote tactile telepresence wherein tactile telepresence sessions are time-coded along with audiovisual content wherein playback is heard, seen, and felt. Embodiments associate motion capture with the tactile profile so that remote, haptic recipients may see renderings of objects (e.g., hands) imparting vibrotactile sensations.
1. A method, comprising:
providing a registration module operable on a computer processor, the processor communicatively coupled to an electronic surface sensor detecting tactile input and an optical motion capture camera recording spatial pose data of a body part imposing the tactile input upon the electronic surface sensor;
recording to a first database store the tactile input and spatial pose data as a tactile-spatial gesture;
assigning a unique profile to the tactile-spatial gesture within the first database store;
invoking from a local network, the unique profile directed to a remotely located recipient having an affixed haptic device and electronic visual display;
receiving the unique profile at a remote network communicatively coupled to the haptic device and visual display;
querying the first database store from the remote network for tactile-spatial gesture assigned to the unique profile; and
applying the tactile-spatial gesture to the haptic device and electronic visual display at the recipient whereby the recipient feels the tactile mechanical force and sees a simulated rendering of the body part applying it.
2. The method of claim 1 wherein the electronic visual display is a two-dimensional monitor.
3. The method of claim 1 wherein the electronic visual display is an augmented reality head-mounted display.
4. The method of claim 1 wherein the electronic visual display is a virtual reality head-mounted display.
5. The method of claim 1 wherein the electronic surface sensor detecting tactile input is a sensor glove.
6. The method of claim 1 wherein the haptic device is a haptic glove.
7. The method of claim 1 wherein the body part is a hand.