IP Library › Granted Patent US 12,254,133
Granted Patent B2
US 12,254,133 · App. 17/943,418 · Granted Mar 18, 2025

Method and system for the generation and management of tactile commands for tactile sensation

Inventors: Naveen Anand Gunalan (Marina del Rey, CA); Liza Knipscher (Marina del Rey, CA); James D. Hamilton (Marina del Rey, CA); Adam Elhadad (Marina del Rey, CA); Nathan E. Brummel (Marina del Rey, CA); Dustin Delmer (Marina del Rey, CA); Stephen Hodgson (Marina del Rey, CA); Elliot Mebane (Marina del Rey, CA); Shreyas Darshan (Marina del Rey, CA); David A. Wolfe (Marina del Rey, CA); Pete Moss (Marina del Rey, CA); Gregory Raab (Marina del Rey, CA)
Assignee: Emerge Now Inc.
G06F3/016G06F3/011G06T17/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,133
App. No.
17/943,418
Granted
Mar 18, 2025
Kind
B2
Abstract

A system for the generation and management of tactile sensation includes a computing subsystem. A method for the generation and management of tactile sensation includes receiving a set of inputs and processing the set of inputs. Additionally or alternatively, the method can include: communicating tactile commands to a tactile interface system; operating the tactile interface system based on the tactile commands; and/or performing any other suitable processes.

Claims (54)

1. A method for determining and generating tactile sensation, the method comprising:

receiving a first set of inputs from a first tracking subsystem, the first tracking subsystem in communication with a first tactile stimulation device, wherein the first set of inputs comprises a first set of locations associated with a first set of hands of a first user;

receiving a second set of inputs from a second tracking subsystem, the second tracking subsystem in communication with a second tactile stimulation device, wherein the second set of inputs comprises a second set of locations associated with a second set of hands of a second user;

processing the first set of inputs, wherein processing the first set of inputs comprises:

determining a set of distances between locations of the first set of inputs;

generating a set of comparisons based on the set of distances, wherein generating the set of comparisons comprises:

comparing at least a subset of the set of distances with a set of predetermined distance thresholds;

comparing at least a subset of the set of distances with other distances of the set of distances;

based on the set of comparisons, detecting that the first user is taking part in a predetermined hand gesture with the first set of hands;

determining a tactile effect and a visual effect based on the predetermined hand gesture, wherein the visual effect comprises an animation of a set of digital objects; and

conveying tactile sensation corresponding to the tactile effect at the second tactile stimulation device and the visual effect at a visual device for the second user, wherein features of the tactile sensation are determined based on at least one of the first and second sets of locations.

2. The method of claim 1 , wherein processing the first set of inputs further comprises determining at least one of:

a set of temporal parameters associated with the first set of locations;

a set of motion parameters associated with the first set of locations; and

an indication of whether or not the user is facing his hand.

3. The method of claim 1 , wherein a location in space of the tactile effect is determined at least in part based on the second set of locations.

4. The method of claim 3 , wherein the location in space is further determined based on the first set of locations.

5. The method of claim 3 , wherein the visual effect is determined based on the first set of locations.

6. The method of claim 1 , wherein the first and second sets of locations comprise locations of each of a set of predetermined anatomical landmarks associated with anatomy of a hand.

7. The method of claim 6 , wherein the set of predetermined anatomical landmarks comprises a set of tips of digits of the hand.

8. The method of claim 7 , wherein the set of predetermined anatomical landmarks further comprises a set of joints of the hand.

9. The method of claim 1 , wherein the first tracking subsystem is separate and distinct from the second tracking subsystem.

10. The method of claim 9 , wherein the first tracking subsystem is arranged remote from the second tracking subsystem.

11. A system for determining and generating tactile sensation, the system comprising:

a set of tactile stimulation devices, the set of tactile stimulation devices comprising:

a first tactile stimulation device in communication with a first tracking subsystem;

a second tactile stimulation device in communication with a second tracking subsystem;

a set of processing subsystems in communication with the first and second tactile stimulation devices, wherein the set of processing subsystems:

receive a first set of locations from the first tactile stimulation device, the first set of locations associated with a first user;

receive a second set of locations from the second tactile stimulation device, the second set of locations associated with a second user;

determine a set of distances based on the first set of locations and the second set of locations;

based on the set of distances, detecting that at least one of the first user and the second user has formed a predetermined hand gesture, wherein detecting that at least one of the first user and the second user has formed a predetermined hand gesture comprises generating a set of comparisons based on the set of distances, wherein generating the set of comparisons comprises:

comparing at least a subset of the set of distances with a set of predetermined distance thresholds; and

comparing at least a subset of the set of distances with other distances of the set of distances;

generate a tactile effect based on the predetermined hand gesture;

generate a set of tactile commands based on the tactile effect; and

a set of control subsystems in communication with the set of processing subsystems, wherein the set of control subsystems operate the set of tactile stimulation devices based on the set of tactile commands.

12. The system of claim 11 , wherein the first and second sets of locations comprise locations of each of a set of predetermined anatomical landmarks associated with anatomy of a hand.

13. The system of claim 12 , wherein the set of predetermined anatomical landmarks comprises a set of tips of digits of the hand.

14. The system of claim 13 , wherein the set of predetermined anatomical landmarks further comprises a set of joints of the hand.

15. A method for determining and generating tactile sensation, the method comprising:

receiving a first set of inputs from a first tracking subsystem, the first tracking subsystem in communication with a first tactile stimulation device, wherein the first set of inputs comprises a first set of locations associated with a first user;

receiving a second set of inputs from a second tracking subsystem, the second tracking subsystem in communication with a second tactile stimulation device, wherein the second set of inputs comprises a second set of locations associated with a second user;

processing the first set of inputs, wherein processing the first set of inputs comprises:

determining a set of distances between locations of the first set of inputs;

generating a set of comparisons based on the set of distances, comprising:

comparing at least a subset of the set of distances with a set of predetermined distance thresholds; and

comparing at least a subset of the set of distances with other distances of the set of distances;

based on the set of comparisons, detecting that the first user is taking part in a predetermined hand gesture;

determining a tactile effect based on the predetermined hand gesture; and

conveying tactile sensation corresponding to the tactile effect at the second tactile stimulation device wherein features of the tactile sensation are determined based on at least one of the first and second sets of locations.

16. The method of claim 15 , wherein the first and second sets of locations comprise locations of each of a set of predetermined anatomical landmarks associated with anatomy of a hand.

17. The method of claim 16 , wherein comparing at least a subset of the set of distances with other distances of the set of distances comprises comparing a first distance of the set of distances, the first distance corresponding to a distance between a first landmark location of a first digit and a second landmark location of a second digit, with a second distance of the set of distances, the second distance corresponding to a distance between the first landmark and a third landmark location of a third digit.

18. The method of claim 15 , wherein the predetermined hand gesture comprises at least one of: a pointing gesture, a heart formation gesture, a high five gesture, and a thumbs up gesture.

Assignments (4)
SECURITY INTEREST Recorded Sep 3, 2026
From: EMERGE NOW INC.
To: DAVID GRAN HOLDINGS INC.
Reel/Frame 075907/0632 →
SECURITY INTEREST Recorded Sep 2, 2026
From: EMERGE NOW INC.
To: NECTAR INVESTMENTS, LLC
Reel/Frame 075887/0610 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE 10TH INVENTOR'S NAME PREVIOUSLY RECORDED AT REEL: 061712 FRAME: 0621. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 11, 2022
From: GUNALAN, NAVEEN ANAND; KNIPSCHER, LIZA; HAMILTON, JAMES D.; ELHADAD, ADAM; BRUMMEL, NATHAN E.; DELMER, DUSTIN; HODGSON, STEPHEN; MEBANE, ELLIOT; DARSHAN, SHREYAS; WOLFE, DAVID A.; MOSS, PETE; RAAB, GREGORY
To: EMERGE NOW INC.
Reel/Frame 062320/0930 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2022
From: GUNALAN, NAVEEN ANAND; KNIPSCHER, LIZA; HAMILTON, JAMES D.; ELHADAD, ADAM; BRUMMEL, NATHAN E.; DELMER, DUSTIN; HODGSON, STEPHEN; MEBANE, ELLIOT; DARSHAN, SHREYAS; WOLFE, DAVID E.; MOSS, PETE; RAAB, GREGORY
To: EMERGE NOW INC.
Reel/Frame 061712/0621 →
Continuity (5)
Continuation In Part 17568592 · Jan 4, 2022
Continuation 17346912 · Jun 14, 2021
Provisional Application 63243416 · Sep 13, 2021
Provisional Application 63038236 · Jun 12, 2020
Related Publication 20230020835A1 · Jan 19, 2023
References Cited (32)
US 9898864B2 · Shapira · 2018 [cited by examiner]
US 11042028B1 · Welch · 2021 [cited by examiner]
US 11249553B2 · Hamilton et al. · 2022 [cited by applicant]
US 11850508B2 · Cieszkowski, III · 2023 [cited by examiner]
US 20120229401A1 · Birnbaum et al. · 2012 [cited by applicant]
US 20150192995A1 · Subramanian et al. · 2015 [cited by applicant]
US 20170212589A1 · Domenikos et al. · 2017 [cited by applicant]
US 20170220111A1 · Nakamura · 2017 [cited by examiner]
US 20170220112A1 · Nakamura et al. · 2017 [cited by applicant]
US 20180067557A1 · Robert et al. · 2018 [cited by applicant]
US 20180350203A1 · Cruz-Hernandez · 2018 [cited by examiner]
US 20180373335A1 · Seiler · 2018 [cited by applicant]
US 20190204917A1 · Rihn · 2019 [cited by applicant]
US 20190362216A1 · Stokes · 2019 [cited by examiner]
US 20200218338A1 · Lee · 2020 [cited by examiner]
US 20200218354A1 · Beattie · 2020 [cited by examiner]
US 20210089126A1 · Nickerson · 2021 [cited by applicant]
US 20210116990A1 · Song · 2021 [cited by examiner]
US 20210286432A1 · Ishikawa · 2021 [cited by examiner]
US 20220252881A1 · Wieczorek · 2022 [cited by examiner]
WO 2013160561A1 · 2013 [cited by applicant]
Huisman, “Social Touch Technology: A Survey of Haptic Technology for Social Touch”, (Year: 2016). [cited by examiner]
Long, Benjamin , “Rendering Volumetric Haptic Shapes in Mid-air using Ultrasound”, Department of Computer Science, University of Bristol, UK. [cited by applicant]
Sand, Antti , “Head-mounted Display with Mid-Air Tactile Feedback”, Department of Electronics, Tampere University of Technology P.O Box 692, 33101 Tampere, Finland. [cited by applicant]
Watanabe, Toshio , et al., “A Method for Controlling Tactile Sensation of Surface Roughness Using Ultrasonic Vibration”, IEEE, 1995. [cited by applicant]
Inoue , “Active Touch Perception Produced by Airborne Ultrasonic Haptic Hologram”, (Year: 2015). [cited by applicant]
Korres , “Haptogram: Ultrasonic Point-Cloud Tactile Stimulation”, (Year: 2016). [cited by applicant]
Matsubauashi , “Direct Finger Manipulation of 3D Object Image with Ultrasound Haptic Feedback”, (Year: 2019). [cited by applicant]
Kim, Yeongmi , et al., “A Tactile Glove Design and Authoring System for Immersive Media”, 2010. [cited by applicant]
Kim, Seung-Chan , et al., “Tactile Rendering of 3D Features on Touch Surfaces”, UIST'13, Oct. 8-11, 2013, St. Andrews, UK. [cited by applicant]
Martinez, Jonatan , et al., “Mid-Air Haptic Algorithms for Rendering 3D Shapes”, Research Gate, Conference Paper, Oct. 2019. [cited by applicant]
Otaduy, A. Miguel, et al., “Sensation Preserving Simplification for Haptic Rendering”, Department of Computer Science University of North Carolina at Chapel Hill (Year 2005). [cited by applicant]