IP Library Granted Patent US 12,346,524
Granted Patent B2
US 12,346,524 · App. 18/077,226 · Granted Jul 1, 2025

Systems and methods for touch sensing

Inventor: Janos Rohaly (Concord, MA)
Assignee: Gelsight, Inc.
G06F3/042
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,346,524
App. No.
18/077,226
Granted
Jul 1, 2025
Kind
B2
Abstract

One embodiment is directed to a system for characterizing interaction between surfaces, comprising: a deformable transmissive layer coupled to an interface membrane, wherein the interface membrane is interfaced against at least one aspect of an interfaced object; a first illumination source operatively coupled to the deformable transmissive layer and configured to emit first illumination light into the deformable transmissive layer at a known first illumination orientation relative to the deformable transmissive layer, such that at least a portion of the first illumination light interacts with the deformable transmissive layer; a detector configured to detect light from within at least a portion of the deformable transmissive layer; and a computing system configured to operate the detector to detect at least a portion of light directed from the deformable transmissive layer, to determine surface orientations pertaining to positions along the interface membrane based at least in part upon interaction of the first illumination light with the deformable transmissive layer, and to utilize the determined surface orientations to characterize a geometric profile of the at least one aspect of the interfaced object as interfaced against the interface membrane.

Claims (34)

1. A system for characterizing interaction between surfaces, comprising:

a. a deformable transmissive layer coupled to an interface membrane, wherein the interface membrane is interfaced against at least one aspect of an interfaced object, the deformable transmissive layer comprising an elastomeric composite having a metal oxide pigment material distributed within an elastomeric matrix, the pigment material configured to provide an illumination reflectance which is greater than that of the elastomeric matrix;

b. a first illumination source operatively coupled to the deformable transmissive layer and configured to emit first illumination light into the deformable transmissive layer at a known first illumination orientation relative to the deformable transmissive layer, such that at least a portion of the first illumination light interacts with the deformable transmissive layer;

c. a detector configured to detect light from within at least a portion of the deformable transmissive layer; and

d. a computing system configured to operate the detector to detect at least a portion of light directed from the deformable transmissive layer, to determine surface orientations pertaining to positions along the interface membrane based at least in part upon interaction of the first illumination light with the deformable transmissive layer, and to utilize the determined surface orientations to characterize a geometric profile of the at least one aspect of the interfaced object as interfaced against the interface membrane.

2. The system of claim 1 , wherein the interface membrane is directly coupled between the deformable transmissive layer and the interfaced object.

3. The system of claim 1 , further comprising substantially rigid optical element positioned between the detector and the deformable transmissive layer.

4. The system of claim 3 , wherein the first illumination source is directly coupled to the substantially rigid optical element, and wherein the substantially rigid optical element is configured to distribute the first illumination light to the deformable transmissive layer.

5. The system of claim 3 , wherein the substantially rigid optical element is defined by a bottom surface, a top surface, and one or more sidewall surfaces, wherein the bottom surface is directly coupled to the deformable transmissive layer and the top surface is positioned most proximally adjacent to the detector.

6. The system of claim 5 , wherein the substantially rigid optical element comprises an outer shape substantially similar to one selected from the group consisting of: a cylindrical shape, a cubic shape, and a rectangular prismic shape.

7. The system of claim 5 , wherein the first illumination source is coupled to at least one of the one or more sidewall surfaces of the substantially rigid optical element.

8. The system of claim 1 , further comprising a second illumination source operatively coupled to the deformable transmissive layer and configured to emit second illumination light into the deformable transmissive layer at a known second illumination orientation relative to the deformable transmissive layer, such that at least a portion of the second illumination light interacts with the deformable transmissive layer.

9. The system of claim 8 , wherein the detector is further configured to detect light from within at least a portion of the deformable transmissive layer based upon both the first illumination light and second illumination light, and wherein the computing system is configured to operate the detector to detect at least a portion of the first and second illumination light directed from the deformable transmissive layer, to determine surface orientations pertaining to positions along the interface membrane based at least in part upon interaction of the first and second illumination light with the deformable transmissive layer, and to utilize the determined surface orientations to characterize a geometric profile of the at least one aspect of the interfaced object as interfaced against the interface membrane.

10. The system of claim 8 , wherein the second illumination light and first illumination light have different wavelengths.

11. The system of claim 8 , wherein the second illumination light and first illumination light have different polarization.

12. The system of claim 9 , further comprising a third illumination source operatively coupled to the deformable transmissive layer and configured to emit third illumination light into the deformable transmissive layer at a known third illumination orientation relative to the deformable transmissive layer, such that at least a portion of the third illumination light interacts with the deformable transmissive layer.

13. The system of claim 10 , wherein the detector is further configured to detect light from within at least a portion of the deformable transmissive layer based upon each of the first, second, and third illumination light, and wherein the computing system is configured to operate the detector to detect at least a portion of the first, second, and third illumination light directed from the deformable transmissive layer, to determine surface orientations pertaining to positions along the interface membrane based at least in part upon interaction of the first, second, and third illumination light with the deformable transmissive layer, and to utilize the determined surface orientations to characterize a geometric profile of the at least one aspect of the interfaced object as interfaced against the interface membrane.

14. The system of claim 10 , wherein each of the first, second, and third illumination light have different wavelengths.

15. The system of claim 10 , wherein the first, second, and third illumination light do not all have the same polarization.

16. The system of claim 1 , wherein the first illumination source comprises a light emitting diode.

17. The system of claim 1 , wherein the detector is a photodetector.

18. The system of claim 1 , wherein the detector is an image capture device.

19. The system of claim 18 , wherein the image capture device is a CCD or CMOS device.

20. The system of claim 1 , further comprising a lens operatively coupled between the detector and the deformable transmissive layer.

21. The system of claim 1 , wherein the computing system is operatively coupled to the detector and configured to receive information from the detector pertaining to light detected by the detector from within the deformable transmissive layer.

22. The system of claim 1 , wherein the computing system is operatively coupled to the first illumination source and is configured to control emissions from the first illumination source.

23. The system of claim 1 , wherein the elastomeric material is selected from the group consisting of: silicone, urethane, polyurethane, thermoplastic elastomer (TPE), and thermoplastic polyurethane (TPU).

24. The system of claim 1 , wherein the pigment material comprises a metal oxide selected from the group consisting of: iron oxide, zinc oxide, aluminum oxide, and titanium dioxide.

25. The system of claim 1 , wherein the deformable transmissive layer is bounded by a bottom surface directly coupled to the interface membrane, a top surface most adjacent the detector, and a transmissive layer thickness therebetween, wherein the pigment material is distributed adjacent the bottom surface within the transmissive layer thickness to provide optimized illumination reflectance adjacent the bottom surface.

26. The system of claim 1 , wherein the interface membrane comprises an elastomeric material.

27. The system of claim 1 , wherein the interface member and deformable transmissive layer each have an elastic modulus which is substantially the same.

28. The system of claim 1 , wherein the deformable transmissive layer and interface membrane are directly coupled such that both principal and shear loads applied by the interfaced object are substantially transferred across the interface membrane to the deformable transmissive layer.

29. The system of claim 1 , wherein the deformable transmissive layer comprises a configured to be at least partially filled with a fluid.

30. The system of claim 1 , wherein the interface membrane comprises an assembly of relatively thin and sequentially removable membrane components.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2025
From: ROHALY, JANOS
To: GELSIGHT, INC.
Reel/Frame 071231/0034 →
Continuity (2)
Provisional Application 63287007 · Dec 7, 2021
Related Publication 20230359308A1 · Nov 9, 2023
References Cited (38)
US 4668861A · White · 1987 [cited by examiner]
US 6582814B2 · Swiler et al. · 2003 [cited by applicant]
US 7077009B2 · Lokhorst · 2006 [cited by examiner]
US 9013449B2 · Su · 2015 [cited by examiner]
US 9058081B2 · Baxter · 2015 [cited by examiner]
US 9112058B2 · Bao et al. · 2015 [cited by applicant]
US 9127938B2 · Adelson · 2015 [cited by applicant]
US 9538056B2 · Adelson et al. · 2017 [cited by applicant]
US 10228799B2 · Chen · 2019 [cited by examiner]
US 20020084992A1 · Agnew · 2002 [cited by applicant]
US 20080048972A1 · Kakarala · 2008 [cited by examiner]
US 20080100593A1 · Skillman · 2008 [cited by examiner]
US 20120169669A1 · Lee · 2012 [cited by examiner]
US 20120200533A1 · Salsman · 2012 [cited by examiner]
US 20120305776A1 · Lai · 2012 [cited by examiner]
US 20130027351A1 · Los · 2013 [cited by examiner]
US 20130069913A1 · Wang · 2013 [cited by examiner]
US 20130070074A1 · Won · 2013 [cited by examiner]
US 20130314379A1 · Tsai · 2013 [cited by examiner]
US 20140104395A1 · Rohaly et al. · 2014 [cited by applicant]
US 20170169571A1 · Hung et al. · 2017 [cited by applicant]
US 20170332911A1 · Won · 2017 [cited by examiner]
US 20180029337A1 · Wilson et al. · 2018 [cited by applicant]
US 20180049330A1 · Malik · 2018 [cited by examiner]
US 20180330208A1 · Won · 2018 [cited by examiner]
US 20210232243A1 · Ye · 2021 [cited by examiner]
International Search Report and Written Opinion mailed Mar. 10, 2023, for PCT Application No. PCT/US22/81128, filed Dec. 7, 2022, twenty-four pages. [cited by applicant]
Johnson, M. K., & Adelson, E. H. (2009, June). Retrographic sensing for the measurement of surface texture and shape. In 2009 IEEE Conference on Computer Vision and Pattern Recognition (pp. 1070-1077). IEEE. [cited by applicant]
Yuan, W., Dong, S., & Adelson, E. H. (2017). Gelsight: High-resolution robot tactile sensors for estimating geometry and force. Sensors, 17(12), 2762. [cited by applicant]
Donlon, E., Dong, S., Liu, M., Li, J., Adelson, E., & Rodriguez, A. (2018, October). Gelslim: A high-resolution, compact, robust, and calibrated tactile-sensing finger. In 2018 IEEE/RSJ International Conference on Intel… [cited by applicant]
Romero, B., Veiga, F., & Adelson, E. (2020, May). Soft, round, high resolution tactile fingertip sensors for dexterous robotic manipulation. In 2020 IEEE International Conference on Robotics and Automation (ICRA) (pp. 4… [cited by applicant]
She, Y., Wang, S., Dong, S., Sunil, N., Rodriguez, A., & Adelson, E. (2021). Cable manipulation with a tactile-reactive gripper. The International Journal of Robotics Research, 40(12-14), 1385-1401. [cited by applicant]
Ðordević, Srdan, et al. “MC sensor—A novel method for measurement of muscle tension.” Sensors 11.10 (2011): 9411-9425. [cited by applicant]
Esposito, Daniele, et al. “A piezoresistive sensor to measure muscle contraction and mechanomyography.” Sensors 18.8 (2018): Article No. 2553. [cited by applicant]
Johnson, Micah K., and Edward H. Adelson. “Retrographic sensing for the measurement of surface texture and shape.” 2009 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2009. [cited by applicant]
Johnson, Micah K., et al. “Microgeometry capture using an elastomeric sensor.” ACM Transactions on Graphics (TOG) 30.4 (2011): 1-8. [cited by applicant]
Edward H. Adelson, et al., File History for U.S. Appl. No. 61/512,680, filed Jul. 28, 2011. [cited by applicant]
Miller, B. H., Liu, H., & Kolle, M. (2022). Scalable optical manufacture of dynamic structural colour in stretchable materials. Nature Materials, 21(9), 1014-1018. [cited by applicant]