IP Library › Granted Patent US 12,212,915
Granted Patent B2
US 12,212,915 · App. 18/083,316 · Granted Jan 28, 2025

Haptic sensing device, electronic device, earphone, and watch

Inventors: Stephen Lingfeng Wang (Cambridge, GB); Hongbin Liu (London, GB); Jian Hu (London, GB); Federica De Chiara (London, GB); Gang Ni (Nanjing, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04R1/1041G01L1/24G06F3/0304G06F3/0414
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,212,915
App. No.
18/083,316
Granted
Jan 28, 2025
Kind
B2
Abstract

A haptic sensing device, including a light source, an optical waveguide, a photoelectric sensor, and a housing. The optical waveguide includes a waveguide layer and a cladding, the cladding encloses the waveguide layer, and a refractive index of the waveguide layer is greater than a refractive index of the cladding. The waveguide layer includes a plurality of paths, the light source is disposed at an input end of each path, and the photoelectric sensor is disposed at an output end of each path. The light source, the optical waveguide, and the photoelectric sensor are accommodated in the housing. A plurality of contacts are distributed on the housing. When a contact is pressed, the contact is in contact with one path, and the path is deformed. When any two contacts are pressed, the two contacts are in contact with different paths.

Claims (41)

1. A haptic sensing device, comprising a light source, an optical waveguide, a plurality of photoelectric sensors, and a housing, wherein

the optical waveguide comprises a waveguide layer and a cladding, the cladding encloses the waveguide layer, and a refractive index of the waveguide layer is greater than a refractive index of the cladding: the waveguide layer comprises a plurality of paths, the light source is disposed at an input end of the plurality of paths, at least one of the plurality of photoelectric sensors is disposed at an output end of each path, and an optical signal emitted by the light source is transmitted to each photoelectric sensor using the plurality of paths;

the light source, the optical waveguide, and the photoelectric sensor are accommodated in the housing;

a plurality of contacts are distributed on the housing, and each contact comprises at least two positions;

for each contact;

when the contact is in a first position, the contact is not in contact with any path;

when the contact is in a second position, the contact is in contact with one of the plurality of paths, and any two contacts are in contact with different paths when the two contacts both are in the second position;

when there is no contact force on the contact, the contact is in the first position; and

when there is contact force on the contact, the contact is in the second position, wherein the optical signal received by the photoelectric sensor is based on the contact being in the first or second position.

2. The haptic sensing device according to claim 1 , wherein at least two of the plurality of paths have a same input end, and the light source is disposed at the input end for the at least two paths.

3. The haptic sensing device according to claim 2 , wherein the plurality of paths are in a single-input multiple-output (SIMO) structure, and the light source is disposed at an input end for the plurality of paths.

4. The haptic sensing device according to claim 3 , wherein the plurality of paths are in a tree-like structure, the input end for the plurality of paths is a root node of the tree-like structure, and the output end of each path is a leaf node of the tree-like structure; a first path comprises a trunk part and a branch part, and the first path is any of the plurality of paths; the trunk part is a part that is of the first path and that overlaps a path other than the first path in the plurality of paths, and the branch part is a part that is of the first path and that does not overlap a path other than the first path in the plurality of paths; and when the contact is in the second form, the contact is in contact with a branch part of one path.

5. The haptic sensing device according to claim 1 , wherein a refractive index of the housing ranges from 1.35 to 1.38.

6. The haptic sensing device according to claim 5 , wherein a material of the housing is polytetrafluoroethylene (PTFE).

7. The haptic sensing device according to claim 1 , wherein when the housing is the cladding and when the contact is in the second position the contact is directly in contact with one path.

8. The haptic sensing device according to claim 1 , wherein when the housing and the cladding are different structures and when the contact is in the second position the contact is indirectly in contact with one path by using the cladding.

9. The haptic sensing device according to claim 1 , wherein a contour of the contact is fixed.

10. The haptic sensing device according to claim 9 , wherein the contact is hollow or non-hollow with an opaque flexible material within the contact.

11. The haptic sensing device according to claim 9 , wherein a shape of the contact comprises one or more of a cantilever shape, a spiral shape, or a cross shape.

12. The haptic sensing device according to claim 1 , wherein a thickness of the contact is not greater than 0.5 mm.

13. The haptic sensing device according to claim 1 , wherein an angle of incidence of the optical signal is 0°.

14. The haptic sensing device according to claim 1 wherein when the contact is in the first position, a deviation between macro-bending losses of any two paths falls within a preset range.

15. The haptic sensing device according to claim 1 , wherein curvature of the paths is positively related to a diameter of the paths.

16. An electronic device, wherein the electronic device comprises an enclosure and a haptic sensing device, the haptic sensing device is the haptic sensing device described in claim 1 , and the enclosure comprises the housing.

17. The electronic device according to claim 16 , wherein the electronic device further comprises a memory and a processor, the memory is coupled to the processor, the memory pre-stores a correspondence between a pressure degree and an instruction, and the processor determines the instruction based on the correspondence and the pressure degree that is of the contact force and that is determined by the photoelectric sensor.

18. A detection method, wherein the detection method is applied to a haptic sensing device, comprising a light source, an optical waveguide, a plurality of photoelectric sensors, and a housing, wherein

the optical waveguide comprises a waveguide layer and a cladding, the cladding encloses the waveguide layer, and a refractive index of the waveguide layer is greater than a refractive index of the cladding; the waveguide layer comprises a plurality of paths, the light source is disposed at an input end of the plurality of paths, at least one of the plurality of photoelectric sensors is disposed at an output end of each path, and an optical signal emitted by the light source is transmitted to each photoelectric sensor using the plurality of paths;

the light source, the optical waveguide, and the photoelectric sensor are accommodated in the housing;

a plurality of contacts are distributed on the housing, and each contact comprises at least two positions;

for each contact:

when the contact is in a first position, the contact is not in contact with any path;

when the contact is in a second position, the contact is in contact with one of the plurality of paths, and any two contacts are in contact with different paths when the two contacts both are in the second position;

when there is no contact force on the contact, the contact is in the first position; and

when there is contact force on the contact, the contact is in the second position, wherein the optical signal received by the photoelectric sensor is based on the contact being in the first or second position;

the detection method comprises:

obtaining, by using at least one of the plurality of photoelectric sensors disposed at an output end of each path, an optical signal transmitted on the path, wherein intensity of the optical signal obtained by the photoelectric sensor is related to a pressure degree of contact force; and

determining, when a first photoelectric sensor disposed at an output end of a first path detects that intensity of an optical signal transmitted on the first path changes, that a contact corresponding to the first path is in a second form, wherein the at least one of the plurality of photoelectric sensors comprises the first photoelectric sensor, the at least one path comprises the first path.

19. The detection method according to claim 18 , wherein the method further comprises:

determining the pressure degree of the contact force based on a pre-stipulated correspondence between intensity of an optical signal and contact force.

20. The detection method according to claim 18 , wherein the determining, when a first photoelectric sensor disposed at an output end of a first path detects that intensity of an optical signal transmitted on the first path changes, that a contact corresponding to the first path is in a second form comprises:

when at least two neighboring photoelectric sensors in the photoelectric sensor successively detect that the intensity of the optical signal changes, determining that at least two contacts in the first path are successively in the second form.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2024
From: WANG, STEPHEN; LIU, HONGBIN; HU, JIAN; DE CHIARA, FEDERICA; NI, GANG
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 069294/0867 →
Continuity (2)
Continuation PCTCN2020097162 · Jun 19, 2020
Related Publication 20230124841A1 · Apr 20, 2023
References Cited (42)
US 5222165A · Bohlinger · 1993 [cited by applicant]
US 6677576B1 · Kenny et al. · 2004 [cited by applicant]
US 8316719B2 · Majidi et al. · 2012 [cited by applicant]
US 9534969B1 · Hunt et al. · 2017 [cited by applicant]
US 10365172B2 · Tomita et al. · 2019 [cited by applicant]
US 20090033637A1 · Han · 2009 [cited by examiner]
US 20090153519A1 · Suarez Rovere · 2009 [cited by examiner]
US 20090174683A1 · Juni et al. · 2009 [cited by applicant]
US 20100302210A1 · Han · 2010 [cited by examiner]
US 20110206838A1 · Juni et al. · 2011 [cited by applicant]
US 20120268427A1 · Slobodin · 2012 [cited by examiner]
US 20120318074A1 · Kyung et al. · 2012 [cited by applicant]
US 20130220032A1 · Packirisamy · 2013 [cited by examiner]
US 20130324860A1 · Borgos et al. · 2013 [cited by applicant]
US 20140098058A1 · Baharav et al. · 2014 [cited by applicant]
US 20170255337A1 · Drumm · 2017 [cited by applicant]
US 20170372114A1 · Cho · 2017 [cited by examiner]
US 20180356301A1 · Tomita et al. · 2018 [cited by applicant]
CN 103968980B · 2016 [cited by applicant]
CN 110031139A · 2019 [cited by applicant]
CN 110333008A · 2019 [cited by applicant]
CN 111157154A · 2020 [cited by applicant]
EP 0377549A2 · 1990 [cited by applicant]
JP 2003156643A · 2003 [cited by applicant]
KR 20130086909A · 2013 [cited by applicant]
WO 2019173827A1 · 2019 [cited by applicant]
Li Xian et al., Opto-Fluidic Tactile Sensor Array by Laser Direct Writing, 2012 , 6 pages. [cited by applicant]
Lee, H.K., Chang, S.I. and Yoon, E., 2006. A flexible polymer tactile sensor: Fabrication and modular expandability for large area deployment. Journal of microelectromechanical systems, 15(6), pp. 1681-1686. [cited by applicant]
Liu, W., Yu, P., Gu, C., Cheng, X. and Fu, X., 2017. Fingertip piezoelectric tactile sensor array for roughness encoding under varying scanning velocity. IEEE Sensors Journal, 17(21), pp. 6867-6879. [cited by applicant]
Liao Yanbiao. Fiber OptiesIM],2000, 9 pages. [cited by applicant]
Piacenza, P., Xiao, Y., Park, S., Kymissis, I. and Ciocarlie, M., Oct. 2016. Contact localization through spatially overlapping piezoresistive signals. In 2016 IEEE/RSJ International Conference on Intelligent Robots and… [cited by applicant]
Watatani, K., Terao, K., Shimokawa, F. and Takao, H., Jan. 2019. A Monolithic Fingerprint-Like Tactile Sensor Array Realizaing High Resolution Imaging of Spatially Distributed Tactile Information. In 2019 IEEE 32nd Inte… [cited by applicant]
Chen, Y., Liu, Y., Ren, J., Yang, W., Shang, E., Ma, K., Zhang, L., Jiang, J. and Sun, X., 2020. Conformable core-shell fiber tactile sensor by continuous tubular deposition modeling with water-based sacrificial coaxial… [cited by applicant]
Wang, Y., Wu, X., Mei, D., Zhu, L. and Chen, J., 2019. Flexible tactile sensor array for distributed tactile sensing and slip detection in robotic hand grasping. Sensors and Actuators A: Physical, 297, p. 111512. [cited by applicant]
Saadatzi, M.N., Baptist, J.R., Yang, Z. and Popa, D.O., 2019. Modeling and Fabrication of Scalable Tactile Sensor Arrays for Flexible Robot Skins. IEEE Sensors Journal, 19(17), pp. 7632-7643. [cited by applicant]
Hammond, F.L., Kramer, R.K., Wan, Q., Howe, R.D. and Wood, R.J., Oct. 2012. Soft tactile sensor arrays for micromanipulation. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 25-32). IEEE. [cited by applicant]
Li, T., Shi, C. and Ren, H., 2018. A high-sensitivity tactile sensor array based on fiber Bragg grating sensing for tissue palpation in minimally invasive surgery. IEEE/ASME Transactions on Mechatronics, 23(5), pp. 2306… [cited by applicant]
Ward-Cherrier, B., Rojas, N. and Lepora, N.F., 2017. Model-free precise in-hand manipulation with a 3d-printed tactile gripper. IEEE Robotics and Automation Letters, 2(4), pp. 2056-2063. [cited by applicant]
Massaro, A., Spano, F., Cazzato, P., La Tegola, C., Cingolani, R. and Athanassiou, A., 2012. Robot tactile sensing: Gold nanocomposites as highly sensitive real-time optical pressure sensors. IEEE Robotics and Automatio… [cited by applicant]
Back, J., Dasgupta, P., Seneviratne, L., Althoefer, K. and Liu, H., Sep. 2015. Feasibility study-novel optical soft tactile array sensing for minimally invasive surgery. In 2015 IEEE/RSJ International Conference on Inte… [cited by applicant]
Li, W., Konstantinova, J., Noh, Y., Ma, Z., Alomainy, A. and Althoefer, K., 2019. An elastomer-based force and tactile sensor. [cited by applicant]
Yuan, W., Zhu, C., Owens, A., Srinivasan, M.A. and Adelson, E.H., May 2017. Shape-independent hardness Estimation using deep learning and a gelsight tactile sensor. In 2017 IEEE International Conference on Robotics and … [cited by applicant]