IP Library Granted Patent US 12,638,947
Granted Patent B2
US 12,638,947 · App. 18/751,102 · Granted May 26, 2026

Organic responsive user interface system and method of use

Inventor: Jeremy Bates (Kensington, MD)
G06F3/0448G06F3/016G06F3/04162G06F3/0418G06F3/0447
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,638,947
App. No.
18/751,102
Granted
May 26, 2026
Kind
B2
Abstract

An organic interface converting data into tangible 3D shapes using programmable materials. It includes an interaction point with multiple surfaces and a projection module, all coordinated by a computing device for data transmission and reception. Data streams carry computer-readable code interpreted by the projection module to reorient surfaces, thereby materializing the data in three-dimensional space. The interface allows tactile input via human touch generating electrical currents that alter surface properties like position and smoothness. It also responds to audible frequencies and can receive data from secondary computing devices. Using a computing device, users can create 3D objects through data transmission to these responsive surfaces. The interface supports user interactions through touch, voice commands, and digital inputs from devices such as smartphones or tablets. Users have the flexibility to adjust the interface's resolution and response rate to tailor their interaction experience.

Claims (35)

1 . A shape-changing interface system, comprising:

an interaction point with a plurality of surfaces made from a programmable shape-changing material;

a projection module that interprets data and communicates with the surfaces;

a computing device for transmitting and receiving data streams to the interaction point;

wherein the data stream controls the shape-changing material to form a 3D representation of the data;

wherein contacting the 3D shape transmits information back to the computing device;

when representation is established, contact therewith is monitored and received as input to either alter the representation or data stream;

contact results in updates to one or more force-aware motion planning algorithms (FAMPA);

the FAMPA converts that data to 3D data in the cloud; and

the 3D data is then converted into 2D data which the user then receives on their CED.

2 . The system of claim 1 , wherein

a skin is made of doped polymers, PA polymer, or carbon nanotubes;

the skin draws its power from the underlying device via a small cord; and

the skin converts 2D data to 3D data and 3D data is converted to FAMPA data.

3 . The system of claim 1 , integrated with medical imaging software, allowing for the creation of 3D models from medical scans.

4 . The system of claim 1 , with detachable surfaces are combined to create larger and more complex 3D structures.

5 . The system of claim 1 , comprising self-healing properties within the shape-changing material, allowing it to recover from minor tears or deformations.

6 . A method for controlling a shape-changing interface, comprising:

receiving a data stream containing information about a desired 3D shape;

interpreting the data and generating control signals for the shape-changing material;

transmitting the control signals to the interaction point surfaces, causing them to morph into the desired 3D form;

including a feedback loop where sensor data from the interaction point refines the 3D representation; and

is adaptable for real-time data visualization, where the 3D shape dynamically changes based on a live data feed.

7 . The method of claim 6 , adaptable for real-time data visualization, where the 3D shape dynamically changes based on a live data feed.

8 . A shape-changing material composition for the interface, comprising:

a base polymer matrix with shape memory capabilities or responsive to electrical fields or light; and

conductive elements embedded within the matrix for receiving electrical signals; and

self-healing properties achieved through the use of biocompatible materials and self-repair mechanisms.

9 . The composition of claim 8 , wherein

the self-healing process further comprises a redundant healing process (RHP);

the composition including EASMP and PNIPAM deformable media; and

the healing processes harness the properties of EASMP and PNIPAM to achieve comprehensive healing.

10 . The composition of claim 8 , wherein

PNIPAM enables self-healing through reversible hydrophobic interactions, reforming its polymer chains upon cooling; and

simultaneously, the dynamic covalent bonds within EASMP enable it to self-heal through reversible cross-linking, reforming its network structure.

Continuity (2)
Provisional Application 63522684 · Jun 22, 2023
Related Publication 20240427467A1 · Dec 26, 2024
References Cited (98)
US 7056455B2 · Matyjaszewski et al. · 2006 [cited by applicant]
US 8717326B2 · Ciesla · 2014 [cited by applicant]
US 8836643B2 · Romera Joliff et al. · 2014 [cited by applicant]
US 9619032B1 · Ekambaram et al. · 2017 [cited by applicant]
US 9916008B2 · Bostick et al. · 2018 [cited by applicant]
US 9927786B2 · Dewitte · 2018 [cited by applicant]
US 10311992B2 · Engel-Herbert · 2019 [cited by applicant]
US 10345905B2 · McClure et al. · 2019 [cited by applicant]
US 10583067B2 · Kline et al. · 2020 [cited by applicant]
US 11232759B2 · Kwon et al. · 2022 [cited by applicant]
US 11397956B1 · Eidam et al. · 2022 [cited by applicant]
US 20090128503A1 · Grant et al. · 2009 [cited by applicant]
US 20110304550A1 · Romera Jolliff · 2011 [cited by examiner]
US 20160293119A1 · Kwon · 2016 [cited by examiner]
CN 109213302A · 2009 [cited by applicant]
CN 110069168B · 2022 [cited by applicant]
GB 2587368A · 2021 [cited by applicant]
KR 101561718B1 · 2015 [cited by applicant]
KR 20170092610A · 2018 [cited by applicant]
WO WO2015077728A1 · 2015 [cited by applicant]
Stephenson, C., and A. Hubler. “Stability and conductivity of self assembled wires in a transverse electric field.” Scientific reports 5.1 (2015): 1-9. https://link.springer.com/content/pdf/10.1038/srep15044.pdf. [cited by applicant]
Lee, S.; Her, I.; Jung, W.; Hwang, Y. Snakeskin-Inspired 3D Printable Soft Robot Composed of Multi-Modular Vacuum-Powered Actuators. Actuators 2023, 12, 62. https://doi.org/10.3390/act12020062. [cited by applicant]
Bobnar, M., Derets, N., Umerova, S. et al. Polymer-dispersed liquid crystal elastomers as moldable shape-programmable material. Nat Commun 14, 764 (2023). https://doi.org/10.1038/s41467-023-36426-y ; https://www.nature.… [cited by applicant]
Footnote 1 from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8554782/. [cited by applicant]
Lan Luo, Fenghua Zhang, Yanju Liu, Jinsong Leng. Super-tough, self-sensing and shape-programmable polymers via topological structure crosslinking networks. Chemical Engineering Journal, vol. 457, 2023, 141282, ISSN 1385… [cited by applicant]
Kaili Wang, Youming Dong, Zhe Ling, Xiaorong Liu, Sheldon Q. Shi, Jianzhang Li. Transparent wood developed by introducing epoxy vitrimers into a delignified wood template, Composites Science and Technology, vol. 207, 20… [cited by applicant]
Tingzi Yan, Xianlu Li, Huihui Xu, Yongjin Li. Vitrimer-like transparent blend films based on reactive blending of PC and PMMA with catalysis of Mg(TFSI)2, Composites Communications, vol. 36, 2022, 101394, ISSN 2452-2139… [cited by applicant]
Preparation of Colorless, Highly Transparent, Epoxy-Based Vitrimers by the Thiol-Epoxy Click Reaction and Evaluation of Their Shape-Memory Properties. Mikihiro Hayashi, Akira Katayama. CS Appl. Polym. Mater. 2020, 2, 6,… [cited by applicant]
http://hyperphysics.phy-astr.gsu.edu/hbase/vision/specol.html. [cited by applicant]
Electroactive Soft Actuators Based on Columnar Ionic Liquid Crystal/Polymer Composite Membrane Electrolytes Forming 3D Continuous Ionic Channels Siyu Cao, Junko Aimi, and Masafumi Yoshio ACS Applied Materials & Interfac… [cited by applicant]
https://www.sciencedirect.com/science/article/pii/S1878535221004858#bb0035. [cited by applicant]
https://www.semanticscholar.org/paper/Self-assembly-of-semiconductor-nanocrystals-into-Shevchenko-Talapin/cb448a9432c88800363a3182a20962373df54efa. [cited by applicant]
Liu, J., Wen, Z., Lei, H et al. A Liquid-Solid Interface-Based Triboelectric Tactile Sensor with Ultrahigh Sensitivity of 21.48 kPa-1. Nano-Micro Lett. 14, 88 (2022). https://doi.org/10.1007/s40820-022-00831-7. https://… [cited by applicant]
An Ultra-Shapeable, Smart Sensing Platform Based on a Multimodal Ferrofluid-Infused Surface Abdelsalam Ahmed, Islam Hassan, Islam M. Mosa, Esraa Elsanadidy, Mohamed Sharafeldin, James F. Rusling, Shenqiang Ren. First pu… [cited by applicant]
https://www.researchgate.net/publication/334619840_Self_Assembly_of_Ultrathin_Nanocrystals_to_Multidimensional_Superstructures. [cited by applicant]
Long, Y.; Hui, J.- f.; Wang, P.-p.; Hu, S.; Xu, B.; Xiang, G.-I.; Zhuang, J.; Lü, X.-q.; Wang, X. α-MnO2 nanowires as building blocks for the construction of 3D macro-assemblies. Chem. Commun. 2012, 48, 5925-5927. [cited by applicant]
Wang, K.; Lin, H.; Ni, B.; Li, H.; Sial, M. A. Z. G.; Yang, H.; Zhuang, J.; Wang, X. Three-dimensional macroscale assembly of Pd nanoclusters. Nano Res. 2018, 11, 3175-3181. [cited by applicant]
https://www.sciencedirect.com/science/article/pii/S1878535221004858. [cited by applicant]
https://www.sciencedirect.com/science/article/abs/pii/S2211285518307043. [cited by applicant]
https://www.nature.com/articles/s41563-018-0246-7. [cited by applicant]
https://www.tandfonline.com/doi/full/10.1080/14686996.2020.1777833. [cited by applicant]
https://www.neowin.net/news/guide-to-smartphone-hardware-47-displays/. [cited by applicant]
https://electronics.howstuffworks.com/lcd.htm. [cited by applicant]
https://www.researchgate.net/figure/MRI-3D-printing-data-and-photographs-of-three-patients-A-E-I-MRI-images-of-two_fig1_349833784. [cited by applicant]
https://theconversation.com/we-created-holograms-you-can-touch-you-could-soon-shake-a-virtual-colleagues-hand-167478. [cited by applicant]
Pseudo-Hologram with Aerohaptic Feedback for Interactive Volumetric Displays: https://onlinelibrary.wiley.com/doi/10.1002/aisy.202100090. [cited by applicant]
“Mechanical properties of magnetorheological fluids under squeeze-shear mode” by Wang, Hong-yun; Zheng, Hui-qiang; Li, Yong-xian; Lu, Shuang. [cited by applicant]
Algorithmic lattice kirigami: A route to pluripotent materials. Daniel M. Sussman, Yigil Cho, Toen Castle, +3, and Randall D. Kamien https://www.pnas.org/doi/10.1073/pnas.1506048112. [cited by applicant]
https://www.sciencedirect.com/topics/materials-science/shape-memory#:˜:text=SMMs%20are%20classified%20into%20groups,(SMHs)%20%5B13%5D. [cited by applicant]
https://www.psu.edu/news/research/story/transparent-metal-films-smartphone-tablet-and-tv-displays/. [cited by applicant]
https://onlinelibrary.wiley.com/doi/abs/10.1002/adma.201804602. [cited by applicant]
https://www.biolinscientific.com/blog/what-are-surfactants-and-how-do-they-work. [cited by applicant]
Akpan IJ, Shanker M. A comparative evaluation of the effectiveness of virtual reality, 3D visualization and 2D visual interactive simulation: an exploratory meta-analysis. Simulation. 2019;95(2):145-170. doi:10.1177/003… [cited by applicant]
3D-Printed Heart Helps Surgeons Plan Complex Surgery (clevelandclinic.org). [cited by applicant]
How 3D Printer Heart Technology Changed a Teen's Life | UC San Francisco (ucsf.edu). [cited by applicant]
https://pubs.acs.org/doi/10.1021/acsami.2c02690. [cited by applicant]
https://www.researchgate.net/publication/335371607_Ionic_liquid-based_click-ionogels. [cited by applicant]
https://www.mdpi.com/2227-9040/9/8/201. [cited by applicant]
https://core.ac.uk/download/pdf/211274048.pdf. [cited by applicant]
https://asmedigitalcollection.asme.org/appliedmechanics/article/88/3/031016/1091751/All-Solid-Ionic-Eye. [cited by applicant]
https://doi.org/10.1038/s41563-022-01195-4. [cited by applicant]
https://arrow.tudublin.ie/cgi/viewcontent.cgi?article=1015&context=scschcpscon. [cited by applicant]
https://www.academia.edu/en/27395182/A_Smartphone_Controlled_Handheld_Microfluidic_Liquid_Handling_System_Supplement. [cited by applicant]
https://www.semanticscholar.org/paper/Self-Excited-Vibration-Valve-That-Induces-Traveling-Miyaki-Tsukagoshi/e9ab9be84e7e22c3d0ae1ebd8a7237a16b5300f5. [cited by applicant]
https://www.researchgate.net/publication/270933205_Stretchable_cell_culture_platforms_using_micropneumatic_actuators. [cited by applicant]
https://www.sciencedirect.com/science/article/abs/pii/S0924424702001413. [cited by applicant]
E. Shevchenko, et al., https://www.semanticscholar.org/paper/Self-assembly-of-semiconductor-nanocrystals-into-Shevchenko-Talapin/cb448a9432c88800363a3182a20962373df54efa. [cited by applicant]
A.V. Agafonov, et al., https://www.sciencedirect.com/science/article/pii/S1878535221004858#bb0035. [cited by applicant]
Xun Wang, https://www.researchgate.net/publication/334619840_Self_Assembly_of_Ultrathin_Nanocrystals_to_Multidimensional_Superstructures. [cited by applicant]
Rafida Sahrash, et al. https://www.sciencedirect.com/science/article/pii/S2405844018323272#fig1. [cited by applicant]
Too Chen, et al., https://www.sciencedirect.com/science/article/abs/pii/S2211285518307043. [cited by applicant]
Chris Leighton, https://www.nature.com/articles/s41563-018-0246-7. [cited by applicant]
Ryota Tamate, https://www.tandfonline.com/doi/full/10.1080/14686996.2020.1777833. [cited by applicant]
Tim Schiesser, https://www.neowin.net/news/guide-to-smartphone-hardware-47-displays/. [cited by applicant]
Jeff Tyson, https://electronics.howstuffworks.com/lcd.htm. [cited by applicant]
“poly(vinylene fluoride) (CHEBI:53250)”. Retrieved Jul. 14, 2012. [cited by applicant]
Zhang, Q. M., Bharti, V., Kavarnos, G., Schwartz, M. (Ed.), (2002). “Poly (Vinylidene Fluoride) (PVDF) and its Copolymers”, Encyclopedia of Smart Materials, vols. 1-2, John Wiley & Sons, 807-825. [cited by applicant]
“PVDF (Polyvinylidene fluoride, Tecaflon®, Solef®, Kynar®) | Plastics International”. [cited by applicant]
Kawai, Heiji (1969). “The Piezoelectricity of Poly (vinylidene Fluoride)”. Japanese Journal of Applied Physics. 8 (7): 975-976. Bibcode:1969JaJAP . . .8 . . 975K. doi:10.1143/JJAP.8.975. [cited by applicant]
Lolla, Dinesh; Lolla, Manideep; Abutaleb, Ahmed; Shin, Hyeon U.; Reneker, Darrell H.; Chase, George G. (Aug. 9, 2016). “Fabrication, Polarization of Electrospun Polyvinylidene Fluoride Electret Fibers and Effect on Capt… [cited by applicant]
“Physical and Mechanical Properties”. Arkema, Inc. Innovative Chemistry. [cited by applicant]
Jump up to:a b “PVDF Performance & Characteristics Data” (PDF). Plastic Pipe Solutions. [cited by applicant]
Prevedouros K., Cousins I. T., Buck R. C., Korzeniowski S. H. (Jan. 2006). “Sources, fate and transport of perfluorocarboxylates”. Environ. Sci. Technol. 40 (1): 32-44. Bibcode:2006EnST . . . 40...32P. doi:10.1021/es051… [cited by applicant]
Zhang, Qiwu; Lu, Jinfeng; Saito, Fumio; Baron, Michel (2001). “Mechanochemical solid-phase reaction between polyvinylidene fluoride and sodium hydroxide” (PDF). Journal of Applied Polymer Science. 81 (9): 2249. doi:10.1… [cited by applicant]
Ordoñez, J.; Gago, E. J.; Girard, A. (Jul. 1, 2016). “Processes and technologies for the recycling and recovery of spent lithium-ion batteries”. Renewable and Sustainable Energy Reviews. 60: 195-205. doi:10.1016/j.rser.… [cited by applicant]
Guzman, E.; Cugnoni, J.; Gmür, T. (2013). “Survivability of integrated PVDF film sensors to accelerated ageing conditions in aeronautical/aerospace structures”. Smart Mater. Struct. 22 (6): 065020. Bibcode:2013SMaS . . … [cited by applicant]
Omote, Kenji; Ohigashi, Hiroji; Koga, Keiko (1997). “Temperature dependence of elastic, dielectric, and piezoelectric properties of “single crystalline” films of vinylidene fluoride trifluoroethylene copolymer”. Journal… [cited by applicant]
Nix, E. L.; Ward, I. M. (1986). “The measurement of the shear piezoelectric coefficients of polyvinylidene fluoride”. Ferroelectrics. 67: 137-141. doi:10.1080/00150198608245016. [cited by applicant]
Bao, Hui-Min; Song, Jiao-Fan; Zhang, Juan; Shen, Qun-Dong; Yang, Chang-Zheng; Zhang, Q. M. (Apr. 3, 2007). “Phase Transitions and Ferroelectric Relaxor Behavior in P(VDF-TrFE-CFE) Terpolymers”. Macromolecules. ACS Publi… [cited by applicant]
Ahmed, Saad; Arrojado, Erika; Sigamani, Nirmal; Ounaies, Zoubeida (May 14, 2015). Goulbourne, Nakhiah C. (ed.). “Electric field responsive origami structures using electrostriction-based active materials”. Proceedings o… [cited by applicant]
Wang, M., Zhang, P., Shamsi, M. et al. Tough and stretchable ionogels by in situ phase separation. Nat. Mater. 21, 359-365 (2022), https://doi.org/10.1038/s41563-022-01195-4. [cited by applicant]
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8284813/. [cited by applicant]
https://nypost.com/2023/02/27/chinese-kissing-app-with-real-life-silicon-lips-panned-as-creepy/. [cited by applicant]
https://www.intechopen.com/chapters/72010. [cited by applicant]
Hierarchical Self-Assembly of Cellulose Nanocrystals in a Confined Geometry. Richard M. Parker, Bruno Frka-Petesic, Giulia Guidetti, Gen Kamita, Gioele Consani, Chris Abell, and Silvia Vignolini. ACS Nano 2016 10 (9), 8… [cited by applicant]
https://onlinelibrary.wiley.com/doi/full/10.1002/pat.5652. [cited by applicant]
Self-Assembly of Colloidal Nanocrystals: From Intricate Structures to Functional Materials. Michael A. Boles, Michael Engel, and Dmitri V. Talapin. Cite this: Chem. Rev. 2016, 116, 18, 11220-11289. Aug. 23, 2016 https:/… [cited by applicant]
Pan Jiang, Peng Lin, Chang Yang, Hongling Qin, Xiaolong Wang, and Feng Zhou. 3D Printing of Dual-Physical Cross-linking Hydrogel with Ultrahigh Strength and Toughness. Chemistry of Materials 2020 32 (23), 9983-9995 DOI:… [cited by applicant]