IP Library › Granted Patent US 12,431,006
Granted Patent B2
US 12,431,006 · App. 17/986,463 · Granted Sep 30, 2025

Augmented reality for guiding users to assets in IOT applications

Inventors: Hendrik J Volkerink (Palo Alto, CA); Ajay Khoche (West San Jose, CA)
G08B25/10G08B21/182G16Y10/40G16Y20/10G16Y40/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,431,006
App. No.
17/986,463
Granted
Sep 30, 2025
Kind
B2
Abstract

A wireless sensing system includes a first tape node and a second tape node. The first tape node has a low-power wireless-communications interface and an environmental sensor operable to capture and transmit a first set of environmental data of at least one environmental characteristic to the second tape node. The second node includes an environmental sensor, a low-power wireless-communication interface, a first processor, and a first memory communicatively coupled with the first processor, the first memory storing machine-readable instructions that, when executed by the first processor, cause the first processor to: capture a second set of environmental data; compute an environmental differential between the first set of environmental data and the second set of environmental data; compare the environmental differential to a predetermined environmental threshold; and transmit a notification to a client application of the wireless sensing system running on a client device of the wireless sensing system when the environmental differential exceeds the predetermined environmental threshold.

Claims (39)

1. A wireless sensor device comprising:

an environmental sensor;

a wireless communication system of a first type;

a processor; and

a memory, wherein

the wireless sensor device is configured to:

capture a first set of environmental data using the environmental sensor,

receive a wireless communication from another wireless node of a wireless sensing system associated with the wireless sensor device, the wireless communication comprising a second set of environmental data,

compute a differential between the first set of environmental data and the second set of environmental data,

determine that an event has occurred based on the computed differential, and

transmit a notification of the event to a client application of the wireless sensing system running on a client device of the associated wireless sensing system,

wherein a graphical user interface of the client application, displayed on a display of the client device, shows an augmented reality (AR) overlay on live video footage from a camera of the client device, the AR overlay having at least one arrow guiding a user of the client device to a location of the determined event.

2. The wireless sensor device of claim 1 , wherein the wireless sensor device determines that the event has occurred based on the computed differential being above a threshold level.

3. The wireless sensor device of claim 1 , wherein the wireless sensor device determines that the event has occurred based on the computed differential being below a threshold level.

4. The wireless sensor device of claim 1 , wherein the environmental sensor is a temperature sensor or a vibration sensor.

5. The wireless sensor device of claim 1 , wherein the environmental sensor is an accelerometer.

6. The wireless sensor device of claim 2 , wherein the notification is further configured to transmit a notification of the determined event to a client application of the wireless sensing system running on a client device of the associated wireless sensing system in response to the computed differential being above the threshold level.

7. The wireless sensor device of claim 1 , wherein the wireless sensing system tracks a location of the wireless sensor device based on wireless communications between the wireless sensor device and other wireless nodes of the wireless sensing system.

8. The wireless sensor device of claim 1 , wherein the wireless sensor device is further configured to transmit data associated with the determined event to a wireless node of the wireless sensing system.

9. The wireless sensor device of claim 8 , wherein the wireless node uploads the data associated with the determined event to a cloud server of the wireless sensing system.

10. The wireless sensor device of claim 8 , wherein the data associated with the determined event comprises one or more of a portion of the first set of environmental data and a portion of the second set of environmental data.

11. The wireless sensor device of claim 1 , wherein the wireless sensor device is further configured to upload data associated with the determined event to a cloud server of the wireless sensing system.

12. A system comprising:

a first wireless sensor device comprising a wireless communication system of a first type;

a second wireless sensor device comprising:

an environmental sensor,

a wireless communication system of the first type,

a processor, and

a memory, wherein

the second wireless sensor device is configured to:

capture a first set of environmental data using the environmental sensor,

receive a wireless communication from the first wireless sensor device, the wireless communication comprising a second set of environmental data,

compute a differential between the first set of environmental data and the second set of environmental data, and

determine that an event has occurred based on the computed differential; and

a client device executing a client application to receive a notification of the event from the second wireless sensor device and display the notification in a graphical user interface of the client application, wherein the graphical user interface displays an augmented reality (AR) overlay on live video footage from a camera of the client device, the AR overlay comprising an arrow guiding a user of the client device to a location of the event.

13. The system of claim 12 , wherein the second wireless sensor device is configured to transmit data comprising a portion of the first set of environmental data or a portion of the second set of environmental data to the client device, and least a portion of the transmitted data is displayed in the graphical user interface.

14. The system of claim 12 , further comprising a server configured to receive data from the first wireless sensor device and the second wireless sensor device and monitor one or more assets associated with the system based on the received data.

15. The system of claim 14 , wherein the server is configured to receive a notification of the determined event from the second wireless sensor device and alert a user of the systems, in response.

16. The system of claim 14 , further comprising a gateway node configured to receive a notification of the determined event from the second wireless sensor device and communicate with the server, in response.

Continuity (3)
Continuation 17449934 · Oct 4, 2021
Provisional Application 63087225 · Oct 4, 2020
Related Publication 20230222892A1 · Jul 13, 2023
References Cited (172)
US 5478991A · Watanabe · 1995 [cited by applicant]
US 5495250A · Ghaem · 1996 [cited by applicant]
US 5499717A · Hayashi · 1996 [cited by applicant]
US 5838253A · Wurz · 1998 [cited by applicant]
US 5917433A · Keillor · 1999 [cited by applicant]
US 6372342B1 · Karaoglu · 2002 [cited by applicant]
US 6375780B1 · Tuttle et al. · 2002 [cited by applicant]
US 6392536B1 · Tice · 2002 [cited by examiner]
US 6404341B1 · Reid · 2002 [cited by applicant]
US 6614392B2 · Howard · 2003 [cited by applicant]
US 6919803B2 · Breed · 2005 [cited by applicant]
US 7009517B2 · Wood · 2006 [cited by applicant]
US 7020701B1 · Gelvin et al. · 2006 [cited by applicant]
US 7048194B2 · Minami et al. · 2006 [cited by applicant]
US 7177054B2 · Silverbrook et al. · 2007 [cited by applicant]
US 7259030B2 · Daniels et al. · 2007 [cited by applicant]
US 7299990B2 · Hoshina · 2007 [cited by applicant]
US 7321167B2 · Along et al. · 2008 [cited by applicant]
US 7405656B2 · Olsen · 2008 [cited by applicant]
US 7511616B2 · Lake · 2009 [cited by applicant]
US 7540603B2 · Otsuki · 2009 [cited by applicant]
US 7722249B2 · Kim · 2010 [cited by applicant]
US 7804402B2 · Lang · 2010 [cited by examiner]
US 7838844B2 · Wagner · 2010 [cited by applicant]
US 7884727B2 · Tran · 2011 [cited by applicant]
US 8062735B2 · Bi · 2011 [cited by applicant]
US 8072620B2 · Yamamoto et al. · 2011 [cited by applicant]
US 8110254B1 · Sharma · 2012 [cited by applicant]
US 8171791B2 · Sy et al. · 2012 [cited by applicant]
US 8269633B2 · Hollander et al. · 2012 [cited by applicant]
US 8292173B2 · Yturralde et al. · 2012 [cited by applicant]
US 8401238B2 · Stahlin et al. · 2013 [cited by applicant]
US 8448530B2 · Leuenberger et al. · 2013 [cited by applicant]
US 8658455B2 · Shin et al. · 2014 [cited by applicant]
US 8716629B2 · Klewer et al. · 2014 [cited by applicant]
US 8786510B2 · Coleman · 2014 [cited by applicant]
US 8833664B2 · Choi · 2014 [cited by applicant]
US 8879276B2 · Wang · 2014 [cited by applicant]
US 8971673B2 · Beinhocker · 2015 [cited by applicant]
US 9015071B2 · Breed · 2015 [cited by applicant]
US 9070286B2 · Moore · 2015 [cited by applicant]
US 9137637B2 · Bilal et al. · 2015 [cited by applicant]
US 9159635B2 · Elolampi et al. · 2015 [cited by applicant]
US 9182231B2 · Skaaksrud · 2015 [cited by applicant]
US 9183738B1 · Allen et al. · 2015 [cited by applicant]
US 9189226B2 · Driesen et al. · 2015 [cited by applicant]
US 9372123B2 · Li et al. · 2016 [cited by applicant]
US 9473902B2 · Bilal et al. · 2016 [cited by applicant]
US 9496582B1 · Lim et al. · 2016 [cited by applicant]
US 9543495B2 · Paschkewitz et al. · 2017 [cited by applicant]
US 9543549B2 · Bai et al. · 2017 [cited by applicant]
US 9583428B2 · Rafferty et al. · 2017 [cited by applicant]
US 9632050B2 · Zhong et al. · 2017 [cited by applicant]
US 9643460B2 · Peine et al. · 2017 [cited by applicant]
US 9644401B2 · Nguyen et al. · 2017 [cited by applicant]
US 9753568B2 · McMillen · 2017 [cited by applicant]
US 9781825B2 · Farkas et al. · 2017 [cited by applicant]
US 9824329B2 · Stirling et al. · 2017 [cited by applicant]
US 9860688B2 · Kulkami et al. · 2018 [cited by applicant]
US 10275943B2 · Choi · 2019 [cited by applicant]
US 20030000128A1 · Wood et al. · 2003 [cited by applicant]
US 20030018927A1 · Gadir et al. · 2003 [cited by applicant]
US 20040044493A1 · Coulthard · 2004 [cited by applicant]
US 20040131761A1 · Shakespeare · 2004 [cited by applicant]
US 20050110632A1 · Berezowski · 2005 [cited by examiner]
US 20060100299A1 · Malik et al. · 2006 [cited by applicant]
US 20070008099A1 · Kimmel · 2007 [cited by examiner]
US 20070049291A1 · Kim et al. · 2007 [cited by applicant]
US 20070095905A1 · Kadaba · 2007 [cited by applicant]
US 20070159326A1 · Quist · 2007 [cited by examiner]
US 20070287473A1 · Dupray · 2007 [cited by applicant]
US 20080079567A1 · Poor · 2008 [cited by applicant]
US 20080180258A1 · Lang · 2008 [cited by examiner]
US 20080184795A1 · Woodard · 2008 [cited by applicant]
US 20080198002A1 · Bartholf et al. · 2008 [cited by applicant]
US 20080239282A1 · Zou et al. · 2008 [cited by applicant]
US 20090051530A1 · Brooks et al. · 2009 [cited by applicant]
US 20090072974A1 · Miyashita et al. · 2009 [cited by applicant]
US 20090174600A1 · Mazlum et al. · 2009 [cited by applicant]
US 20090192709A1 · Yonker et al. · 2009 [cited by applicant]
US 20090196267A1 · Walker · 2009 [cited by applicant]
US 20100082870A1 · Tokuhara · 2010 [cited by applicant]
US 20100096181A1 · Nakamura · 2010 [cited by applicant]
US 20100180701A1 · Daniel · 2010 [cited by applicant]
US 20100201519A1 · Dagher · 2010 [cited by applicant]
US 20100230498A1 · Atherton · 2010 [cited by applicant]
US 20100299401A1 · Lloyd · 2010 [cited by applicant]
US 20110054979A1 · Cova et al. · 2011 [cited by applicant]
US 20110192465A1 · Collings, III · 2011 [cited by applicant]
US 20110251469A1 · Varadan · 2011 [cited by applicant]
US 20120271540A1 · Miksa · 2012 [cited by applicant]
US 20120278676A1 · Teraura · 2012 [cited by applicant]
US 20130107770A1 · Marsden et al. · 2013 [cited by applicant]
US 20130131980A1 · Ginsberg · 2013 [cited by applicant]
US 20130250357A1 · Yu · 2013 [cited by applicant]
US 20140014403A1 · Miller et al. · 2014 [cited by applicant]
US 20140240088A1 · Robinette et al. · 2014 [cited by applicant]
US 20140265915A1 · Huang et al. · 2014 [cited by applicant]
US 20140268780A1 · Wang · 2014 [cited by applicant]
US 20140274139A1 · Bilal et al. · 2014 [cited by applicant]
US 20140317406A1 · Lewis et al. · 2014 [cited by applicant]
US 20150034635A1 · Dagher · 2015 [cited by applicant]
US 20150154531A1 · Skaaksrud · 2015 [cited by applicant]
US 20150324745A1 · Goodall · 2015 [cited by applicant]
US 20150347959A1 · Skaaksrud · 2015 [cited by applicant]
US 20150349667A1 · Andosca et al. · 2015 [cited by applicant]
US 20150354973A1 · Wang et al. · 2015 [cited by applicant]
US 20150382154A1 · Bilal et al. · 2015 [cited by applicant]
US 20160011074A1 · Mian et al. · 2016 [cited by applicant]
US 20160026213A1 · Li et al. · 2016 [cited by applicant]
US 20160110085A1 · Barton · 2016 [cited by applicant]
US 20160147353A1 · Fliz et al. · 2016 [cited by applicant]
US 20160188181A1 · Smith · 2016 [cited by applicant]
US 20160205509A1 · Hoperaft et al. · 2016 [cited by applicant]
US 20160233927A1 · Wu · 2016 [cited by applicant]
US 20160239801A1 · Burch, V et al. · 2016 [cited by applicant]
US 20160269533A1 · Taylor · 2016 [cited by applicant]
US 20160270215A1 · Goto · 2016 [cited by applicant]
US 20160358444A1 · Lundy · 2016 [cited by applicant]
US 20160370210A1 · Kapusta et al. · 2016 [cited by applicant]
US 20160377440A1 · Dorum · 2016 [cited by applicant]
US 20170017872A1 · Kato et al. · 2017 [cited by applicant]
US 20170025547A1 · Cho et al. · 2017 [cited by applicant]
US 20170039666A1 · Kuersten et al. · 2017 [cited by applicant]
US 20170079144A1 · Coleman et al. · 2017 [cited by applicant]
US 20170161679A1 · Stingel et al. · 2017 [cited by applicant]
US 20170337405A1 · Schutz · 2017 [cited by applicant]
US 20180003507A1 · Arslan et al. · 2018 [cited by applicant]
US 20180046964A1 · Leoni et al. · 2018 [cited by applicant]
US 20180104609A1 · Musliner · 2018 [cited by applicant]
US 20180144601A1 · Moore · 2018 [cited by examiner]
US 20180165568A1 · Khoche · 2018 [cited by applicant]
US 20180190096A1 · Lundy · 2018 [cited by applicant]
US 20190041836A1 · Cella et al. · 2019 [cited by applicant]
US 20190250653A1 · Conlon · 2019 [cited by applicant]
US 20190265082A1 · Zafar et al. · 2019 [cited by applicant]
US 20200072485A1 · LaPalme · 2020 [cited by applicant]
US 20200098238A1 · Skaaksrud · 2020 [cited by applicant]
US 20200100115A1 · Skaaksrud · 2020 [cited by examiner]
US 20220100263A1 · Nagar · 2022 [cited by applicant]
EP 1786143A2 · 2007 [cited by applicant]
JP 2008239282A · 2008 [cited by applicant]
JP 2009230500A · 2009 [cited by applicant]
JP 2011090670A · 2011 [cited by applicant]
JP 2012141995A · 2012 [cited by applicant]
WO WO2014195756A1 · 2014 [cited by applicant]
WO WO2016120628A1 · 2016 [cited by applicant]
WO WO2017046699A1 · 2017 [cited by applicant]
WO WO2017100707A3 · 2017 [cited by applicant]
PCT Application No. PCT/US2018/064919, Written Opinion, dated Apr. 5, 2019, 7 pages. [cited by applicant]
Dementyev, SensorTape: Modular and Programmable 3D-Aware Dense Sensor Network on a Tape, In Proc. of JIST 2015. [cited by applicant]
Griffin et al., Adhesive RFID Sensor Patch for Monitoring of Sweat Electrolytes, in IEEE Transactions on Bio-Medical Engineering, Nov. 2014. [cited by applicant]
Pyo et al., Development of a Map Matching Method Using the Multiple Hypothesis Technique, 2001 IEEE. [cited by applicant]
Liu, Survey of Wireless Based Indoor Localization Technologies, arXiV:1709.01015v2 Ics.N1 Mar. 14, 2018. [cited by applicant]
Cheung et al., Least Squares Algorithms for Time-of-Arrival-Based Mobile Location, IEEE Transactions on Signal recessing, vol. 52, No. 4, Apr. 2004, pp. 1121-1128. [cited by applicant]
Frazier et al., Fully-Drawn Carbon-Based Chemical Sensors on Organic and Inorganic Surfaces, Lab Chip. Oct. 21, 2014; 14(20): 4059-4066. doi:10.1039/c4lc00864b. [cited by applicant]
Alsheikh et al., Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications, arXiv:1405.4463v2 Ics.NI Mar. 19, 2015. [cited by applicant]
Farooqui et al., A Paper Based Ink Jet Printed Real Time Location Tracking TAB, 2013 IEEE MTT-S International Microwave Symposium Digest (MTT). [cited by applicant]
Gong et al., Low-Cost Sensor Tape for Environment Sensing Based on Roll-to-Roll Manufacturing Process, In Jroc. of IEEE Sensors 2012. [cited by applicant]
Olyazadeh, Least Square Approach on Indoor Positioning Measurement Techniques, 2012. [cited by applicant]
Wimmer et al., Modular and Deformable Touch-Sensitive Surfaces Based on Time Domain Reflectometry, UIST 11 Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 517-526, Santa Barba… [cited by applicant]
Olberding et al., A Cuttable Multi-Touch Sensor, Proceeding UIST, 13 Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, pp. 245-254, St. Andrews, Scotland, United Kingdom, Oct. 8-11,… [cited by applicant]
Zhang et al., Deep Neural Networks for Wireless Localization in Indoor and Outdoor Environments, Neurocomputing 194 (2016), pp. 279-287. [cited by applicant]
Roundy et al., Energy Harvester for Rotating Environments Using Offset Pendulum and Nonlinear Dynamics, ‘Smart Materials and Structures,’ OP Publishing Ltd, Sep. 9, 2014. [cited by applicant]
Ku et al., Joint Power Waveforming and Beamforming for Wireless Power Transfer, IEEE Transactions on Signal recessing, vol. 65,No. 24, Dec. 15, 2017, p. 6409. [cited by applicant]
PCT Application No. PCT/US2019/042488, International Search Report and Written Opinion, dated Nov. 5, 2019. [cited by applicant]
Shen et al., A Mobility Framework to Improve Heterogeneous Wireless Network Services, Inderscience Enterprises _td., 2011. [cited by applicant]
Iacono, Wireless Sensor Network Protocols, Universidad De Mendoza, Argentina, 2011. [cited by applicant]
Matin et al., Overview of Wireless Sensor Network, Intech, 2012 (http://doi.org/10.6772/49376.1). [cited by applicant]
Camino et al., Wireless Communication, Identification, and Sensing Technologies Enabling Integrated Logistics: A Study in the Harbor Environment, Research Gate, Oct. 2015 (https://www.researchgate.net/ publication/28311… [cited by applicant]
PCT Application No. PCT/US2019/046588, International Search Report and Written Opinion, dated Jan. 6, 2020. [cited by applicant]
PCT Application No. PCT/2021/053437, International Search Report and Written Opinion dated Jan. 11, 2022, 11 pages. [cited by applicant]