IP Library Granted Patent US 12,315,241
Granted Patent B2
US 12,315,241 · App. 18/600,186 · Granted May 27, 2025

User interfaces to configure a thermal imaging system

Inventors: Marek Steffanson (Mosman, AU); Felix Dintner (Bronte, AU)
Assignee: Calumino Pty Ltd.
G06V10/945G06F18/40G06N20/00G06V10/22G06V20/52G08B21/0407G08B21/043G08B21/0469G08B21/0476H04N5/33G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,241
App. No.
18/600,186
Granted
May 27, 2025
Kind
B2
Abstract

A thermal imaging system including at least one thermal imaging device, a server, and at least one mobile device. The thermal imaging device captures thermal images of an environment. The server applies computer vision techniques to the thermal images, detects events of a predetermined type, and generates notifications of the events of predetermined types detected from the thermal images. The mobile device runs a mobile application that is configured to receive the notifications, present user interfaces, receive user annotations of the notifications in the user interfaces, and transmit the annotations to the server. According to the annotations, the server adjusts parameters used in the application of the computer vision techniques and in the generation of the notifications.

Claims (38)

1. A mobile device, comprising:

a memory;

a display device; and

a microprocessor configured via an application stored in the memory to:

display an instruction to move an item, detectable via a thermal imaging system, to a designated location within an indoor environment;

communicate with the thermal imaging system installed in the indoor environment to determine whether an event is detected via the thermal imaging system;

present in the display device a message indicative of the event being detected in response to the thermal imaging system having detected the event; and

present a user interface to receive an indication, from a user of the mobile device, whether detection of the event by the thermal imaging system is verified by the user.

2. The mobile device of claim 1 , wherein installation of the thermal imaging system is validated via receiving the indication.

3. The mobile device of claim 2 , wherein installation of the thermal imaging system is validated via matching events detected via the thermal imaging system and indications of the events provided by the user to the application.

4. The mobile device of claim 1 , wherein the item is a person.

5. The mobile device of claim 4 , wherein the person is the user of the mobile device.

6. The mobile device of claim 1 , wherein the event is based at least in part on an orientation of the item being positioned at the designated location.

7. The mobile device of claim 1 , wherein the designated location is selected based on a floorplan of the indoor environment.

8. The mobile device of claim 7 , wherein the application is further configured to cause the mobile device to display a prompt requesting the user to change a position while being at the designated location.

9. The mobile device of claim 8 , wherein the position is based on a post of the user in relation with a structure disposed in the indoor environment.

10. The mobile device of claim 9 , wherein the structure is substantially invisible to the thermal imaging system.

11. The mobile device of claim 10 , wherein the structure is a bed.

12. A method, comprising:

displaying, via an application running in a mobile device, an instruction to move an item, detectable via a thermal imaging system, to a designated location within an indoor environment;

communicating, via the application running in the mobile device, with the thermal imaging system installed in the indoor environment to determine whether an event is detected via the thermal imaging system;

presenting, in a display device of the mobile device, a message indicative of the event being detected in response to the thermal imaging system having detected the event; and

presenting, via the application running in the mobile device, a user interface to receive an indication, from a user of the mobile device, whether detection of the event by the thermal imaging system is verified by the user.

13. The method of claim 12 , further comprising:

validating installation of the thermal imaging system via receiving the indication.

14. The method of claim 13 , further comprising:

matching events detected via the thermal imaging system and indications of the events provided by the user to the application to validate the installation of the thermal imaging system.

15. The method of claim 14 , wherein the item is a person, or the user of the mobile device.

16. The method of claim 12 , wherein the event is based at least in part on an orientation of the item being positioned at the designated location; and the designated location is selected based on a floorplan of the indoor environment.

17. The method of claim 16 , wherein the application is further configured to cause the mobile device to display a prompt requesting the user to change a position while being at the designated location; and the position is based on a post of the user in relation with a structure disposed in the indoor environment.

18. A non-transitory computer-readable storage medium for tangibly storing computer program instructions which, when executed in a mobile device, cause the mobile device to perform a method, comprising:

displaying, via an application running in the mobile device, an instruction to move an item, detectable via a thermal imaging system, to a designated location within an indoor environment;

communicating, via the application running in the mobile device, with the thermal imaging system installed in the indoor environment to determine whether an event is detected via the thermal imaging system;

presenting, in a display device of the mobile device, a message indicative of the event being detected in response to the thermal imaging system having detected the event; and

presenting, via the application running in the mobile device, a user interface to receive an indication, from a user of the mobile device, whether detection of the event by the thermal imaging system is verified by the user.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the method further comprises:

matching events detected via the thermal imaging system and indications of the events provided by the user to the application to validate installation of the thermal imaging system.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the event is detected based at least in part on a pose of a user of the mobile device relative to a bed disposed at the designated location.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2024
From: STEFFANSON, MAREK; DINTNER, FELIX
To: MP HIGH TECH SOLUTIONS PTY LTD
Reel/Frame 067171/0480 →
CHANGE OF NAME Recorded Apr 19, 2024
From: MP HIGH TECH SOLUTIONS PTY. LTD.
To: CALUMINO PTY LTD
Reel/Frame 067171/0508 →
Continuity (5)
Continuation 18311195 · May 2, 2023
Continuation 16900741 · Jun 12, 2020
Continuation 16290367 · Mar 1, 2019
Continuation 16042045 · Jul 23, 2018
Related Publication 20240212337A1 · Jun 27, 2024
References Cited (77)
US 5718372A · Tishler · 1998 [cited by examiner]
US 7693679B1 · Warnke et al. · 2010 [cited by applicant]
US 8003941B1 · Heinke et al. · 2011 [cited by applicant]
US 9141851B2 · Sarkis et al. · 2015 [cited by applicant]
US 9408561B2 · Stone et al. · 2016 [cited by applicant]
US 9489635B1 · Zhu · 2016 [cited by applicant]
US 9863660B2 · Kusukame et al. · 2018 [cited by applicant]
US 10225492B1 · Steffanson et al. · 2019 [cited by applicant]
US 10489661B1 · Rush et al. · 2019 [cited by applicant]
US 10701290B2 · Steffanson et al. · 2020 [cited by applicant]
US 10847009B1 · Sulucz · 2020 [cited by examiner]
US 11127144B2 · Steiner · 2021 [cited by examiner]
US 11276181B2 · Chronis · 2022 [cited by examiner]
US 11657605B2 · Steffanson et al. · 2023 [cited by applicant]
US 11941874B2 · Steffanson et al. · 2024 [cited by applicant]
US 20070049259A1 · Onishi et al. · 2007 [cited by applicant]
US 20090167862A1 · Jentoft · 2009 [cited by examiner]
US 20100194525A1 · Do et al. · 2010 [cited by applicant]
US 20100214408A1 · McClure et al. · 2010 [cited by applicant]
US 20110043630A1 · McClure et al. · 2011 [cited by applicant]
US 20110295583A1 · Hollock et al. · 2011 [cited by applicant]
US 20120053423A1 · Kenalty · 2012 [cited by examiner]
US 20120072032A1 · Powell · 2012 [cited by examiner]
US 20120075309A1 · Warnke et al. · 2012 [cited by applicant]
US 20120314901A1 · Hanson et al. · 2012 [cited by applicant]
US 20130072120A1 · Wu · 2013 [cited by applicant]
US 20130321637A1 · Frank et al. · 2013 [cited by applicant]
US 20140014302A1 · Gutai · 2014 [cited by examiner]
US 20150029320A1 · Wieser · 2015 [cited by examiner]
US 20150036920A1 · Wu et al. · 2015 [cited by applicant]
US 20150077566A1 · Xiao · 2015 [cited by examiner]
US 20150247647A1 · Kusukame et al. · 2015 [cited by applicant]
US 20160140827A1 · Derenne · 2016 [cited by examiner]
US 20160188965A1 · Mcclure et al. · 2016 [cited by applicant]
US 20160203694A1 · Högasten · 2016 [cited by examiner]
US 20160224839A1 · Dempsey · 2016 [cited by applicant]
US 20170116484A1 · Johnson · 2017 [cited by examiner]
US 20170296854A1 · Bradley · 2017 [cited by examiner]
US 20180032643A1 · Wright · 2018 [cited by examiner]
US 20180032645A1 · Wright · 2018 [cited by examiner]
US 20180032647A1 · Wright · 2018 [cited by examiner]
US 20180069932A1 · Tiwari et al. · 2018 [cited by applicant]
US 20180097972A1 · Bourret · 2018 [cited by examiner]
US 20180109703A1 · Steffanson et al. · 2018 [cited by applicant]
US 20180109740A1 · Pickett · 2018 [cited by examiner]
US 20180285650A1 · George · 2018 [cited by examiner]
US 20190130725A1 · Dempsey · 2019 [cited by applicant]
US 20200005618A1 · Masuda · 2020 [cited by examiner]
US 20200020111A1 · Broers · 2020 [cited by examiner]
US 20200029029A1 · Steffanson et al. · 2020 [cited by applicant]
US 20200051251A1 · Chronis · 2020 [cited by examiner]
US 20200134836A1 · Chen · 2020 [cited by examiner]
US 20200203007A1 · Durlach · 2020 [cited by examiner]
US 20200314358A1 · Steffanson et al. · 2020 [cited by applicant]
US 20200348183A1 · Agarwal · 2020 [cited by examiner]
US 20210072378A1 · Shin · 2021 [cited by examiner]
US 20210074138A1 · Micko · 2021 [cited by examiner]
US 20210158030A1 · Correnti · 2021 [cited by examiner]
US 20210216774A1 · Jiang et al. · 2021 [cited by applicant]
US 20210248822A1 · Choi · 2021 [cited by examiner]
US 20210350687A1 · Johnson et al. · 2021 [cited by applicant]
US 20210358249A1 · Furtuna · 2021 [cited by examiner]
US 20220058382A1 · LiVoti · 2022 [cited by examiner]
US 20220076028A1 · Hisada et al. · 2022 [cited by applicant]
US 20230267728A1 · Steffanson et al. · 2023 [cited by applicant]
US 20240265731A1 · Afshar · 2024 [cited by examiner]
CN 206312334U · 2017 [cited by applicant]
CN 112394864 · 2021 [cited by applicant]
DE 102009015537B4 · 2010 [cited by applicant]
Danielsen Asbjorn, Torresen Jim, “Recognizing Bedside Events Using Thermal and Ultrasonic Readings”, Sensors (Basel), 17(6), Jun. 9, 2017. [cited by applicant]
International Search Report and Written Opinion, PCT/US19/20261, mailed Jun. 6, 2019. [cited by applicant]
Jonathan Synnott, Chris D. Nugent, Paul Jeffers, “A Thermal Data Simulation Tool for the Testing of Novel Approaches to Activity Recognition”, IWAAL 2014, LNCS 8868, pp. 10-13, 2014. [cited by applicant]
Joseph Rafferty, Jonathan Synnott, Chris Nugent, Gareth Morrison, and Elena Tamburini, “Fall Detection Through Thermal Vision Sensing”, UCAml 2016, Part II, LNCS 10070, pp. 84-90, 2016. [cited by applicant]
Satoshi Kido, Tomoya Miyasaka, Toshiaki Tanaka, Takao Shimizu, Tadafumi Saga, “Fall detection in toilet rooms using thermal imaging sensors”, SI International, 2009. [cited by applicant]
Sixsmith, et al. “A Smart Sensor to Detect the Falls of the Elderly.” IEEE Pervasive Computing, IEEE Service Center, Apr. 1, 2004. [cited by applicant]
Supplementary European Search Report, EP 19840915.3, mailed on Mar. 18, 2022. [cited by applicant]
Zhen-hai Wang, Bo Xu, “Robust Home Alone Faint Detection Based on Wireless Sensor Networks”, International Journal of Distributed Sensor Networks, Aug. 18, 2015. [cited by applicant]