IP Library Granted Patent US 12,406,563
Granted Patent B2
US 12,406,563 · App. 17/217,144 · Granted Sep 2, 2025

Smart surveillance system for swimming pools

Inventors: Ramy R. Gali (Lake Worth, FL); Phillip E. Matar (Tampa, FL); David C. May (The Villages, FL)
Assignee: POOL KNIGHT, LLC
G08B21/086G06T7/70G10L17/22H04N7/18G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,563
App. No.
17/217,144
Granted
Sep 2, 2025
Kind
B2
Abstract

A swimming pool monitoring system including an imaging sensor for detecting the presence of an object within a defined perimeter of the swimming pool and a computer system operatively coupled to the imaging sensor with a non-transitory computer readable medium storing a program causing the computer system to execute processing to determine when an object is moving within a field of view of the imaging sensor once detected by the imaging sensor, to determine an angle of the object relative to the imaging sensor and to determine a range of the object relative to the imaging device to include a determination of a size of object for providing an alarm when the object approaches within a predetermined distance of the pool edge.

Claims (25)

1. A swimming pool monitoring system comprising:

an imaging sensor suite for detecting the presence of an object within a defined perimeter of the swimming pool wherein the imaging sensor suite comprises at least one infrared imaging sensor and at least one red, green, blue (RGB) imaging sensor;

at least one local ambient environment condition sensor to sense a quantity of ambient light in an environment of the swimming pool being monitored by the imaging sensor suite to determine at least one of: a mode for the at least one infrared imaging sensor to operate and whether to use the at least one RGB imaging sensor;

a computer system operatively coupled to the imaging sensor suite with a non-transitory computer readable medium storing a program causing the computer system to execute processing to determine when an object is moving within a field of view of the imaging sensor suite once detected by the imaging sensor suite, to determine an angle of the object relative to the imaging sensor suite and to determine a range of the object relative to the imaging sensor suite to include a determination of a size of the object for providing an alarm when the object approaches within a predetermined distance of an edge of the swimming pool; and

a plurality of sensor systems comprising at least an olfactory sensor coupled to the computer system, wherein the computer system further comprises a data storage device including a database of olfactory signatures associated with authorized objects for comparison to olfactory signatures detected by the olfactory sensor, the computer system providing an alarm in response to unauthorized signatures.

2. The swimming pool monitoring system of claim 1 , wherein to determine the range of the object, a field of view at a bottom of an image frame taken by the imaging sensor suite is determined with right triangle trigonometric equations.

3. The swimming pool monitoring system of claim 1 , wherein the plurality of sensor systems further comprises an auditory sensor for detecting sounds within the perimeter of the swimming pool and the computer system includes a voice identification system for identifying authorized voices within the swimming pool perimeter and responding to commands from the authorized voices.

4. The swimming pool monitoring sensor of claim 1 , further comprising an ultrasonic range sensor for determining a range of a live object from the edge of the swimming pool.

5. The swimming pool monitoring system of claim 1 , wherein the computer system inhibits the alarm if an authorized live object is in juxtaposition with an unauthorized live object.

6. The swimming pool monitoring system of claim 1 , wherein the computer system includes a data input function coupled to the imaging sensor suite for enabling selected captured images to be stored in the data storage whereby a plurality of predetermined images of objects may be updated for additional authorized and unauthorized objects.

7. The swimming pool monitoring system of claim 1 , wherein the local ambient environment condition sensor is a sensor suite comprising an ambient lighting sensor and at least one of a temperature sensor, a humidity sensor, and a weather detection sensor.

8. The swimming pool monitoring system of claim 1 , wherein the at least one infrared imaging sensor is coupled to at least one lens and wherein the at least one lens comprises a dome shape.

9. The swimming pool monitoring system of claim 1 , wherein the at least one infrared imaging sensor is coupled to at least one lens and wherein the at least one lens comprises a Fresnel lens.

10. The swimming pool monitoring system of claim 9 , wherein the at least one lens comprises a plurality of Fresnel lenses arranged in a dome shape.

11. A swimming pool monitoring system comprising:

an imaging sensor suite, with at least one infrared imaging sensor and at least one red, green, blue (RGB) imaging sensor, with a known distance to a base surface;

at least one local ambient environment condition sensor to sense a quantity of ambient light in an environment of the swimming pool being monitored by the imaging sensor suite to determine at least one of: a mode for the at least one infrared imaging sensor to operate and whether to use the at least one RGB imaging sensor;

a computer system with a non-transitory computer readable medium storing a program causing the computer system to execute processes to receive image frames from the imaging sensor suite, to detect an object within a field of view of the imaging sensor suite when comparing image frames at a horizon of each image frame to a floor of each image frame, to determine a range of the object from the imaging sensor suite, and to determine a width and height of the object with right triangle trigonometric equations;

an alarm system in communication with the computer system to sound at least one of an audible, visual, and tactile alarm emitting from at least one of the computer system and a remote device when determined that the object is entering into a predetermined perimeter area around the swimming pool relative to the imaging sensor suite; and

a plurality of sensor systems comprising at least an olfactory sensor coupled to the computer system, wherein the computer system further comprises a data storage device including a database of olfactory signatures associated with authorized objects for comparison to olfactory signatures detected by the olfactory sensor, the computer system or the remote device providing an alarm in response to unauthorized signatures.

12. The swimming pool monitoring system of claim 11 , wherein the non-transitory computer readable medium storing the program further causes the computer system to determine at least one of whether the object has limbs and whether the object is at least one of walking and crawling.

13. The swimming pool monitoring system of claim 12 , wherein to determine whether the object is at least one of walking and crawling is based on the object moving at at least one of a predetermined velocity and a predetermined acceleration.

14. A computerized method to monitor a swimming pool for a moving object, the computerized method comprises a computer system comprising a non-transitory computer readable medium storing a program causing the computer system to execute processes to image an area of interest with a stationary imaging sensor suite wherein to image the area is determined by information from a sensor which is used to select a type of imaging sensor of the imaging sensor suite to use, wherein the imaging sensor suite comprises at least one infrared imaging sensor and at least one red, green, blue (RGB) imaging sensor; detect a moving object within the field of view of the imaging sensor suite; and determine a range of the object relative to the imaging sensor suite utilizing an angle of the object from the imaging sensor suite and a position of the imaging sensor suite relative to a base, wherein a plurality of sensor systems comprising at least an olfactory sensor is coupled to the computer system, wherein the computer system further comprises a data storage device including a database of olfactory signatures associated with authorized objects for comparison to olfactory signatures detected by the olfactory sensor, wherein the non-transitory computer readable medium storing a program causing the computer system to execute processes to provide an alarm in response to unauthorized signatures.

15. The computerized method of claim 14 , further comprising the non-transitory computer readable medium storing a program causing the computer system to execute processes to determine the range of the object, a field of view at a bottom of an image frame taken by the imaging sensor suite is determined with right triangle trigonometric equations.

16. The computerized method of claim 14 , further comprising the non-transitory computer readable medium storing a program causing the computer system to execute processes to compare image frames taken by the imaging sensor suite at a horizon of each image frame to a floor of each image frame to determine the range of the object from the imaging sensor suite, and to determine a width and height of the object with right triangle trigonometric equations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: GALI, RAMY R.; MATAR, PHILLIP E.; MAY, DAVID C.
To: POOL KNIGHT, LLC
Reel/Frame 056675/0491 →
Continuity (3)
Continuation In Part 16774933 · Jan 28, 2020
Provisional Application 62798017 · Jan 29, 2019
Related Publication 20210241597A1 · Aug 5, 2021
References Cited (40)
US 5631630A · McSweeney · 1997 [cited by applicant]
US 6263311B1 · Dildy · 2001 [cited by examiner]
US 7138921B1 · Fontaine · 2006 [cited by applicant]
US 7317406B2 · Wolterman · 2008 [cited by applicant]
US 8669876B2 · Anderson et al. · 2014 [cited by applicant]
US 9049352B2 · Scalisi et al. · 2015 [cited by applicant]
US 9928719B1 · Webb · 2018 [cited by applicant]
US 9953506B2 · Zhang et al. · 2018 [cited by applicant]
US 10026283B1 · Liu et al. · 2018 [cited by applicant]
US 10068445B2 · Nongpiur et al. · 2018 [cited by applicant]
US 10666913B1 · Siminoff · 2020 [cited by examiner]
US 20030156027A1 · Seo · 2003 [cited by applicant]
US 20050225443A1 · Lerg · 2005 [cited by examiner]
US 20060007308A1 · Ide · 2006 [cited by examiner]
US 20080048870A1 · Laitta et al. · 2008 [cited by applicant]
US 20080211921A1 · Sako · 2008 [cited by examiner]
US 20080258907A1 · Kaipaxis · 2008 [cited by applicant]
US 20100294915A1 · Williams · 2010 [cited by examiner]
US 20130106610A1 · Pratt · 2013 [cited by applicant]
US 20140267736A1 · DeLean · 2014 [cited by examiner]
US 20150092055A1 · Scalisi · 2015 [cited by examiner]
US 20150173993A1 · Walsh · 2015 [cited by examiner]
US 20160093198A1 · Tung et al. · 2016 [cited by applicant]
US 20160142597A1 · Warren · 2016 [cited by examiner]
US 20160180239A1 · Frankel et al. · 2016 [cited by applicant]
US 20160307420A1 · DeLean · 2016 [cited by applicant]
US 20160364972A1 · Torti · 2016 [cited by applicant]
US 20170018170A1 · Sayavong et al. · 2017 [cited by applicant]
US 20170345151A1 · Hornung · 2017 [cited by examiner]
US 20180082436A1 · Hattori · 2018 [cited by examiner]
US 20180096569A1 · Eaton · 2018 [cited by applicant]
US 20180120661A1 · Kilgore · 2018 [cited by examiner]
US 20190205608A1 · Weitzman · 2019 [cited by applicant]
US 20200246690A1 · Weitzman · 2020 [cited by applicant]
CN 103440735 · 2013 [cited by applicant]
CN 104524747 · 2015 [cited by applicant]
CN 205354285 · 2016 [cited by applicant]
CN 106971508 · 2017 [cited by applicant]
WO 2010078617 · 2010 [cited by applicant]
WO 2017130187 · 2017 [cited by applicant]