IP Library Granted Patent US 12,536,749
Granted Patent B2
US 12,536,749 · App. 18/114,204 · Granted Jan 27, 2026

Augmented reality visualizer for swimming pools

Inventors: Will Cappiello (Latham, NY); Joel Culp (Latham, NY); Scott Mocha (Latham, NY); Scott Reynolds (Latham, NY)
Assignee: Latham Pool Products, Inc.
G06T19/006G01S19/01G06T7/13G06T7/60G06T7/70G06T19/20G06Q30/0627G06T2200/24G06T2219/2012G06T2219/2016G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,749
App. No.
18/114,204
Granted
Jan 27, 2026
Kind
B2
Abstract

An augmented reality visualizer for swimming pools is described herein. In one example, a system can receive images of a target area for a swimming pool from a camera. The system can generate an augmented reality environment by analyzing the images. The augmented reality environment can include a virtual swimming pool overlaying at least one image of the target area. The system can then output the augmented reality environment on a display for viewing by a user.

Claims (47)

1 . A method comprising:

receiving, by a processor, one or more images of a target area for a swimming pool from a camera;

generating, by the processor, an augmented reality environment based on the one or more images, the augmented reality environment including a virtual swimming pool that is automatically scaled in size based on an object detected in the one or more images; and

outputting, by the processor, the augmented reality environment for display.

2 . The method of claim 1 , further comprising:

detecting the object by analyzing the one or more images; and

determining a size for the virtual swimming pool based on the detected object.

3 . The method of claim 2 , wherein the object is a vertical object extending vertically upward from a horizontal plane.

4 . The method of claim 3 , further comprising determining the horizontal plane by analyzing the one or more images using an image-processing algorithm.

5 . The method of claim 4 , further comprising determining a vertical plane that is perpendicular to the horizontal plane by analyzing the one or more images, wherein the vertical object is located in the vertical plane.

6 . The method of claim 3 , wherein the horizontal plane corresponds to ground level.

7 . The method of claim 3 , wherein the vertical object includes a tree, a rock, or a fence post.

8 . The method of claim 2 , wherein determining the size for the virtual swimming pool based on the object comprises:

estimating a distance between the camera and the object; and

determining the size for the virtual swimming pool based on the distance.

9 . The method of claim 2 , further comprising:

determining that the object is located outside the target area; and

based on determining that the object is located outside the target area, using the object as a visual anchor for calculating the size of the virtual swimming pool.

10 . The method of claim 1 , wherein the processor is part of a handheld device.

11 . A non-transitory computer-readable medium comprising program code that is executable by a processor for causing the processor to:

receive one or more images of a target area for a swimming pool from a camera;

generate an augmented reality environment based on the one or more images, the augmented reality environment including a virtual swimming pool that is automatically scaled in size based on an object detected in the one or more images; and

output the augmented reality environment for display.

12 . The non-transitory computer-readable medium of claim 11 , further comprising program code that is executable by the processor for causing the processor to:

detect the object by analyzing the one or more images; and

determine a size for the virtual swimming pool based on the detected object.

13 . The non-transitory computer-readable medium of claim 12 , wherein the object is a vertical object extending vertically upward from a horizontal plane.

14 . The non-transitory computer-readable medium of claim 13 , further comprising program code that is executable by the processor for causing the processor to:

determine the horizontal plane by analyzing the one or more images using an image-processing algorithm.

15 . The non-transitory computer-readable medium of claim 14 , further comprising program code that is executable by the processor for causing the processor to:

determine a vertical plane that is perpendicular to the horizontal plane by analyzing the one or more images, wherein the vertical object is located in the vertical plane.

16 . The non-transitory computer-readable medium of claim 13 , wherein the horizontal plane corresponds to ground level.

17 . The non-transitory computer-readable medium of claim 12 , further comprising program code that is executable by the processor for causing the processor to determine the size for the virtual swimming pool based on the object by:

estimating a distance between the camera and the object; and

determining the size for the virtual swimming pool based on the distance.

18 . The non-transitory computer-readable medium of claim 12 , further comprising program code that is executable by the processor for causing the processor to:

determine that the object is located outside the target area; and

based on determining that the object is located outside the target area, use the object as a visual anchor for calculating the size of the virtual swimming pool.

19 . The non-transitory computer-readable medium of claim 11 , wherein the processor and the camera are parts of a handheld device.

20 . A handheld device comprising:

a camera;

a display;

a processor communicatively coupled to the camera and the display; and

a memory including instructions executable by the processor for causing the processor to:

receive one or more images of a target area for a swimming pool from the camera;

generate an augmented reality environment based on the one or more images, the augmented reality environment including a virtual swimming pool that is automatically scaled in size based on an object detected in the one or more images; and

output the augmented reality environment on the display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 25, 2023
From: CAPPIELLO, WILL; CULP, JOEL; MOCHA, SCOTT; REYNOLDS, SCOTT
To: LATHAM POOL PRODUCTS, INC.
Reel/Frame 062803/0166 →
Continuity (4)
Continuation 17729029 · Apr 26, 2022
Continuation 17139797 · Dec 31, 2020
Provisional Application 62956255 · Jan 1, 2020
Related Publication 20230215115A1 · Jul 6, 2023
References Cited (20)
US 10885701B1 · Patel · 2021 [cited by applicant]
US 11341730B2 · Cappiello et al. · 2022 [cited by applicant]
US 20140285522A1 · Kim · 2014 [cited by examiner]
US 20150324940A1 · Samson et al. · 2015 [cited by applicant]
US 20170124713A1 · Jurgenson · 2017 [cited by examiner]
US 20180191769A1 · Anderson · 2018 [cited by applicant]
US 20190242692A1 · Saure et al. · 2019 [cited by applicant]
US 20200175654A1 · Tagra · 2020 [cited by examiner]
US 20210142497A1 · Pugh et al. · 2021 [cited by applicant]
Yard, YARD Training 1: Augmented Reality Tracking, https://www.youtube.com/watch?v=ObKibi5gdSA, Mar. 27, 2018. [cited by examiner]
U.S. Appl. No. 17/139,797 , “Non-Final Office Action”, Sep. 27, 2021, 13 pages. [cited by applicant]
U.S. Appl. No. 17/139,797 , “Notice of Allowance”, Jan. 20, 2022, 6 pages. [cited by applicant]
U.S. Appl. No. 17/729,029 , “Notice of Allowance”, Nov. 23, 2022, 6 pages. [cited by applicant]
Nehlich , “Vip3D Update: Complete Outdoor Living Design Software is Even Better”, Available Online at : https://blog.structurestudios.com/software/best-outdoor-living-design-software-is-even-better-vip3d-update, Aug. 10… [cited by applicant]
Nehlich , “YARD: Augmented Reality for Swimming Pools, Outdoor Kitchens, and Hardscapes”, Available Online at : https://blog.structurestudios.com/software/yard-augmented-reality-for-swimming-pools-outdoor-kitchens-and-h… [cited by applicant]
Nobrega et al., “Dynamic Insertion of Virtual Objects in Photographs”, International Journal of Creative Interfaces and Computer Graphics, vol. 4, No. 2, Jun. 1, 2013, 18 pages. [cited by applicant]
PCT/US2020/067723 , “International Preliminary Report on Patentability”, Jul. 14, 2022, 17 pages. [cited by applicant]
PCT/US2020/067723 , “International Search Report and Written Opinion”, Jul. 6, 2021, 21 pages. [cited by applicant]
PCT/US2020/067723 , “Invitation to Pay Additional Fees and, Where Applicable, Protest Fee”, May 6, 2021, 15 pages. [cited by applicant]
Wang et al., “Cut-and-Fold: Automatic 3D Modeling From a Single Image”, IEEE International Conference On Multimedia and Expo Workshops (ICMEW), Jul. 14-18, 2014, 6 pages. [cited by applicant]