IP Library Granted Patent US 11,341,730
Granted Patent B2
US 11,341,730 · App. 17/139,797 · Granted May 24, 2022

Augmented reality visualizer for swimming pools

Inventors: Will Cappiello (Latham, NY); Joel Culp (Latham, NY); Scott Mocha (Latham, NY); Scott Reynolds (Latham, NY)
Assignee: Latham Pool Products, Inc.
G06T19/006G01S19/01G06T7/13G06T7/60G06T7/70G06T19/20G06Q30/0627G06T2200/24G06T2219/2012G06T2219/2016G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,341,730
App. No.
17/139,797
Granted
May 24, 2022
Kind
B2
Abstract

An augmented reality visualizer for swimming pools is described herein. In one example, a system can receive images of a target area for a swimming pool from a camera. The system can generate an augmented reality environment by analyzing the images. The augmented reality environment can include a virtual swimming pool overlaying at least one image of the target area. The system can then output the augmented reality environment on a display for viewing by a user.

Claims (73)

1. A method comprising:

receiving, by a processor, a plurality of images of a target area for a swimming pool from a camera;

generating, by the processor, an augmented reality environment by analyzing the plurality of images, the augmented reality environment including a virtual swimming pool overlaying at least one image of the target area, wherein generating the augmented reality environment by analyzing the plurality of images involves:

determining a horizontal plane and a vertical plane in the plurality of images by analyzing the plurality of images using an image-processing algorithm;

performing edge detection on image features in the vertical plane to identify a vertical object extending vertically upward from the horizontal plane;

determining a size for the virtual swimming pool in the augmented reality environment by using the vertical object as an indicator of scale; and

depicting the virtual swimming pool in the augmented reality environment as having the size; and

outputting, by the processor, the augmented reality environment on a display.

2. The method of claim 1 , further comprising:

identifying, by the processor, an obstruction in the plurality of images that would prevent placement of the swimming pool in the target area; and

in response to identifying the obstruction, outputting, by the processor, an alert associated with the obstruction.

3. The method of claim 1 , further comprising:

receiving, by the processor, a user input for modifying a visual characteristic of the virtual swimming pool in the augmented reality environment; and

in response to receiving the user input, modifying, by the processor, the visual characteristic of the virtual swimming pool in the augmented reality environment.

4. The method of claim 3 , wherein the visual characteristic includes a size, shape, orientation, material, color, pattern, or liner of the virtual swimming pool.

5. The method of claim 3 , wherein the visual characteristic is a fill state, the fill state being whether the virtual swimming pool is depicted as filled with virtual water or empty.

6. The method of claim 1 , wherein the processor and the camera are included in a handheld device.

7. The method of claim 6 , further comprising:

determining, by the processor, a physical location of the handheld device in real space using one or more sensors;

determining, by the processor, a relative position of the sun to the physical location of the handheld device; and

rendering, by the processor, a shadow associated with the virtual swimming pool in the augmented reality environment based on the relative position of the sun to the physical location of the handheld device.

8. The method of claim 7 , wherein the physical location is a geographical location and the one or more sensors include a global positioning system (GPS) unit.

9. The method of claim 1 , further comprising:

receiving, by the processor, a user input for identifying a supplier of pool products having one or more visual characteristics of the virtual swimming pool; and

in response to receiving the user input:

filtering, by the processor, through a list of suppliers of pool products to identify one or more suppliers that sell pool products having the one or more visual characteristics of the virtual swimming pool; and

outputting the one or more identified suppliers on the display.

10. The method of claim 1 , wherein the augmented reality environment includes a virtual deck associated with the virtual swimming pool, and further comprising:

receiving, by the processor, a user input for modifying a visual characteristic of the virtual deck in the augmented reality environment; and

in response to receiving the user input, modifying, by the processor, the visual characteristic of the virtual deck in the augmented reality environment.

11. The method of claim 10 , wherein the visual characteristic includes a size, shape, orientation, material, color, or texture of the virtual deck.

12. A system comprising:

a camera;

a display;

a processor communicatively coupled to the camera and the display; and

a memory including instructions executable by the processor for causing the processor to:

receive a plurality of images of a target area for a swimming pool from the camera;

generate an augmented reality environment by analyzing the plurality of images, the augmented reality environment including a virtual swimming pool overlaying at least one image of the target area, wherein generating the augmented reality environment by analyzing the plurality of images involves:

determining a horizontal plane and a vertical plane in the plurality of images by analyzing the plurality of images using an image-processing algorithm;

performing edge detection on image features in the vertical plane to identify a vertical object extending vertically upward from the horizontal plane;

determining a size for the virtual swimming pool in the augmented reality environment by using the vertical object as an indicator of scale; and

depicting the virtual swimming pool in the augmented reality environment as having the size; and

output the augmented reality environment on the display.

13. The system of claim 12 , wherein the memory further includes instructions that are executable by the processor for causing the processor to:

identify an obstruction in the plurality of images that would prevent placement of the swimming pool in the target area; and

in response to identifying the obstruction, output an alert associated with the obstruction.

14. The system of claim 12 , wherein the memory further includes instructions that are executable by the processor for causing the processor to:

receive a user input for modifying a visual characteristic of the virtual swimming pool in the augmented reality environment; and

in response to receiving the user input, modify the visual characteristic of the virtual swimming pool in the augmented reality environment.

15. The system of claim 12 , further comprising one or more sensors, wherein the memory further includes instructions that are executable by the processor for causing the processor to:

determine a physical location in real space using the one or more sensors;

determine a relative position of the sun to the physical location; and

render a shadow associated with the virtual swimming pool in the augmented reality environment based on the relative position of the sun to the physical location.

16. The system of claim 12 , wherein the augmented reality environment includes a virtual deck associated with the virtual swimming pool, and wherein the memory further includes instructions that are executable by the processor for causing the processor to:

receive a user input for modifying a visual characteristic of the virtual deck in the augmented reality environment; and

in response to receiving the user input, modify the visual characteristic of the virtual deck in the augmented reality environment.

17. A non-transitory computer-readable medium comprising program code that is executable by a processor for causing the processor to:

receive a plurality of images of a target area for a swimming pool from a camera;

generate an augmented reality environment by analyzing the plurality of images, the augmented reality environment including a virtual swimming pool overlaying at least one image of the target area, wherein generating the augmented reality environment by analyzing the plurality of images involves:

determining a horizontal plane and a vertical plane in the plurality of images by analyzing the plurality of images using an image-processing algorithm;

performing edge detection on image features in the vertical plane to identify a vertical object extending vertically upward from the horizontal plane;

determining a size for the virtual swimming pool in the augmented reality environment by using the vertical object as an indicator of scale; and

depicting the virtual swimming pool in the augmented reality environment as having the size; and

output the augmented reality environment on a display.

18. The non-transitory computer-readable medium of claim 17 , further comprising program code that is executable by the processor for causing the processor to:

identify an obstruction in the plurality of images that would prevent placement of the swimming pool in the target area; and

in response to identifying the obstruction, output an alert associated with the obstruction.

19. The non-transitory computer-readable medium of claim 17 , further comprising program code that is executable by the processor for causing the processor to:

determine a physical location in real space associated with the processor using one or more sensors;

determine a relative position of the sun to the physical location; and

render a shadow associated with the virtual swimming pool in the augmented reality environment based on the relative position of the sun to the physical location.

20. The non-transitory computer-readable medium of claim 17 , further comprising program code that is executable by the processor for causing the processor to:

generate the augmented reality environment to include a visual option that is selectable to toggle the virtual swimming pool between an empty state and a filled state, the empty state depicting the virtual swimming pool without virtual water and the filled state depicting the virtual swimming pool with virtual water.

Assignments (2)
SECURITY INTEREST Recorded Feb 23, 2022
From: LATHAM POOL PRODUCTS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 059075/0090 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2022
From: CAPPIELLO, WILL; CULP, JOEL; MOCHA, SCOTT; REYNOLDS, SCOTT
To: LATHAM POOL PRODUCTS, INC.
Reel/Frame 058748/0943 →
Continuity (2)
Provisional Application 62956255 · Jan 1, 2020
Related Publication 20210201589A1 · Jul 1, 2021
Cited By (2)
US 12,536,749 US 12,678,692