IP Library Granted Patent US 11,941,794
Granted Patent B2
US 11,941,794 · App. 16/997,054 · Granted Mar 26, 2024

Commissioning of lighting system aided by augmented reality

Inventors: Glenn Howard Kuenzler (East Cleveland, OH); Taylor Apolonius Barto (East Cleveland, OH)
Assignee: CURRENT LIGHTING SOLUTIONS, LLC
G06T7/0004G01C21/3804G01C21/3811G01S5/013G06F18/251G06T7/11G06T7/136G06T7/70G06T2207/20012G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,941,794
App. No.
16/997,054
Granted
Mar 26, 2024
Kind
B2
Abstract

System and methods and computer program code are provided to perform a commissioning process comprising capturing, using an image capture device, an image of an area containing at least a first fixture, identifying location and positioning information associated with the image, performing image processing of the image to identify a location of the at least first fixture in the image, and converting the location of the at least first fixture in the image into physical coordinate information associated with the at least first fixture.

Claims (39)

1. A method, comprising:

capturing, using an image capture device, an image of an area containing at least a first fixture;

identifying physical location and positioning information associated with the image capture device;

identifying pixel coordinates in the image of the at least first fixture in the image by performing image processing of the image including a first thresholding process and a second thresholding process, wherein the first thresholding process generates a first thresholding process image including a plurality of pixels, each pixel of the plurality of pixels having a value of black or white and the second thresholding process generates, using a threshold value based on a neighboring area of pixels, a second thresholding process image;

pixel-by-pixel processing the first thresholding process image and the second thresholding process image to generate a third image; and generating a final image

by processing, using an OR function, the third image and the first thresholding process image;

and

converting pixel coordinates of the at least first fixture in the final image into physical coordinate information associated with the at least first fixture.

2. The method of claim 1 , wherein the identifying physical location and positioning information associated with the image capture device is performed using an augmented reality application that identifies a physical location of the at least first fixture in relation to an anchor point.

3. The method of claim 2 , wherein the image capture device is a camera of a mobile device.

4. The method of claim 1 , wherein the performing image processing of the image further comprises:

performing at least a first operation to produce a modified image having pixels of a first value that represent the at least first fixture; and

determining a reference point and orientation vector of the at least first fixture.

5. The method of claim 1 , further comprising:

prior to performing image processing of the image, normalizing an exposure of the image.

6. The method of claim 1 , wherein the capturing and performing image processing are performed at different times, the method further comprising:

adjusting the physical coordinate information to account for movement of the image capture device during processing.

7. The method of claim 1 , further comprising:

storing the physical coordinate information in a map table associated with a lighting installation.

8. The method of claim 7 , further comprising:

storing an identifier of the at least first fixture in the map table.

9. The method of claim 1 , further comprising:

generating a display on a display device prompting a user of the image capture device to perform a further image capture operation.

10. The method of claim 1 , wherein a location of the at least first fixture in the image analyzed by the image processing is in a different coordinate system than a physical coordinate system associated with the physical coordinate information.

11. The method of claim 1 , wherein the first thresholding process is a global thresholding process generating the first thresholding process image and the second thresholding process is a local thresholding process generating the second thresholding process image.

12. The method of claim 11 , further comprising:

generating the third image by processing the first thresholding process image and the second thresholding process image using an AND function.

13. A non-transitory, computer-readable medium storing instructions, that, when executed by a processor, cause the processor to perform a mapping method comprising:

capturing, using an image capture device, an image of an area containing at least a first fixture;

identifying location and positioning information associated with the image capture device;

identifying pixel coordinates in the image of the at least first fixture in the image by performing image processing of the image including a first thresholding process and a second thresholding process, wherein the first thresholding process generates a first thresholding process image including a plurality of pixels, each pixel of the plurality of pixels having a value of black or white and the second thresholding process generates, using a threshold value based on a neighboring area of pixels, a second thresholding process image;

pixel-by-pixel processing the first thresholding process image and the second thresholding process image to generate a third image; and generating a final image

by processing, using an OR function, the third image and the first thresholding process image;

and

converting a location of the at least first fixture in the final image into physical coordinate information associated with the at least first fixture.

14. The non-transitory, computer-readable medium of claim 13 , wherein the identifying location and positioning information associated with the image capture device is performed using an augmented reality application that identifies a location of the at least first fixture in relation to an anchor point.

15. The non-transitory, computer-readable medium of claim 13 , wherein the performing image processing of the image further comprises:

performing at least a first operation to produce a modified image having pixels of a first value that represent the at least first fixture; and

determining a reference point and orientation vector of the at least first fixture.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER PREVIOUSLY RECORDED AT REEL: 059034 FRAME: 0469. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 25, 2024
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NETWORKS INC.; FORUM, INC.
To: ATLANTIC PARK STRATEGIC CAPITAL FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 066372/0590 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 10841994 TO PATENT NUMBER 11570872 PREVIOUSLY RECORDED ON REEL 058982 FRAME 0844. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT. Recorded Jan 19, 2024
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NETWORKS INC.; FORUM, INC.
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 066355/0455 →
SECURITY INTEREST Recorded Feb 11, 2022
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NETWORKS INC.; FORUM, INC.
To: ATLANTIC PARK STRATEGIC CAPITAL FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 059034/0469 →
SECURITY AGREEMENT Recorded Feb 2, 2022
From: HUBBELL LIGHTING, INC.; LITECONTROL CORPORATION; CURRENT LIGHTING SOLUTIONS, LLC; DAINTREE NEETWORKS INC.; FORUM, INC.
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 058982/0844 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2020
From: KUENZLER, GLENN HOWARD; BARTO, TAYLOR APOLONIUS
To: CURRENT LIGHTING SOLUTIONS, LLC
Reel/Frame 053536/0106 →
Continuity (2)
Provisional Application 62889019 · Aug 19, 2019
Related Publication 20210056680A1 · Feb 25, 2021