IP Library › Granted Patent US 11,847,677
Granted Patent B2
US 11,847,677 · App. 17/878,989 · Granted Dec 19, 2023

Lighting and internet of things design using augmented reality

Inventors: Nam Chin Cho (Peachtree City, GA); Parth Joshi (Sugar Hill, GA); William Thomas Cook (Peachtree City, GA)
Assignee: SIGNIFY HOLDING B.V.
G06Q30/0621G02B27/017G06F3/04842G06Q30/04G06T15/50G06T15/506G06T19/006H04L12/1428H04L41/22H04L67/12H05B47/175G02B2027/0138G06T2210/04G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,847,677
App. No.
17/878,989
Granted
Dec 19, 2023
Kind
B2
Abstract

An augmented reality-based lighting design method includes displaying, by an augmented reality device, a real-time image of a target physical area on a display screen. The method further includes displaying, by the augmented reality device, a lighting fixture 3-D model on the display screen in response to a user input, where the lighting fixture 3-D model is overlaid on the real-time image of the target physical area. The method also includes displaying, by the augmented reality device, a lighting pattern on the display screen overlaid on the real-time image of the target physical area, wherein the lighting pattern is generated based on at least photometric data associated with the lighting fixture 3-D model.

Claims (46)

1. An augmented reality-based lighting design method, comprising:

detecting, by an augmented reality device, an existing light fixture installed in an area displayed on a touch sensitive display screen;

determining, by the augmented reality device, one or more surfaces and one or more of physical locations in the area using image or sensor data;

determining, by the augmented reality device, one or more replacement light fixtures based, at least in part, on the one or more determined surfaces, the one or more determined physical locations and at least one performance characteristic of the one or more replacement light fixtures;

displaying, on the touch sensitive display screen of the augmented reality device, at least one lighting fixture model associated with the one or more replacement light fixtures determined;

receiving, via the touch sensitive display screen of the augmented reality device, a user selection of one or more of the light fixture models; and

displaying, on the touch sensitive display screen of the augmented reality device, the user selected one or more lighting fixture models overlaid on a real-time image of the area displayed on the touch sensitive display screen at one or more of the determined physical locations.

2. The method of claim 1 , further comprising:

determining, by the augmented reality device, a recommended number of replacement light fixtures based on the at least one performance characteristic of the replacement light fixtures and the determined surfaces or physical locations detected; and

displaying copies of replacement light fixture models on the touch sensitive display screen, wherein the number of copies displayed corresponds to the determined recommended number.

3. The method of claim 1 , further comprising displaying illuminance values overlaid on the one or more surfaces of the area in the real-time image of the area, wherein one or more of the illuminance values are determined based on at least photometric data associated with the lighting fixture model of the replacement light fixture and spatial relationship between the one or more surfaces and the replacement light fixture model.

4. The method of claim 1 , wherein the selected lighting fixture model of the replacement light fixture is overlaid on the real-time image at a location of the existing light fixture in response to the selection.

5. The method of claim 1 , wherein determining the one or more replacement light fixtures is performed further based on a spatial relationship between the existing light fixture and the one or more surfaces.

6. The method of claim 1 , further comprising:

determining, by the augmented reality device, a second one or more replacement light fixtures; and

displaying, overlaid on the real-time image of the area displayed on the touch sensitive display screen, a second lighting fixture model.

7. The method of claim 6 , further comprising displaying illuminance values overlaid on the one or more surfaces of the area displayed on the touch sensitive display screen, wherein the illuminance values are determined based on combining at least photometric data associated with the lighting fixture model and photometric data associated with the second lighting fixture model, and spatial relationships of the light fixture model and the second light fixture model with the one or more surfaces.

8. The method of claim 1 , further comprising, determining, by the augmented reality device, a type of the existing light fixture based on at least the image data, wherein a type of the replacement light fixture is same as the type of the existing light fixture.

9. The method of claim 1 , further comprising, determining, by the augmented reality device, a type of the existing light fixture based on at least the image data, wherein a type of the replacement light fixture is different than the type of the existing light fixture.

10. The method of claim 1 , further comprising, measuring, by a sensor included on the AR device, an illuminance value observed in the area.

11. The method of claim 1 , further comprising, generating a bill of material that includes an identifier of the replacement light fixture.

12. The method of claim 1 , wherein displaying the user selected replacement light fixture model at one of the determined physical locations is based, at least in part, on the at least one performance characteristics of the one or more replacement light fixtures.

13. An augmented reality (AR) device, comprising:

a camera to capture a real-time image of an area;

a sensor;

a touch sensitive display screen;

a memory device storing a software code; and

a controller configured to execute the software code to:

detect an existing light fixture installed in the area using image data from the camera;

determine one or more surfaces and one or more physical locations in the area using the sensor or the image data from the camera;

determine one or more replacement light fixtures based, at least in part, on the determined one or more surfaces, the one or more determined physical locations and at least one performance characteristic of the one or more replacement light fixtures;

display, overlaid on the real-time image of the area displayed on the touch sensitive display screen, at least one lighting fixture model associated with the one or more replacement light fixtures determined;

receive, via a user interface of the augmented reality device, a user selection of one or more of the light fixture models; and

display the user selected one or more lighting fixture models overlaid on a real-time image of the area displayed on the touch sensitive display screen at one or more of the determined physical locations.

14. The AR device of claim 13 , wherein the controller is further configured to display illuminance values overlaid on the one or more surfaces displayed on the touch sensitive display screen.

15. The AR device of claim 14 , wherein the controller is further configured to determine the one or more of the illuminance values based on at least photometric data associated with the replacement light fixture and spatial relationship between the replacement light fixture and the one or more surfaces.

16. The AR device of claim 13 , wherein the controller is further configured to determine a type of the existing light fixture based on at least the image data from the camera, and wherein a type of the determined one or more replacement light fixtures is same as the type of the existing light fixture.

17. The AR device of claim 13 , wherein the controller is further configured to: display, on the touch sensitive display screen, the user selected replacement light fixture model at a one of the determined physical locations based, at least in part, on the at least one performance characteristics of the one or more replacement light fixtures.

18. The AR device of claim 13 , wherein the controller is further configured to:

determine a recommended number of replacement light fixtures based on the at least one performance characteristic of the replacement light fixtures and the determined surfaces or physical locations detected, and

display copies of replacement light fixture models on the touch sensitive display screen, wherein the number of copies displayed corresponds to the determined recommended number.

19. The AR device of claim 13 , wherein the at least a portion of the memory or software code is remotely located from the AR device and accessible by the controller via wireless communication with the AR device.

20. The AR device of claim 13 , wherein the controller is further configured to:

determine a second one or more replacement light fixtures,

display a second lighting fixture model overlaid on the real-time image of the area displayed on the touch sensitive display screen, and

display illuminance values overlaid on the one or more surfaces of the area displayed on the touch sensitive display screen, wherein the illuminance values are determined based on combining at least photometric data associated with the lighting fixture model and photometric data associated with the second lighting fixture model, and spatial relationships of the light fixture model and the second light fixture model with the one or more surfaces.

Continuity (4)
Continuation 16916526 · Jun 30, 2020
Continuation 15971623 · May 4, 2018
Provisional Application 62608361 · Dec 20, 2017
Related Publication 20230015451A1 · Jan 19, 2023