IP Library Granted Patent US 11,435,704
Granted Patent B2
US 11,435,704 · App. 17/111,000 · Granted Sep 6, 2022

Visible light sensor configured for glare detection and controlling motorized window treatments

Inventors: Craig Alan Casey (Coopersburg, PA); Brent Protzman (Easton, PA)
Assignee: Lutron Technology Company LLC
G05B11/01E06B9/32E06B9/68G06T7/0002G06T7/73G06T7/97E06B2009/6827
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,435,704
App. No.
17/111,000
Granted
Sep 6, 2022
Kind
B2
Abstract

A sensor and/or system controller may process an image multiple times at multiple resolutions to detect glare conditions. A glare condition threshold used to determine whether a glare condition exists may be based on the resolution of the image. When the resolution of the image is higher, the glare condition threshold may be higher. The sensor and/or system controller may organize one or more adjacent pixels having similar intensities into pixel groups. The pixel groups may vary in size and/or shape. The sensor and/or system controller may determine a representative group luminance for the pixel group (e.g., an average luminance of the pixels in the group). The sensor and/or system controller may determine a group glare condition threshold, which may be used to determine whether a glare condition exists for the group of pixels and/or may be based on the size of the group.

Claims (79)

1. A method for detecting a location of a glare condition and for controlling a shade position of a motorized window treatment, the method comprising:

recording one or more images;

processing at least one image at a plurality of different resolutions;

determining if a glare condition exists in the at least one image at each of the plurality of different resolutions, wherein the glare condition at each of the plurality of different resolutions is determined when a luminance value of a pixel in the at least one image exceeds a respective glare condition threshold for the resolution; and

generating control instructions for controlling the shade position of the motorized window treatment to a position corresponding to a location of the glare condition detected at one of the plurality of resolutions.

2. The method of claim 1 , further comprising:

processing the at least one image at a first resolution to detect a first glare condition;

determining a first glare condition threshold based on the first resolution;

determining a first location of the first glare condition in the at least one image at the first resolution based on the first glare condition threshold;

processing the at least one image at a second resolution that is lower than the first resolution to detect a second glare condition;

determining a second glare condition threshold based on the second resolution;

determining a second location of the second glare condition in the at least one image at the second resolution based on the second glare condition threshold; and

determining a lowest of the first and second glare conditions detected based on the respective location for each of the glare conditions.

3. The method of claim 2 , wherein the at least one image comprises a first plurality of pixels at the first resolution, and a second plurality of pixels at the second resolution.

4. The method of claim 3 , further comprising processing the at least one image at the first resolution by beginning to process the first plurality of pixels of the at least one image from a bottom towards a top of the at least one image until a luminance value of a processed pixel exceeds the first glare condition threshold; and

processing the at least one image at the second resolution by beginning to process the second plurality of pixels of the at least one image from a bottom towards a top of the at least one image until a luminance value of a processed pixel exceeds the second glare condition threshold.

5. The method of claim 4 , further comprising:

storing a first location for the processed pixel that exceeds the first glare condition threshold; and

storing a second location for the processed pixel that exceeds the second glare condition threshold in the memory.

6. The method of claim 5 , further comprising determining a profile angle based on a lowest location of the first location and the second location, wherein the shade position of the motorized window treatment is based on the profile angle.

7. The method of claim 2 , further comprising:

retrieving a first image at the first resolution;

processing the first image to detect the first glare condition;

retrieving a second image at the second resolution; and

processing the second image to detect the second glare condition.

8. The method of claim 2 , further comprising:

retrieving a first image at the first resolution;

processing the first image to detect the first glare condition;

subsequently reducing the resolution of the first image to the second resolution; and

processing the second image to detect the second glare condition.

9. The method of claim 1 , further comprising processing the at least one image at each resolution from a bottom row of pixels to a top row of pixels until a lowest glare condition for the resolution is detected, wherein the lowest glare condition for each resolution of the at least one image is a first pixel having a luminance value that exceeds the glare condition threshold for the resolution.

10. The method of claim 1 , further comprising:

retrieving the at least one image via a visible light sensing circuit; and

de-warping the at least one image.

11. The method of claim 1 , further comprising converting the at least one image to the plurality of different resolutions.

12. The method of claim 1 , wherein the one or more images are recorded at the plurality of different resolutions.

13. The method of claim 1 , wherein the respective glare condition threshold is directly related to the resolution.

14. The method of claim 1 , further comprising transmitting the control instructions for controlling the shade position of the motorized window treatment.

15. A method for detecting a location of a glare condition and for controlling a shade position of a motorized window treatment, the method comprising:

recording one or more images;

organizing one or more adjacent pixels in the image into a group of pixels, each of the one or more adjacent pixels having a similar intensity, wherein the group of pixels comprises a group size and a representative group luminance;

determining a glare condition threshold for the group of pixels based on the group size;

detecting a glare condition when the representative group luminance exceeds the group glare condition threshold; and

generating control instructions for controlling the shade position of the motorized window treatment to a location corresponding to a lowest pixel in the group in response to detecting the glare condition.

16. The method of claim 15 , wherein the representative group luminance is an average luminance of the one or more adjacent pixels.

17. The method of claim 15 , wherein the representative luminance is a luminance of a pixel, in the one or more adjacent pixels, having a highest luminance.

18. The method of claim 15 , wherein the group glare condition threshold is directly proportional to the group size.

19. The method of claim 15 , further comprising determining a profile angle based on the location of the lowest pixel in the group of pixels, wherein the shade position of the motorized window treatment is based on the profile angle.

20. The method of claim 15 , further comprising transmitting the control instructions for controlling the shade position of the motorized window treatment.

21. A non-transitory computer readable medium comprising executable instructions stored thereon that, when executed by a control circuit, cause the control circuit to:

retrieve one or more images;

process at least one image at a plurality of different resolutions;

determine if a glare condition exists in the at least one image at each of the plurality of different resolutions, wherein the glare condition at each of the plurality of different resolutions is determined when a luminance value of a pixel in the at least one image exceeds a respective glare condition threshold for the resolution; and

generate control instructions for controlling a shade position of a motorized window treatment to a position corresponding to a location of the glare condition detected at one of the plurality of resolutions.

22. The computer-readable medium of claim 21 , wherein the instructions, when executed, further cause the control circuit to:

process the at least one image at a first resolution to detect a first glare condition;

determine a first glare condition threshold based on the first resolution;

determine a first location of the first glare condition in the at least one image at the first resolution based on the first glare condition threshold;

process the at least one image at a second resolution that is lower than the first resolution to detect a second glare condition;

determine a second glare condition threshold based on the second resolution;

determine a second location of the second glare condition in the at least one image at the second resolution based on the second glare condition threshold; and

determine a lowest of the first and second glare conditions detected based on the respective location for each of the glare conditions.

23. The computer-readable medium of claim 21 , wherein the at least one image comprises a first plurality of pixels at the first resolution, and a second plurality of pixels at the second resolution, and wherein the instructions, when executed, further cause the control circuit to:

process the at least one image at the first resolution by beginning to process the first plurality of pixels of the at least one image from a bottom towards a top of the at least one image until a luminance value of a processed pixel exceeds the first glare condition threshold; and

process the at least one image at the second resolution by beginning to process the second plurality of pixels of the at least one image from a bottom towards a top of the at least one image until a luminance value of a processed pixel exceeds the second glare condition threshold.

24. The computer-readable medium of claim 23 , wherein the instructions, when executed, further cause the control circuit to:

store a first location for the processed pixel that exceeds the first glare condition threshold; and

store a second location for the processed pixel that exceeds the second glare condition threshold in the memory.

25. The computer-readable medium of claim 21 , wherein the instructions, when executed, further cause the control circuit to transmit the control instructions for controlling the shade position of the motorized window treatment.

26. A non-transitory computer readable medium comprising executable instructions stored thereon that, when executed by a control circuit, cause the control circuit to:

retrieve one or more images;

organize one or more adjacent pixels in the image into a group of pixels, each of the one or more adjacent pixels having a similar intensity, wherein the group of pixels comprises a group size and a representative group luminance;

determine a glare condition threshold for the group of pixels based on the group size;

detect a glare condition when the representative group luminance exceeds the group glare condition threshold; and

generate control instructions for controlling a shade position of a motorized window treatment to a location corresponding to a lowest pixel in the group in response to detecting the glare condition.

27. The computer-readable medium of claim 26 , wherein the representative group luminance is one of:

an average luminance of the one or more adjacent pixels; or

a luminance of a pixel, in the one or more adjacent pixels, having a highest luminance.

28. The computer-readable medium of claim 26 , wherein the instructions, when executed, further cause the control circuit to transmit the control instructions for controlling the shade position of the motorized window treatment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2024
From: CASEY, CRAIG ALAN; PROTZMAN, BRENT
To: LUTRON TECHNOLOGY COMPANY LLC
Reel/Frame 066684/0575 →
Continuity (3)
Continuation 16442016 · Jun 14, 2019
Provisional Application 62684951 · Jun 14, 2018
Related Publication 20210109484A1 · Apr 15, 2021
Cited By (1)
US 12,423,943