IP Library Granted Patent US 12,120,434
Granted Patent B1
US 12,120,434 · App. 18/490,437 · Granted Oct 15, 2024

Sky sensor device

Inventors: Christian Humann (Berkeley, CA); Walter Thomas Barnum (Salt Lake City, UT); John B. Bogdan (Logan, UT); Robert Don Bruhn (West Jordan, UT); Andrew McNiel (Oakland, CA); Michael Scott Moulton (Heber City, UT); Benjamin Nagel (Salt Lake City, UT)
Assignee: Halio, Inc.
H04N23/743G01J1/42G02F1/163G06T3/60G06T7/60G06T7/70G06V10/25G06V10/60H04N23/51H04N23/71H04N23/741G01J2001/4266
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,120,434
App. No.
18/490,437
Granted
Oct 15, 2024
Kind
B1
Abstract

A sky sensor device for measuring direct normal illuminance (DNE) value is described. One method controls a camera sensor to capture a series of exposure-bracketed images having a first dynamic range and generate an image from the series of exposure-bracketed images, the image having a second dynamic range higher than the first dynamic range. The method controls an illuminance sensor to measure a global illuminance value. The method determines a global horizontal diffuse value based on at least the image. The method determines a direct normal illuminance (DNE) value using the global illuminance value and the global horizontal diffuse value.

Claims (70)

1. A processing device comprising:

a first interface coupled to a camera sensor;

a second interface coupled to an illuminance sensor; and

a processor core coupled to the first interface and the second interface, wherein the processor core is to:

control the camera sensor to capture a series of exposure-bracketed images having a first dynamic range and generate an image from the series of exposure-bracketed images, the image having a second dynamic range higher than the first dynamic range;

control the illuminance sensor to measure a global illuminance value;

determine a global horizontal diffuse value based on at least the image; and

determine a direct normal illuminance (DNE) value using the global illuminance value and the global horizontal diffuse value.

2. The processing device of claim 1 , wherein the processor core is further to send the DNE value to an electrochromic window system for controlling a tint level of one or more electrochromic windows of the electrochromic window system.

3. The processing device of claim 1 , wherein the processor core is further to:

determine a first location of the sky's zenith in the image;

determine a second location in the image representing an expected location of the sun using solar altitude and azimuth values;

create a region of interest (ROI) mask in the image at a predetermined radius from the second location;

determine a centroid location of a set of pixels within the ROI mask having brighter pixel values than other pixels in the ROI mask;

determine an angle, relative to the sky's zenith, between the second location and the centroid location; and

rotate the image by the angle to obtain a rotated image.

4. The processing device of claim 3 , wherein the processor core is further to:

determine that the angle satisfies a threshold condition representing a misaligned camera sensor; and

send, to a user, a notification of the misaligned camera sensor responsive to the angle satisfying the threshold condition.

5. The processing device of claim 1 , wherein the DNE value is an amount of illuminance in the visible spectrum and is indicative of a sky condition in a field of view of the camera sensor, the sky condition relating to glare from the sun on a window near the camera sensor.

6. The processing device of claim 5 , wherein the processor core is to report the sky condition to an electrochromic window system for controlling a tint level of one or more electrochromic windows of the electrochromic window system based on the sky condition.

7. The processing device of claim 1 , wherein the processor core is further to:

control the illuminance sensor to measure multiple global illuminance values;

average the multiple global illuminance values to determine an average global illuminance value; and

determine the direct normal illuminance (DNE) value using the average global illuminance value and the global horizontal diffuse value.

8. A method comprising:

controlling a camera sensor to capture a series of exposure-bracketed images having a first dynamic range and generate an image from the series of exposure-bracketed images, the image having a second dynamic range higher than the first dynamic range;

controlling an illuminance sensor to measure a global illuminance value;

determining a global horizontal diffuse value based on at least the image; and

determining a direct normal illuminance (DNE) value using the global illuminance value and the global horizontal diffuse value.

9. The method of claim 8 , further comprising sending the DNE value to an electrochromic window system for controlling a tint level of one or more electrochromic windows of the electrochromic window system.

10. The method of claim 8 , further comprising:

determining a first location of the sky's zenith in the image;

determining a second location in the image representing an expected location of the sun using solar altitude and azimuth values;

creating a region of interest (ROI) mask in the image at a predetermined radius from the second location;

determining a centroid location of a set of pixels within the ROI mask having brighter pixel values than other pixels in the ROI mask;

determining an angle, relative to the sky's zenith, between the second location and the centroid location; and

rotating the image by the angle to obtain a rotated image.

11. The method of claim 10 , further comprising:

determining that the angle satisfies a threshold condition representing a misaligned camera sensor; and

sending a notification to a user of the misaligned camera sensor responsive to the angle satisfying the threshold condition.

12. The method of claim 8 , wherein the DNE value is an amount of illuminance in the visible spectrum and is indicative of a sky condition in a field of view of the camera sensor, the sky condition relating to glare from the sun on a window near the camera sensor.

13. The method of claim 12 , further comprising reporting the sky condition to an electrochromic window system for controlling a tint level of one or more electrochromic windows of the electrochromic window system based on the sky condition.

14. The method of claim 8 , further comprising:

controlling the illuminance sensor to measure multiple global illuminance values;

averaging the multiple global illuminance values to determine an average global illuminance value; and

determining the direct normal illuminance (DNE) value using the average global illuminance value and the global horizontal diffuse value.

15. A computing system comprising:

a memory; and

a processing device operatively coupled to the memory, wherein the processing device is to:

control a camera sensor to capture a series of exposure-bracketed images having a first dynamic range and generate an image from the series of exposure-bracketed images, the image having a second dynamic range higher than the first dynamic range;

control an illuminance sensor to measure a global illuminance value;

determine a global horizontal diffuse value based on at least the image; and

determine a direct normal illuminance (DNE) value using the global illuminance value and the global horizontal diffuse value.

16. The computing system of claim 15 , wherein the processing device is further to send the DNE value to an electrochromic window system for controlling a tint level of one or more electrochromic windows of the electrochromic window system.

17. The computing system of claim 15 , wherein the processing device is further to:

determine a first location of the sky's zenith in the image;

determine a second location in the image representing an expected location of the sun using solar altitude and azimuth values;

create a region of interest (ROI) mask in the image at a predetermined radius from the second location;

determine a centroid location of a set of pixels within the ROI mask having brighter pixel values than other pixels in the ROI mask;

determine an angle, relative to the sky's zenith, between the second location and the centroid location; and

rotate the image by the angle to obtain a rotated image.

18. The computing system of claim 17 , wherein the processing device is further to:

determine that the angle satisfies a threshold condition representing a misaligned camera sensor; and

send, to a user, a notification of the misaligned camera sensor responsive to the angle satisfying the threshold condition.

19. The computing system of claim 15 , wherein the DNE value is an amount of illuminance in the visible spectrum and is indicative of a sky condition in a field of view of the camera sensor, the sky condition relating to glare from the sun on a window near the camera sensor, wherein the processing device is to report the sky condition to an electrochromic window system for controlling a tint level of one or more electrochromic windows of the electrochromic window system based on the sky condition.

20. The computing system of claim 15 , wherein the processing device is further to:

control the illuminance sensor to measure multiple global illuminance values;

average the multiple global illuminance values to determine an average global illuminance value; and

determine the direct normal illuminance (DNE) value using the average global illuminance value and the global horizontal diffuse value.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2025
From: HALIO , LLC
To: SMART WINDOW INC., LIMITED
Reel/Frame 070438/0439 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2025
From: HALIO , INC.
To: HALIO , LLC
Reel/Frame 070402/0474 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2023
From: HUMANN, CHRISTIAN; BARNUM, WALTER THOMAS; BOGDAN, JOHN B.; BRUHN, ROBERT DON; MCNIEL, ANDREW; MOULTON, MICHAEL SCOTT; NAGEL, BENJAMIN
To: KINESTRAL TECHNOLOGIES, INC.
Reel/Frame 065299/0377 →
CHANGE OF NAME Recorded Oct 20, 2023
From: KINESTRAL TECHNOLOGIES, INC.
To: HALIO, INC.
Reel/Frame 065304/0350 →