IP Library Granted Patent US 8,180,490
Granted Patent B2
US 8,180,490 · App. 12/007,027 · Granted May 15, 2012

Video-based sensing for daylighting controls

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,180,490
App. No.
12/007,027
Granted
May 15, 2012
Kind
B2
Abstract

A video imager may be used to measure the natural and/or artificial light levels in a space. The lighting estimates may be passed to a controller via a communication network. The lighting estimates may be in the form of actual radiance values, brightness, or other forms. The controller may determine if and which areas of the space require more light or if and which areas of the space have more light than required. Based on the lighting estimates, the controller may issue commands to turn on/off or dim/brighten the light from various ones or combinations of light sources in or around the space via actuators. The controller may also directly interface with the light sources.

Claims (74)

1. A method of video-based day-lighting control, comprising:

a. receiving video image information about a scene, the video image information comprising an image sequence including a plurality of images of the scene;

b. determining a light estimate for the scene based on the video image information;

c. regulating light provided to the scene based on the light estimate wherein the determining further comprises:

setting an exposure to a predetermined maximum exposure;

determining a brightness with the exposure set to the maximum exposure;

reducing the light to the scene if the measured brightness is larger than a predetermined maximum brightness;

setting the exposure to a predetermined minimum exposure;

determining a brightness with the exposure set to the minimum exposure; and

increasing the light to the scene if the measured brightness is less than a predetermined minimum brightness.

2. The method of claim 1 , wherein the light estimate comprises a brightness value.

3. The method of claim 1 , further comprising determining a radiance based on the brightness.

4. The method of claim 3 , wherein determining the radiance comprises:

determining a radiance based on the brightness with a current exposure; and

adjusting the current exposure if the radiance is outside a range and repeating until the radiance at each image location is determined.

5. The method of claim 1 , wherein the light estimate comprises radiance.

6. The method of claim 5 , wherein determining the radiance comprises:

capturing image information with a variety of exposures;

estimating a response function based on the image information; and

creating a radiance map based on the response function.

7. The method of claim 1 , further comprising:

a. defining a plurality of areas of interest within the space; and

b. individually controlling the light in the respective areas of interest based on the video image information from one video sensor.

8. The method of claim 7 , wherein the defining comprises at least one of:

c. receiving user input via a graphical user interface;

d. locating markers to denote boundaries of the areas of interest;

e. pacing out the areas of interest while the sensor is in a learning mode;

f. learning the space usage based on statistics; or

g. by the sensor learning the effect of each artificial light in the area by turning the light on and off.

9. The method of claim 1 , wherein determining the light estimate further comprises:

defining a range of light levels for the scene; and

determining if the light is within the range.

10. The method of claim 9 , wherein the range is determined at least one of manually or automatically.

11. The method of claim 1 , wherein determining the light estimate further comprises:

locating specular regions in the scene; and

determining the light estimate excluding the specular regions.

12. The method of claim 1 , wherein determining the light estimate further comprises:

computing a diffuse image for the scene; and

determining the light estimate based on the diffuse image.

13. The method of claim 7 , wherein step b comprises providing control signals for a plurality of light sources to control an amount of light.

14. A method of video-based day-lighting control, comprising:

a. receiving video image information about a scene, the video image information comprising an image sequence including a plurality of images of the scene;

b. determining a light estimate for the scene based on the video image information, including, 1) determining a respective measured brightness with the scene set to a minimum of a range and set to a maximum of the range; 2) storing the measured brightness value and corresponding exposure for which the measured brightness is within a dynamic range of the sensor; and 3) updating the exposure if the measured brightness is outside the dynamic range of the sensor and returning to step (2); and

c. regulating light provided to the scene based on the light estimate.

15. The method of claim 14 , wherein the light estimate comprises a brightness value.

16. The method of claim 14 , further comprising determining a radiance based on the brightness.

17. The method of claim 16 , wherein determining the radiance comprises:

determining a radiance based on the brightness with a current exposure; and

adjusting the current exposure if the radiance is outside a range and repeating until the radiance at each image location is determined.

18. The method of claim 14 , wherein the light estimate comprises radiance.

19. The method of claim 18 , wherein determining the radiance comprises:

capturing image information with a variety of exposures;

estimating a response function based on the image information; and

creating a radiance map based on the response function.

20. The method of claim 14 , further comprising:

defining a plurality of areas of interest within the space; and

individually controlling the light in the respective areas of interest based on the video image information from one video sensor.

21. The method of claim 20 , wherein the defining comprises at least one of:

a. receiving user input via a graphical user interface;

b. locating markers to denote boundaries of the areas of interest;

c. pacing out the areas of interest while the sensor is in a learning mode;

d. learning the space usage based on statistics; or

e. by the sensor learning the effect of each artificial light in the area by turning the light on and off.

22. The method of claim 14 , wherein determining the light estimate further comprises:

defining a range of light levels for the scene; and

determining if the light is within the range.

23. The method of claim 22 , wherein the range is determined at least one of manually or automatically.

24. The method of claim 14 , wherein determining the light estimate further comprises:

locating specular regions in the scene; and

determining the light estimate excluding the specular regions.

25. The method of claim 14 , wherein determining the light estimate further comprises:

computing a diffuse image for the scene; and

determining the light estimate based on the diffuse image.

26. The method of claim 20 , wherein individually controlling the light comprises providing control signals for a plurality of light sources to control an amount of light.

Assignments (7)
NUNC PRO TUNC ASSIGNMENT Recorded Oct 23, 2022
From: AVIGILON FORTRESS CORPORATION
To: MOTOROLA SOLUTIONS, INC.
Reel/Frame 061746/0897 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2018
From: HSBC BANK CANADA
To: AVIGILON FORTRESS CORPORATION
Reel/Frame 047032/0063 →
SECURITY INTEREST Recorded Apr 8, 2015
From: AVIGILON FORTRESS CORPORATION
To: HSBC BANK CANADA
Reel/Frame 035387/0569 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2014
From: OBJECTVIDEO, INC.
To: AVIGILON FORTRESS CORPORATION
Reel/Frame 034552/0425 →
RELEASE OF SECURITY AGREEMENT/INTEREST Recorded Feb 24, 2012
From: RJF OV, LLC
To: OBJECTVIDEO, INC.
Reel/Frame 027810/0117 →
GRANT OF SECURITY INTEREST IN PATENT RIGHTS Recorded Oct 28, 2008
From: OBJECTVIDEO, INC.
To: RJF OV, LLC
Reel/Frame 021744/0464 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2008
From: SHAFIQUE, KHURRAM HASSAN; HAERING, NIELS; LIPTON, ALAN J.; BISWAS, SOMA
To: OBJECTVIDEO, INC.
Reel/Frame 020749/0112 →