IP Library Granted Patent US 9,367,925
Granted Patent B2
US 9,367,925 · App. 14/735,851 · Granted Jun 14, 2016

Image detection and processing for building control

Inventors: Peter Dominic Kovesi (Shenton Park, AU); Evan Danny Petridis (South Fremantle, AU); Tanuj Mohan (Mountain View, CA)
Assignee: enLighted, Inc.
G06T7/2033G06T7/2053G06T7/408H04N5/23229G06T2207/10016G06T2207/10024G06T2207/20224G06T2207/30196G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,367,925
App. No.
14/735,851
Granted
Jun 14, 2016
Kind
B2
Abstract

Occupancy detection for building environmental control is disclosed. One apparatus includes at least one image sensor and a controller, wherein the controller is operative to obtain a plurality of images from the image sensor, determine a color difference image of a color difference between consecutive images, determine areas of the color difference image wherein the color difference is greater than a threshold, calculate a total change area as an aggregate area of the determined areas, create a list of occupancy candidates based on filtering of the determined areas if the total change area is less than a light change threshold, wherein each occupancy candidate is represented by a connected component, track the one or more occupancy candidates over a period of time, and detect occupancy if one or more of the occupancy candidates is detected to have moved more than a movement threshold over the period of time.

Claims (26)

1. An apparatus, comprising:

at least one image sensor;

a controller, wherein at least one of the controller, or an external controller electronically connected to the controller are operative to:

obtain a plurality of images from the image sensor;

determine a color difference image of a color difference between consecutive images;

determine areas of the color difference image wherein the color difference is greater than a threshold;

calculate a total change area as an aggregate area of the determined areas;

create a list of occupancy candidates based on filtering of the determined areas if the total change area is less than a light change threshold, wherein each occupancy candidate is represented by a connected component;

track the one or more occupancy candidates over a period of time; and

detect occupancy if one or more of the occupancy candidates is detected to have moved more than a movement threshold over the period of time.

2. The apparatus of claim 1 , wherein the apparatus is further operative to power an infrared (IR) illuminator proximate the at least one sensor if lighting proximate to the apparatus is sensed to be below a lighting threshold.

3. The apparatus of claim 2 , wherein the controller is further operative reduce a frame or image rate of the plurality of images.

4. The apparatus of claim 2 , wherein the IR illuminator is strobed with a pattern that is synchronous with a frame capture times sequence of the plurality of images.

5. The apparatus of claim 1 , wherein the controller is further operative to measure temporal sequences of movement of the occupancy candidates, and comparing the measured temporal sequences to a database of temporal sequences known to be associated with humans, allowing an estimate of a likelihood that one or more humans appear in the plurality of images.

6. A method of detecting occupancy, comprising:

obtaining a plurality of images;

determining a color difference image of a color difference between consecutive images;

determining areas of the color difference image wherein the color difference is greater than a threshold;

calculating a total change area as an aggregate area of the determined areas;

creating a list of occupancy candidates based on filtering of the determined areas if the total change area is less than a light change threshold, wherein each occupancy candidate is represented by a connected component;

tracking the one or more occupancy candidates over a period of time; and

detecting occupancy if one or more of the occupancy candidates is detected to have moved more than a movement threshold over the period of time.

7. The method of claim 6 , further comprising powering an infrared (IR) illuminator proximate to a device that is obtaining a plurality of images if lighting proximate to the device is sensed to be below a lighting threshold.

8. The method of claim 7 , further comprising reducing a frame or image rate of the plurality of images.

9. The method of claim 8 , wherein the IR illuminator is strobed with a pattern that is synchronous with a frame capture times sequence of the plurality of images.

10. The method of claim 6 , further comprising measuring temporal sequences of movement of the occupancy candidates, and comparing the measured temporal sequences to a database of temporal sequences known to be associated with humans, allowing an estimate of a likelihood that one or more humans appear in the plurality of images.

Assignments (4)
MERGER Recorded Oct 22, 2025
From: BUILDING ROBOTICS, INC.
To: SIEMENS INDUSTRY, INC.
Reel/Frame 073156/0424 →
MERGER Recorded Oct 21, 2021
From: ENLIGHTED, INC.
To: BUILDING ROBOTICS, INC.
Reel/Frame 057883/0238 →
SECURITY INTEREST Recorded Feb 1, 2016
From: ENLIGHTED, INC.
To: PACIFIC WESTERN BANK
Reel/Frame 037631/0651 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2015
From: KOVESI, PETER DOMINIC; PETRIDIS, EVAN DANNY; MOHAN, TANUJ
To: ENLIGHTED, INC.
Reel/Frame 035818/0396 →
Continuity (3)
Division 14016055 · Aug 31, 2013
Provisional Application 61699946 · Sep 12, 2012
Related Publication 20150279051A1 · Oct 1, 2015