IP Library Granted Patent US 11,102,453
Granted Patent B2
US 11,102,453 · App. 15/899,210 · Granted Aug 24, 2021

Analytics based lighting for network cameras

Inventors: Nicholas Dye Abalos (San Francisco, CA); Ian Matthew Snyder (San Francisco, CA)
Assignee: CISCO TECHNOLOGY, INC.
H04N7/18H04N7/188H05B47/115H05B47/125G06T7/248G08B13/19608G08B13/19613H04N5/2256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,102,453
App. No.
15/899,210
Granted
Aug 24, 2021
Kind
B2
Abstract

Systems and methods are disclosed for intelligently activating light devices for optimized lighting conditions in a scene, where optimized illumination is provided by a subset of light devices within an array of light devices in communication with the camera. The systems and methods detect a target within a camera's field of view and determine an optimized illumination of the target according to a video analytics model. Lighting is adjusted in accordance with the determined optimized illumination.

Claims (63)

1. A method comprising:

detecting a plurality of targets within a field of view of a camera;

determining a plurality of factors to yield an optimized illumination of the plurality of targets, the plurality of factors including power resources of the camera and at least one of movement within the field of view of the camera or a number of objects within the field of view of the camera, the power resources of the camera including an amount of power needed to turn on a light device at a particular intensity, the light device being within an array of light devices communicatively coupled to the camera, the particular intensity based on a highest priority of one of the plurality of targets and a lowest priority of another one of the plurality of targets; and

adjusting lighting in accordance with the optimized illumination of the plurality of targets by sending a request to the array of light devices so a first subset of light devices within the array of light devices corresponding to the one of the plurality of targets is optimized to a first intensity and a second subset of light devices within the array of light devices corresponding to another one of the plurality of targets is optimized to a second intensity.

2. The method of claim 1 ,

wherein,

the plurality of factors includes the movement within the field of view,

the method includes tracking positions of the plurality of targets within the field of view over a time period and predicting at least one of a trajectory or a position of the one of the plurality of targets at a time subsequent to the time period, and

the sending of the request at the time subsequent to the time period.

3. The method of claim 1 , further comprising:

determining the amount of power needed to turn on the light device within the array of light devices at the particular intensity; and

based on the amount of power needed for the light device, determining whether to turn on the light device based on one or more contextual rules, the one or more contextual rules based on a context of a scene within the field of view and an energy budget for the camera.

4. The method of claim 3 , further comprising:

determining that the first subset of light devices within the array of light devices are able to focus on the one of the plurality of targets, and the second subset of light devices are unable to focus on the one of the plurality of targets; and

based on the energy budget, de-optimizing the second subset of light devices and redirecting power from the second subset of light devices to the first subset of light devices.

5. The method of claim 1 , further comprising:

informing a second camera to adjust lighting in accordance with the optimized illumination based on a trajectory of the one of the plurality of targets.

6. The method of claim 1 , further comprising:

capturing an audio source outside the field of view of the camera, the optimized illumination determined based on a location of the one of the plurality of targets inferred from the audio source.

7. The method of claim 1 , further comprising:

determining the one of the plurality of targets is of the highest priority based on a determination the one of the plurality of targets is a threat.

8. The method of claim 1 , further comprising:

determining the one of the plurality of targets is of the highest priority when the one of the plurality of targets is classified as human; and

determining the one of the plurality of targets is of the lowest priority when the another one of the plurality of targets is classified other than human.

9. A camera comprising:

at least one sensor for capturing data; and

at least one processor and at least one memory containing instructions that, when executed, cause the at least one processor to perform operations including:

detecting a plurality of targets within a field of view of the camera;

determining a plurality of factors to yield an optimized illumination of the plurality of targets, the plurality of factors including power resources of the camera and at least one of movement within the field of view of the camera or a number of objects within the field of view of the camera, the power resources of the camera including an amount of power needed to turn on a light device at a particular intensity, the light device being within an array of light devices communicatively coupled to the camera, the particular intensity based on a highest priority of one of the plurality of targets and a lowest priority of another one of the plurality of targets; and

adjusting lighting in accordance with the optimized illumination by sending a request to a subset of light devices within the array of light devices communicatively coupled to the camera so a first subset of light devices within the array of light devices corresponding to the one of the plurality of targets is optimized to a first intensity and a second subset of light devices within the array of light devices corresponding to another one of the plurality of targets is optimized to a second intensity.

10. The camera of claim 9 ,

wherein,

the plurality of factors includes the movement within the field of view,

the operations include tracking positions of the plurality of targets within the field of view over a time period and predicting at least one of a trajectory or a position of the one of the plurality of targets at a time subsequent to the time period, and

the sending of the request at the time subsequent to the time period.

11. The camera of claim 9 , wherein the operations include informing a second camera to adjust lighting in accordance with the optimized illumination based on a trajectory of the one of the plurality of targets.

12. The camera of claim 9 , wherein the operations include determining the one of the plurality of targets is of the highest priority based on a determination the one of the plurality of targets is a threat.

13. The camera of claim 9 ,

wherein the operations include:

determining the one of the plurality of targets is of the highest priority when the one of the plurality of targets is classified as a person, and

determining the one of the plurality of targets is of the lowest priority when the another one of the plurality of targets is classified other than human.

14. A system comprising:

a light device; and

a camera in communication with the light device, the camera including computer readable instructions stored thereon that, when executed, are effective to cause the camera to perform operations including:

detecting a plurality of targets within a field of view of the camera;

determining a plurality of factors to yield an optimized illumination of the plurality of targets, the plurality of factors including power resources of the camera and one or more of movement within the field of view of the camera or a number of objects within the field of view of the camera, the power resources of the camera including an amount of power needed to turn on the light device at a particular intensity, the light device being within an array of light devices communicatively coupled to the camera, the particular intensity based on a highest priority of one of the plurality of targets and a lowest priority of another one of the plurality of targets; and

adjusting lighting in accordance with the optimized illumination by sending a request to a subset of light devices within the array of light devices communicatively coupled to the camera so a first subset of light devices within the array of light devices corresponding to the one of the plurality of targets is optimized to a first intensity and a second subset of light devices within the array of light devices corresponding to another one of the plurality of targets is optimized to a second intensity.

15. The system of claim 14 , wherein the array of light devices is external to the camera, each light device within the array of light devices being located at a fixed position.

16. The system of claim 14 , wherein the array of light devices is built into the camera, each light device within the array of light devices having a different illumination area.

17. The system of claim 14 ,

wherein,

the plurality of factors includes the movement within the field of view,

the operations include tracking positions of the plurality of targets within the field of view over a time period and predicting at least one of a trajectory or a position of the one of the plurality of targets at a time subsequent to the time period, and

the sending of the request occurs at the time subsequent to the time period.

18. The system of claim 14 , wherein the operations include informing a second camera to adjust lighting in accordance with the optimized illumination based on a trajectory of the one of the plurality of targets.

19. The system of claim 14 ,

wherein the operations include:

determining the amount of power needed to turn on the light device within the array of light devices at the particular intensity; and

based on the amount of power needed for the light device, determining whether to turn on the light device based on one or more contextual rules, the one or more contextual rules based on a context of a scene within the field of view and an energy budget for the camera.

20. The system of claim 14 ,

wherein the operations include:

determining the one of the plurality of targets is of the highest priority when the one of the plurality of targets is classified as a person, and

determining the one of the plurality of targets is of the lowest priority when the another one of the plurality of targets is classified other than human.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2018
From: ABALOS, NICHOLAS DYE; SNYDER, IAN MATTHEW
To: CISCO TECHNOLOGY, INC.
Reel/Frame 044966/0914 →
Continuity (1)
Related Publication 20190261491A1 · Aug 22, 2019