Rendering a dynamic light scene based on audio visual content
A method of controlling a connected lighting system based on audio-visual content. The method comprises automatically performing operations of: color extraction from an image comprised in video component of the audio-visual content, calculating an audio intensity level of an audio sample of the audio component of the audio-visual content, determining of a first target light color and a first audio intensity level based on the extracted color and the calculated audio intensity level; and controlling at least one lighting device according to the determined first target light color and the first audio intensity level. This method provides for control in a manner which increases immersion of a user experiencing the audio-visual content as being rendered by, for example a TV, through providing light effects by a connected lighting system.
1. A method of controlling a connected lighting system, comprising one or more lighting devices, based on audio-visual content, the method comprising automatically performing operations of:
extracting a first and second color from an image comprised in, respectively, a first and second segment of the audio-visual content, wherein the second segment is a segment of the audio-visual content subsequent to the first segment;
calculating a first and second audio intensity level of an audio sample comprised in, respectively, the first and second segment of the audio-visual content;
determining a first and second target light color, based on, respectively, the extracted first and second color;
on the condition that the first audio intensity level exceeds and that the second audio intensity level does not exceed an upper threshold audio intensity level, performing the steps of:
determining a first and second target light intensity level, based on, respectively, the calculated first audio intensity level and a predetermined intensity level;
controlling at least one lighting device of the lighting system to emit a first light effect according to the determined first target light color and the determined first target light intensity level; and
controlling at least one lighting device of the lighting system to emit a second light effect according to the determined second target light color and the determined second target light intensity level;
wherein the predetermined intensity level is based on an envelope function comprising
a decay function which defines a light intensity level decreasing over time from the first target light intensity level to a minimum light intensity level; or
an attack function which defines a light intensity level increasing over time from the first target light intensity level to a maximum light intensity level.
2. The method of claim 1 , the method further comprising:
determining the minimum respectively maximum intensity level based on an audio intensity level of an audio sample comprised in at least one segment of the audio-visual content preceding the first segment.
3. The method of claim 1 , wherein the minimum respectively maximum light intensity level is user definable.
4. The method of claim 1 , wherein the minimum respectively maximum light intensity level is based on a volume level at which the audio-visual content is rendered and/or based on a sensor signal indicative of an amount of movement of one or more users exposed to a rendering of the audio-visual content.
5. The method of claim 1 , wherein the rate at which the light intensity level defined by the decay or attack function decreases respectively increases over time is dependent upon the calculated second audio intensity level.
6. The method of claim 1 , wherein the first target light intensity level is limited to a maximum light intensity level.
7. The method of claim 6 , the method further comprising:
determining the maximum light intensity level based on an audio intensity level of an audio sample comprised in at least one segment of the audio-visual content preceding the first segment.
8. The method of claim 6 , wherein the maximum light intensity level is user definable.
9. The method of claim 1 , wherein the first light effect comprises rendering the first target light color at a light intensity which increases, over time, from an initial light intensity to the determined first target intensity light level.
10. The method of claim 9 , wherein the initial light intensity level is the minimum light intensity level.
11. The method of claim 1 , wherein one or more of the at least one lighting device which is controlled to emit the first light effect is further controlled to emit the second light effect, such that, for the one or more of the at least one lighting device, the first light effect is effectively replaced by the second light effect.
12. A computer program product comprising code embodied on computer-readable storage, configured so as when run on one or more processing units to perform the operations of claim 1 .
13. A controller for a connected lighting system comprising storage storing code and one or more processing units arranged to run said code, the code being configured so as when run to perform the operations of claim 1 .