System and method for producing a video stream
Methods, systems, and computer program products for providing a shared digital video stream. A first and a second digital video stream are collected. The shared stream is produced based on the first stream so that the first source is visible in the shared stream, but so that the second source is not visible in the shared stream. The first and/or second stream are analysed to detect a trigger, based on detection of a predetermined image and/or audio pattern, the trigger being a detected gazing or a gesture. The shared stream based on the second stream and/or based on the first source but with at least one of a different cropping, a different zooming, a different panning, or a different focus plane selection. The output stream is provided to a consumer.
1. A method for providing a shared digital video stream, the method comprising:
in a collecting step, collecting from a first digital video source a first digital video stream and from a second digital video source a second digital video stream;
in a first production step, producing the shared digital video stream as an output digital video stream based on consecutively considered frames of the first digital video stream so that image information from the first digital video source is visible in the shared digital video stream, but so that image information from the second digital video source is not visible in the shared digital video stream;
in a trigger detection step, automatically detecting a trigger by performing at least one of:
a) digitally analyzing the first digital video stream to automatically detect the trigger in the form of a participant depicted in the first digital video stream gazing towards, or making a predetermined gesture in relation to, an object depicted in the second digital video stream, the detection being based on information about a relative orientation of the first camera, the participant and the object, the detection further being based on a digital image-based determination of at least one of a body direction, a head direction, a gaze direction and a gesture direction of the participant in question; and
b) digitally analyzing the first and/or second digital video stream to automatically detect the trigger in the form of a transition of a gaze direction of the participant depicted in the second digital video stream from not gazing into the second camera to gazing into the second camera,
the trigger being instructive, according to a predetermined production rule, to alter the production mode of the shared digital video stream;
in a second production step, initiated in response to the detection of the trigger, producing the shared digital video stream as an output digital video stream based on consecutively considered frames of the second digital video stream so that image information from the second digital video source is visible in the shared digital video stream, and/or producing the shared digital video stream as an output digital video stream based on consecutively considered frames of the first digital video source but with at least one of a different cropping, a different zooming, a different panning or a different focus plane selection of the first digital video stream as compared to the first production step; and
in a publishing step, continuously providing the output digital video stream to two or more consumers of the shared digital video stream.
2. The method of claim 1 , wherein:
the first digital video stream is continuously captured by a first digital camera; and
the second digital video stream is continuously captured by a second digital camera.
3. The method of claim 1 , wherein:
the second object is a human, a group of humans, a machine, a whiteboard, or a presentation screen.
4. The method of claim 1 , wherein:
the gesture is a pointing towards the object.
5. The method of claim 1 , wherein:
the detection of the trigger comprises detecting a predetermined image pattern in turn comprising a relative change of movement in the first and/or second digital video stream.
6. The method of claim 1 , further comprising:
determining a location of the participant and the object, in relation to the first camera and/or the second camera, using digital image processing based on the first and/or second digital video stream.
7. The method of claim 1 , wherein:
the second production step comprises determining a particular one second camera among several possible second cameras currently showing the object and selecting that second camera as the one providing the second video stream in question.
8. The method of claim 1 , wherein:
the production in the second production step is configured to highlight or shift focus of the output digital video stream so as to provide increased visual focus to the object.
9. The method of claim 1 , further comprising:
a delaying step, wherein a latency is deliberately introduced with respect to at least the first and the second digital video stream, the latency being present in the shared digital video stream, wherein:
the trigger detection step is performed based on the first and/or second digital video streams before introducing the latency.
10. The method of claim 9 , wherein:
the latency is at most 30 seconds.
11. A computer program product for providing a shared digital video stream, the computer program product being stored on a non-transitory computer readable medium and comprising instructions that when executed by a processor cause the processor to perform:
a collecting step, wherein a first digital video stream is collected from a first digital video source and a second digital video stream is collected from a second digital video source;
a first production step, wherein the shared digital video stream is produced as an output digital video stream based on consecutively considered frames of the first digital video stream so that image information from the first digital video source is visible in the shared digital video stream, but so that image information from the second digital video source is not visible in the shared digital video stream;
a trigger detection step, wherein a trigger is automatically detected by at least one of:
a) digitally analyzing the first digital video stream to automatically detect the trigger in the form of a participant depicted in the first digital video stream gazing towards, or making a predetermined gesture in relation to, an object depicted in the second digital video stream, the detection being based on information about a relative orientation of the first camera, the participant and the object, the detection further being based on a digital image-based determination of at least one of a body direction, a head direction, a gaze direction and a gesture direction of the participant in question; and
b) digitally analyzing the first and/or second digital video stream to automatically detect the trigger in the form of a transition of a gaze direction of the participant depicted in the second digital video stream from not gazing into the second camera to gazing into the second camera,
the trigger being instructive, according to a predetermined production rule, to alter the production mode of the shared digital video stream;
a second production step, initiated in response to the detection of the trigger, wherein the shared digital video stream is produced as an output digital video stream based on consecutively considered frames of the second digital video stream so that image information from the second digital video source is visible in the shared digital video stream, and/or the shared digital video stream is produced as an output digital video stream based on consecutively considered frames of the first digital video source but with at least one of a different cropping, a different zooming, a different panning or a different focus plane selection of the first digital video stream as compared to the first production step; and
a publishing step, wherein the output digital video stream is continuously provided to two or more consumers of the shared digital video stream.
12. A system for providing a shared digital video stream, the system comprising a central server in turn comprising:
a collecting function, arranged to collect from a first digital video source a first digital video stream and from a second digital video source a second digital video stream;
a first production function, arranged to produce the shared digital video stream as an output digital video stream based on consecutively considered frames of the first digital video stream so that image information from the first digital video source is visible in the shared digital video stream, but so that image information from the second digital video source is not visible in the shared digital video stream;
a trigger detection function, arranged to automatically detect a trigger by performing at least one of:
a) digitally analyzing the first digital video stream to automatically detect the trigger in the form of a participant depicted in the first digital video stream gazing towards, or making a predetermined gesture in relation to, an object depicted in the second digital video stream, the detection being based on information about a relative orientation of the first camera, the participant and the object, the detection further being based on a digital image-based determination of at least one of a body direction, a head direction, a gaze direction and a gesture direction of the participant in question; and
b) digitally analyzing the first and/or second digital video stream to automatically detect the trigger in the form of a transition of a gaze direction of the participant depicted in the second digital video stream from not gazing into the second camera to gazing into the second camera,
the trigger being instructive, according to a predetermined production rule, to alter the production mode of the shared digital video stream;
a second production function, arranged to be initiated in response to the detection of the trigger, and to produce the shared digital video stream as an output digital video stream based on consecutively considered frames of the second digital video stream so that image information from the second digital video source is visible in the shared digital video stream, and/or to produce the shared digital video stream as an output digital video stream based on consecutively considered frames of the first digital video source but with at least one of a different cropping, a different zooming, a different panning or a different focus plane selection of the first digital video stream as compared to the first production function; and
a publishing function, arranged to continuously provide the output digital video stream to two or more consumers of the shared digital video stream.