Methods for interactive video compositing
An interactive video compositing device includes a chroma-key mixer, video switcher and control circuitry. The chroma-key mixer generates a composite image by combining a real-time image, such as one captured by a video recorder, with a prerecorded video image, such as a movie. The composite image includes the modified real-time image superimposed, or overlaid, onto the prerecorded image. The video switcher automatically selects either the composite image or the prerecorded image to be output to a display. The control circuitry controls the video switcher and other outputted signals based on data file information that corresponds to content of the prerecorded image or media. For example, the data files may contain information relating to the presence (or absence) of a particular character in a movie scene, thus allowing for the output and display, at appropriate times, of the real-time composite image instead of the prerecorded image.
1. A method for video compositing, the method comprising:
receiving a first audio signal and a first video signal, the first video signal comprising video content having multiple frames, the video content representing a cinematic scene comprising at least first and second characters;
receiving a second audio signal and a second video signal, the second video signal comprising a real-time video image of a participant, and the second audio signal being associated with the participant;
creating a combined video signal comprising the first video signal and the second video signal, wherein portions of the combined video signal comprise the real-time video image of the participant, and wherein the combined video signal is configured to cause the display of the real-time video image of the participant as the first character in the video content;
accessing data that corresponds to certain ones of the multiple frames of the first video signal, the data comprising,
first reference data that identifies a first frame of the multiple frames in which the participant is to be displayed as the first character in the video content in place of the first character when the first character would have appeared in the cinematic scene,
second reference data that identifies a second frame of the multiple frames in which the participant is to be removed as the first character in the video content, and
third reference data that identifies a third frame of the multiple frames in which the participant is to be re-displayed as the first character in the video content in place of the first character when the first character would have re-appeared in the cinematic scene; and
selectively switching between outputting the first video signal and outputting the combined video signal, wherein said selective switching is performed automatically based at least in part on the data that corresponds to the certain ones of the multiple frames of the first video signal, whereby at a first time identified by the first reference data the participant is displayed as the first character in the cinematic scene of the video content, whereby at a second time identified by the second reference data the cinematic scene of the video content is displayed without the participant, and whereby at a third time identified by the third reference data the participant is re-displayed as the first character in the cinematic scene of the video content.
2. The method of claim 1 , wherein said selective switching is performed in real time with respect to the real-time second video signal.
3. The method of claim 1 , wherein the data identifies time codes associated with the first video signal.
4. The method of claim 1 , further comprising processing the second video signal to isolate the real-time video image of the participant from a background of the second video signal.
5. The method of claim 4 , wherein said processing comprises chroma-key processing.
6. A method for coordinating the display of multiple signals, the method comprising:
receiving a first signal comprising video content representing a scene comprising first and second original characters;
receiving a second signal comprising a real-time video image of a participant; receiving a third signal comprising first audio content associated with the scene; receiving a fourth signal comprising second audio content associated with the participant;
forming a combined video signal comprising portions of the first signal and portions of the second signal, wherein the combined video signal is configured to cause the display of the real-time video image of the participant in place of the first original character of the scene;
receiving reference data that corresponds to portions of the first signal, the reference data comprising first reference data that identifies a first frame of the multiple frames in which the first original character is associated with the scene, and wherein the reference data comprises second reference data that identifies a second frame of the multiple frames in which the first original character is not associated with the scene; and
alternating between (i) displaying the first signal and outputting at least the first audio content and (ii) displaying the combined video signal and outputting at least the second audio content, wherein the timing of said alternating is based on the reference data such that the combined video signal is selected at a first time identified by the first reference data whereby the participant appears in the scene at the time the first original character would appear in the scene and in place of the first original character, and such that the first signal is selected at a second time identified by the second reference data whereby the participant no longer appears in the scene.
7. The method of claim 6 , wherein said receiving the second signal comprises receiving the second signal via a network.
8. The method of claim 6 , further comprising receiving a third signal comprising a second real-time video image of a second participant.
9. The method of claim 8 , wherein the combined video signal comprises portions of the first signal, portions of the second signal and portions of the third signal.
10. The method of claim 6 , further comprising digitally removing a background of the second video signal to isolate the real-time video image of the participant.