Situational media integration
View Patent ↗A method for situational media integration for telecommunication is described. The method comprises receiving media input and obtaining ambient media along with the received media input. One or more timestamps are applied to the received media input. One or more timestamps are applied to the ambient media. The one or more timestamps are used to synchronize the received media input with the ambient media to create a synchronized media stream. The synchronized media stream is transmitted to recipient devices. A device comprising a processor; and a computer-readable storage medium having stored thereon program instructions that, when executed by the processor, causes the processor to perform the method is also described.
1 . A method comprising:
receiving text input;
obtaining ambient media comprising at least one of ambient audio and ambient video along with the received text input;
applying one or more timestamps to the received text input;
analyzing the text input for keywords suggestive of a critical situation;
in response to identifying keywords suggestive of a critical situation, activating at least one of an audio input device to record the ambient audio and a camera to record the ambient video;
applying one or more timestamps to the ambient media;
using the one or more timestamps to synchronize the received text input with the ambient media to create synchronization information and a synchronized media stream; and
transmitting the synchronized media stream.
2 . The method of claim 1 , wherein the synchronized media stream comprises the synchronization information along with the received text input and at least one of the ambient audio and the ambient video.
3 . The method of claim 1 further comprising associating the ambient audio with one or more unique identifiers configured to identify the ambient audio, wherein the synchronized media stream comprises the synchronization information along with the received text input and the one or more unique identifiers.
4 . The method of claim 1 further comprising:
converting the text input to audio input; and
mixing the converted audio input with the ambient audio to create the synchronized media stream.
5 . A device comprising:
a processor; and
a computer-readable storage medium having stored thereon program instructions that, when executed by the processor, causes the processor to perform a set of operations comprising:
receiving text input;
obtaining ambient media comprising at least one of ambient audio and ambient video along with the received text input;
synchronizing the received text input and the ambient media by:
applying one or more timestamps to the received text input;
analyzing the text input for keywords suggestive of a critical situation;
in response to identifying keywords suggestive of a critical situation, activating at least one of an audio input device to record the ambient audio and a camera to record the ambient video;
applying one or more timestamps to the ambient media; and
using the one or more timestamps to synchronize the received text input with the ambient media to create synchronization information and a synchronized media stream; and
transmitting the synchronized media stream.
6 . The device of claim 5 , wherein the synchronized media stream comprises the synchronization information along with the received text input and at least one of the ambient audio and the ambient video.
7 . The device of claim 5 , the set of operations further comprising associating the ambient audio with one or more unique identifiers configured to identify the ambient audio, wherein the synchronized media stream comprises the synchronization information along with the received text input and the one or more unique identifiers.
8 . The device of claim 5 , the set of operations further comprising:
converting the text input to audio input; and
mixing the converted audio input with the ambient audio to create the synchronized media stream.
9 . A method comprising:
receiving video input capturing sign language gestures;
obtaining, using at least one audio input device ambient audio along with the received video input;
applying one or more timestamps to the received video input;
applying one or more timestamps to the ambient audio;
converting the sign language gestures in the video input to audio input, the timestamp from the video input being correlated with associated converted audio input;
using the one or more timestamps to synchronize the received video input with the ambient audio to create synchronization information and a synchronized media stream; and
transmitting the synchronized media stream.
10 . The method of claim 9 , wherein the video input comprises both video and audio data, and ambient audio is extracted from the video input.
11 . The method of claim 9 , wherein the video input is captured in real-time in response to an activation trigger, the activation trigger comprising a physical trigger or detection of the sign language gestures.
12 . The method of claim 9 further comprising associating the ambient audio with one or more unique identifiers configured to identify the ambient audio, wherein the synchronized media stream comprises the synchronization information along with the converted audio input and the one or more unique identifiers.
13 . The method of claim 9 further comprising mixing the converted audio input with the ambient audio to create the synchronized media stream.
14 . A device comprising:
a processor; and
a computer-readable storage medium having stored thereon program instructions that, when executed by the processor, causes the processor to perform a set of operations comprising:
receiving video input capturing sign language gestures;
obtaining, using at least one audio input device ambient audio along with the received video input;
synchronizing the received video input and the ambient audio by:
applying one or more timestamps to the received video input;
applying one or more timestamps to the ambient audio;
converting the sign language gestures in the video input to audio input, the timestamp from the video input being correlated with associated converted audio input; and
using the one or more timestamps to synchronize the received video input with the ambient audio to create synchronization information and a synchronized media stream; and
transmitting the synchronized media stream.
15 . The device of claim 14 , wherein the video input comprises both video and audio data, and ambient audio is extracted from the video input.
16 . The device of claim 14 , wherein the video input is captured in real-time in response to an activation trigger, the activation trigger comprising a physical trigger or detection of the sign language gestures.
17 . The device of claim 14 , the set of operations further comprising associating the ambient audio with one or more unique identifiers configured to identify the ambient audio, wherein the synchronized media stream comprises the synchronization information along with the converted audio input and the one or more unique identifiers.
18 . The device of claim 14 , the set of operations further comprising mixing the converted audio input with the ambient audio to create the synchronized media stream.