Artificial intelligence analysis of multimedia content
A method includes receiving video segments from a transcoder of a media device. The video segments are associated with multimedia content. The method further includes detecting, during a delay associated with the multimedia content and using an artificial intelligence (AI) technique, a particular representation in at least one of the video segments. The method further includes generating metadata associated with the particular representation and sending the metadata to a multimedia player to enable the multimedia player to modify playback of the multimedia content based on the metadata.
1. A method comprising:
receiving video segments from a transcoder of a media device, the video segments associated with multimedia content, the received video segments correspond to a live stream being delivered to a plurality of playback devices including the multimedia player;
during a delay associated with the multimedia content, detecting, using an artificial intelligence (AI) technique, a particular representation in at least one of the video segments;
generating metadata associated with the particular representation, the metadata and the at least one of the video segments include a common identifier to enable synchronization of the metadata with the at least one of the video segments; and
sending the metadata to a multimedia player to enable the multimedia player to modify playback of the multimedia content based on the metadata, wherein the delay is based on a time period associated with transcoding the multimedia content, a time period associated with transporting the multimedia content from the transcoder to the multimedia player, a time period associated with processing of the multimedia content at the multimedia player and a time period associated with executing the AI technique.
2. The method of claim 1 , wherein the particular representation includes an object detected in the multimedia content, a face detected in the multimedia content, or a logo detected in the multimedia content.
3. The method of claim 2 , further comprising modifying playback of the multimedia content by replacing the object, the face, or the logo with an overlay.
4. The method of claim 1 , wherein the metadata indicates absence of a person in the multimedia content, and further comprising modifying playback of the multimedia content by terminating playback of the multimedia content based on the metadata.
5. An apparatus comprising:
a memory; and
a processor coupled to the memory and configured to perform, initiate, or control operations comprising:
receiving video segments from a transcoder of a media device, the video segments associated with multimedia content, the received video segments correspond to a live stream being delivered to a plurality of playback devices including the multimedia player;
during a delay associated with the multimedia content, detecting, using an artificial intelligence (AI) technique, a particular representation in at least one of the video segments;
generating metadata associated with the particular representation, the metadata and the at least one of the video segments include a common identifier to enable synchronization of the metadata with the at least one of the video segments; and
sending the metadata to a multimedia player to enable the multimedia player to modify playback of the multimedia content based on the metadata, wherein the delay is based on a time period associated with transcoding the multimedia content, a time period associated with transporting the multimedia content from the transcoder to the multimedia player, a time period associated with processing of the multimedia content at the multimedia player and a time period associated with executing the AI technique.
6. The apparatus of claim 5 , wherein the operations further comprise receiving a request for the metadata, the request sent in response to a marker received from the transcoder.
7. The apparatus of claim 6 , wherein the marker includes a unique identifier (UID) of the at least one video segment, and wherein the request includes one or more of a representational state transfer (REST) request or a websocket request.
8. A non-transitory computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
receiving video segments from a transcoder of a media device, the video segments associated with multimedia content, the received video segments correspond to a live stream being delivered to a plurality of playback devices including the multimedia player;
during a delay associated with the multimedia content, detecting, using an artificial intelligence (AI) technique, a particular representation in at least one of the video segments, the metadata and the at least one of the video segments include a common identifier to enable synchronization of the metadata with the at least one of the video segments;
generating metadata associated with the particular representation; and
sending the metadata to a multimedia player to enable the multimedia player to modify playback of the multimedia content based on the metadata, wherein the delay is based on a time period associated with transcoding the multimedia content, a time period associated with transporting the multimedia content from the transcoder to the multimedia player, a time period associated with processing of the multimedia content at the multimedia player and a time period associated with executing the AI technique.
9. The non-transitory computer-readable storage device of claim 8 , wherein the operations further comprise modifying playback of the multimedia content by replacing the particular representation with an overlay.
10. The non-transitory computer-readable storage device of claim 8 , wherein the metadata indicates absence of a person in the multimedia content, and wherein the operations further comprise modifying playback of the multimedia content by terminating playback of the multimedia content based on the metadata.