Information provisioning apparatus and information provisioning method
View Patent ↗Information provisioning includes acquiring a plurality of audio and video elementary streams of which content is composed, and metadata related to the content comprising a plurality of segments. The metadata is divided into metadata processing units, wherein a metadata processing unit (MPU) indicates a unit of the metadata and corresponds to a segment of the content, the MPU and the segment are configured to be processed for partial execution of the metadata in synchronization with the segment of the content. A transport stream of a MPEG-2 system is generated by multiplexing an audio packetized elementary stream (PES), a video PES, and a metadata PES. The audio PES and the video PES are acquired by packetizing the plurality of audio and video elementary streams. The metadata PES is acquired by packetizing the metadata processing units.
1. An information provisioning apparatus, comprising:
an acquirer that acquires a plurality of audio and video elementary streams of which content is composed, and metadata related to the content, the content comprising a plurality of segments;
a unitizer that divides the metadata into metadata processing units, wherein a metadata processing unit (MPU) indicates a unit of the metadata and corresponds to a segment of the content, the MPU and the segment are configured to be processed for partial execution of the metadata in synchronization with the segment of the content; and
a multiplexer that generates a transport stream of a MPEG2-system by multiplexing an audio packetized elementary stream (PES), a video PES, and a metadata PES for each segment of the content, the audio PES and the video PES being acquired by packetizing the plurality of audio and video elementary streams, the metadata PES being acquired by packetizing the metadata processing units.
2. The information provisioning apparatus according to claim 1 , wherein the metadata includes actual data of the metadata and control information of the metadata, the control information of the metadata including a time synchronization flag that indicates whether time synchronization is provided between the actual data of the metadata and the plurality of audio and video elementary streams.
3. The information provisioning apparatus according to claim 2 , wherein the control information of the metadata further includes time information that indicates a play start time.
4. The information provisioning apparatus according to claim 3 , wherein the multiplexer places the metadata PES, the audio PES, and the video PES in the transport stream based on the time information.
5. An information provisioning method, comprising:
acquiring a plurality of audio and video elementary streams of which content is composed, and metadata related to the content, the content comprising a plurality of segments;
dividing the metadata into metadata processing units, wherein a metadata processing unit (MPU) indicates a unit of the metadata and corresponds to a segment of the content, the MPU and the segment are configured to be processed for partial execution of the metadata in synchronization with the segment of the content; and
generating a transport stream of a MPEG2-system by multiplexing an audio packetized elementary stream (PES), a video PES, and a metadata PES for each segment of the content, the audio PES and the video PES being acquired by packetizing the plurality of audio and video elementary streams, the metadata PES being acquired by packetizing the metadata processing units.
6. The information provisioning apparatus according to claim 1 , wherein the MPU identifies a processing start time of the segment of the content for performing the partial execution of the metadata in synchronization with the segment of the content.
7. The information provisioning apparatus according to claim 6 , wherein the multiplexer generates the transport stream by placing the metadata PES packets of the MPU in the transport stream earlier in time than the processing start time of the segment of the content.
8. The information provisioning apparatus according to claim 7 , wherein the multiplexer places the metadata PES packets of the MPU in the transport stream by interleaving the metadata PES packets with the audio PES packets and the video PES packets.
9. The information provisioning apparatus according to claim 7 , wherein the metadata PES packets of the MPU are configured to be processed for generating the MPU before the processing start time of the segment of the content.
10. The information provisioning apparatus according to claim 9 , wherein the multiplexer places the metadata PES packets of the MPU in the transport stream so that a difference in an arrival time of a last of the metadata PES packets of the MPU and the processing start time is less than a processing time for generating the MPU from the metadata PES packets.
11. The information provisioning method according to claim 5 , wherein the MPU identifies a processing start time of the segment of the content for performing the partial execution of the metadata in synchronization with the segment of the content.
12. The information provisioning method according to claim 11 , wherein the transport stream is generated by placing the metadata PES packets of the MPU in the transport stream earlier in time than the processing start time of the segment of the content.
13. The information provisioning method according to claim 12 , wherein the transport stream is generated by placing the metadata PES packets of the MPU in the transport stream by interleaving the metadata PES packets with the audio PES packets and the video PES packets.
14. The information provisioning method according to claim 12 , wherein the metadata PES packets of the MPU are configured to be processed for generating the MPU before the processing start time of the segment of the content.
15. The information provisioning method according to claim 14 , wherein the transport stream is generated by placing the metadata PES packets of the MPU in the transport stream so that a difference in an arrival time of a last of the metadata PES packets of the MPU and the processing start time is less than a processing time for generating the MPU from the metadata PES packets.
16. The information provisioning apparatus according to claim 1 , wherein the metadata processing units are re-formatted unit by unit and packetized for partial execution.
17. The information provisioning apparatus according to claim 16 , wherein each of the metadata processing units is configured to be executed in synchronization with the content of a corresponding segment to one of describe and process the content of the corresponding segment.
18. The information provisioning apparatus according to claim 1 , further comprising:
an extractor that extracts the audio PES packet, the video PES, and the metadata PES from the transport stream for each segment of the content; and
a processor that processes the metadata PES in synchronization with the audio PES and the video PES for each segment of the content.
19. The information provisioning method according to claim 5 , further comprising:
re-formatting the metadata processing units unit by unit for partial execution; and
packetizing the reformatted metadata processing units.
20. The information provisioning method according to claim 5 , further comprising:
extracting the audio PES packet, the video PES, and the metadata PES from the transport stream for each segment of the content
processing the metadata PES in synchronization with the audio PES and the video PES for each segment of the content.