Method and system for sending and playing media data in telepresence technology
The present disclosure discloses a method and system for sending media data in telepresence technology. By collecting audio or video data corresponding to a spatial area, the collected data is processed respectively to acquire multiple streams of data distinguished by a collecting spatial area and corresponding collecting spatial information; the multiple streams of data are encoded, encoded multiple streams of audio data and the collecting spatial information are packed together, and/or encoded multiple streams of video data and the collecting spatial information are packed together, and a packet including multiple streams of audio or video data is sent, respectively. The present disclosure also discloses a method and system for playing media data in telepresence technology. With the methods and systems, it is possible to directly identify the corresponding collecting spatial area, i.e., a corresponding playing location in the process of data transmission, which enables a conferee at a receiving end to experience auditory positioning and an immersive sensation. Further, the problem of synchronization among the multiple streams of audio or video data is solved effectively.
1. A method for sending media data in telepresence technology, comprising:
collecting audio or video data corresponding to a spatial area, and processing the collected audio or video data respectively to acquire multiple streams of data distinguished by a collecting spatial area and collecting spatial information of each stream of data; and
encoding the multiple streams of data, packing together encoded multiple streams of audio data and the collecting spatial information, and/or packing together encoded multiple streams of video data and the collecting spatial information, and sending a packet including multiple streams of audio or video data, respectively,
wherein the packet including multiple streams of audio or video data comprises a packet header and a packet body, wherein the packet header carries an identifier for each stream of audio or video data and indicates a stream length, the identifier corresponds to the collecting spatial information; the packet body carries content of the multiple streams of data.
2. The method according to claim 1 , wherein the processing the collected audio or video data respectively is: processing the video or audio data collected at each collecting spatial area respectively as one stream of data.
3. A system for sending media data in telepresence technology, comprising: one or multiple audio-video collecting devices, a multi-stream data processing module, and a multi-stream data transmitting module, wherein
the one or multiple audio-video collecting devices are configured to collect audio or video data corresponding to a spatial area respectively and send the collected data to the multi-stream data processing module;
the multi-stream data processing module is configured to process the collected audio or video data respectively to acquire multiple streams of data distinguished by a collecting spatial area and collecting spatial information of each stream of data, and send the multiple streams of data as well as the collecting spatial information to the multi-stream data transmitting module; and
the multi-stream data transmitting module is configured to encode the multiple streams of data, pack together encoded multiple streams of audio data and the collecting spatial information, and/or pack together encoded multiple streams of video data and the collecting spatial information, and send a packet including multiple streams of audio or video data, respectively,
wherein the packet including multiple streams of audio or video data comprises a packet header and a packet body, wherein the packet header carries an identifier for each stream of audio or video data and indicates a stream length, the identifier corresponds to the collecting spatial information; the packet body carries content of the multiple streams of data.
4. The system according to claim 3 , wherein processing, by the multi-stream data processing module, the collected audio or video data respectively is: processing, by the multi-stream data processing module, the video or audio data collected at each collecting spatial area respectively as one stream of data.