Real-time multi-media streaming bandwidth management
View Patent ↗A multi-media method, system and apparatus are provided to optimize a network bandwidth and enhanced video experience. Each of a plurality of environmental views are encoded and the encoded multi-media streams are subsequently transcoded in accordance with respective encoding characteristics. The resulting video streams are then provided to a user for selecting preferred views. The user's multi-media preferential attributes are determined from the viewer's feedback. In response to the viewers' feedback, a video manager communicates to the cameras/encoders encoding characteristics and to the transcoders transcoding characteristics associated with corresponding encoded multi-media streams. A transport processor encodes for transport each of a plurality of the transcoded video streams and communicate towards viewers the transcoded video streams.
1. A method for real-time multi-media streaming, comprising:
transcoding each of a plurality of multi-media streams in accordance with respective encoding characteristics to provide respective transcoded multi-media streams, wherein each multi-media stream comprises an encoded video of a respective subset view of a total view of at least one viewing environment with a plurality of cameras capturing corresponding subset views;
forwarding each transcoded multi-media stream towards a plurality of viewers;
receiving from at least one of the plurality of viewers an indication of a preferred subset view; and
adapting characteristics associated with at least one transcoded multi-media stream to improve viewer experience associated with the multi-media stream providing the preferred subset view, wherein optimization of the preferred subset view comprises providing lesser quality of non-preferred subset views.
2. The method of claim 1 , wherein each of said plurality of viewers receives said adapted preferred subset view.
3. The method of claim 1 , wherein multiple viewers receive said adapted preferred subset view.
4. The method of claim 1 , wherein said characteristics comprise one or more of the following attributes: a frame rate, a resolution, a color depth, frequency components, a zoom, a coding algorithm, an available bandwidth and a range.
5. The method of claim 1 , wherein each of said multi-media streams is provided by a respective camera/encoder configured to capture a respective subset view.
6. The method of claim 5 , wherein said each camera/encoder is adapted to encode imagery according to provided encoding characteristics.
7. The method of claim 1 , wherein each of a first portion of said plurality of multi-media streams is provided by a respective remote camera/encoder configured to capture a respective subset view.
8. A real-time multi-media streaming system, comprising:
a video manager, communicatively coupled to a plurality of transcoders configured to transcode respective multi-media streams in accordance with respective encoding characteristics, wherein each multi-media stream comprises an encoded video of a respective subset view of a total view of at least one viewing environment with a plurality of cameras capturing corresponding subset views;
a transport processor adapted to transport encode each transcoded multi-media stream for transport toward a plurality of viewers;
said video manager further configured to receive from at least one of the plurality of viewers an indication of a preferred subset view, and adapt characteristics associated with at least one transcoded multi-media stream to improve viewer experience associated with the multi-media stream providing the preferred subset view, wherein optimization of the preferred subset view comprises providing lesser quality of non-preferred subset views.
9. The system of claim 8 , wherein said video manager is communicatively coupled to each of a plurality of cameras/encoders configured to capture respective subset views within said at least one viewing environment and provide corresponding multi-media streams to respective transcoders.
10. The system of claim 8 , said video manager is communicatively coupled to each of a plurality of cameras/encoders configured to capture respective subset views within a different viewing environment and provide corresponding multi-media streams to respective transcoders.
11. The system of claim 8 , wherein said encoding characteristics comprise one or more of the following attributes: a frame rate, a resolution, a color depth, frequency components, a zoom, a coding algorithm, an available bandwidth and a range.
12. The system of claim 8 , wherein multiple viewers receive said adapted preferred subset view.
13. The system of claim 8 , wherein each of said plurality of viewers receives said adapted preferred subset view.
14. The system of claim 8 , wherein said transport processor allocates bandwidth according to said transcoded video streams characteristics.
15. A real-time multi-media streaming apparatus, comprising:
means for transcoding each of a plurality of multi-media streams in accordance with respective encoding characteristics to provide respective transcoded multi-media streams, wherein each multi-media stream comprises an encoded video of a respective subset view of a total view of at least one viewing environment with a plurality of cameras capturing corresponding subset views;
means for forwarding each transcoded multi-media stream towards a plurality of viewers;
means for receiving from at least one of the plurality of viewers an indication of a preferred subset view; and
means for adapting characteristics associated with at least one transcoded multi-media stream to improve viewer experience associated with the multi-media stream providing the preferred subset view, wherein optimization of the preferred subset view comprises providing lesser quality of non-preferred subset views.
16. A real-time multi-media transcoder apparatus, comprising:
a distributor for selecting one or more of a plurality of Digital Signal Processors (DSPs) to transcode respective multi-media streams in accordance with respective encoding characteristics to provide respective transcoded multi-media streams, wherein each multi-media stream comprises an encoded video of a respective subset view of a total view of at least one-viewing environment with a plurality of cameras capturing corresponding subset views;
wherein in response to forwarding each transcoded multi-media stream towards a plurality of viewers and to receiving from at least one of the plurality of viewers an indication of a preferred subset view, the distributor configured to perform said transcoding by
adapting characteristics associated with at least one transcoded multi-media stream to improve viewer experience associated with the multi-media stream providing the preferred subset view, wherein optimization of the preferred subset view comprises providing lesser quality of non-preferred subset views.
17. A real-time multi-media encoding apparatus, comprising:
a plurality of encoders, each of the encoders configured for processing a respective video signal for a corresponding multi-media stream, wherein each multi-media stream comprises an encoded video of a respective subset view of a total view of at least one viewing environment with a plurality of cameras capturing corresponding subset views;
wherein in response to forwarding each multi-media stream towards a plurality of viewers and to receiving from at least one of the plurality of viewers an indication of a preferred subset view, said encoders are configured to
adapt characteristics associated with at least one multi-media stream to improve viewer experience associated with the multi-media stream providing the preferred subset view, wherein optimization of the preferred subset view comprises providing lesser quality of non-preferred subset views.
18. The apparatus of claim 17 , wherein said encoding parameters comprise one or more of the following: a frame rate, a resolution, a color depth, frequency components, a zoom, a coding algorithm, an available bandwidth and a range.
19. The apparatus of claim 17 , further comprising:
at least one segmentation processor for reducing a frame size associated with a received video signal in response to said indication of the preferred subset view.
20. The apparatus of claim 15 , further comprising:
a router for routing to users the adapted transcoded multi-media stream corresponding to the preferred subset view.
21. The method of claim 1 , wherein said viewer experience is improved by removing subset views not proximate an audio source within the total view.
22. The method of claim 1 , wherein said viewer experience is improved by transcoding at a reduced quality level of selected multi-media streams associated with subset views not proximate an audio source within the total view.
23. The method of claim 1 , wherein said viewer experience is improved by transcoding at an enhanced quality level of selected multi-media streams associated with subset views proximate an audio source within the total view.
24. The method of claim 1 , wherein said viewer experience is improved by transcoding at an enhanced quality level of portions within a multi-media stream of said multi-media streams spatially proximate an audio source within the total view.
25. The method of claim 1 , wherein at least a portion of the total view is related to a meeting in a room and at least a portion of the subset views represent separate individual views of participants of the meeting taken by respective cameras.
26. The method of claim 1 , wherein the total view is related to a meeting environment, and the subset views taken by respective cameras represent circumferential view of the meeting environment.