Reducing bandwidth for video streaming using de-warping and video analytics
An apparatus comprising an interface and a processor. The interface may be configured to receive a panoramic video stream from a capture device and present one or more enhanced region of interest video frames to a communication device. The processor may be configured to perform de-warping operations on the panoramic video stream received from the interface, perform video analytics on the de-warped panoramic video stream to select a region of interest, crop the de-warped panoramic video based on the region of interest to generate a region of interest video frame, enhance the region of interest video frame and present the enhanced region of interest video frame to the interface. The de-warping operations may be implemented to correct distortion caused by the capture device. The region of interest may be dynamically selected based on objects detected in response to the video analytics.
1. An apparatus comprising:
an interface configured to (i) receive a panoramic video stream from a capture device and (ii) present one or more enhanced region of interest video frames to a communication device; and
a processor configured to (i) perform de-warping operations on said panoramic video stream received from said interface, (ii) perform video analytics on said de-warped panoramic video stream to select a region of interest, (iii) crop said de-warped panoramic video based on said region of interest to generate a region of interest video frame, (iv) enhance said region of interest video frame and (v) present said enhanced region of interest video frame to said interface, wherein (a) said de-warping operations are implemented to correct distortion caused by said capture device and (b) said region of interest is dynamically selected based on objects detected in response to said video analytics.
2. The apparatus according to claim 1 , wherein said capture device comprises a wide angle lens configured to capture a wide field of view without physically moving said capture device.
3. The apparatus according to claim 1 , wherein said processor further comprises a hardware de-warp engine configured to perform said de-warping operations.
4. The apparatus according to claim 1 , wherein said de-warped panoramic video stream is stored in a memory.
5. The apparatus according to claim 1 , wherein said objects detected by said video analytics comprise people.
6. The apparatus according to claim 1 , wherein said video analytics is configured to (i) detect said objects and (ii) follow said detected objects from frame to frame of said de-warped panoramic video stream.
7. The apparatus according to claim 1 , wherein said enhanced region of interest video frame is smaller than a frame of said de-warped panoramic video stream.
8. The apparatus according to claim 1 , wherein (i) said apparatus is a component of an unmanned aerial vehicle and (ii) said region of interest is dynamically selected based on movements of said unmanned aerial vehicle.
9. The apparatus according to claim 1 , wherein enhancing said region of interest comprises at least one of (i) performing a digital zoom of said region of interest video frame and (ii) over-sampling an image sensor of said capture device to generate a higher resolution image within size constraints of said region of interest video frame.
10. The apparatus according to claim 1 , wherein transmitting said enhanced region of interest video frame uses less bandwidth compared to transmitting said panoramic video stream.
11. The apparatus according to claim 1 , wherein (i) said apparatus is implemented as a component of an unmanned aerial vehicle and (ii) said communication device is configured to communicate wirelessly.
12. The apparatus according to claim 1 , wherein said apparatus is configured to reduce bandwidth for video streaming using de-warping and said video analytics.
13. An apparatus comprising:
an interface configured to (i) receive plurality of portions of a panoramic video stream from a plurality of capture devices and (ii) present one or more enhanced region of interest video frames to a communication device; and
a processor configured to (i) perform video stitching operations on each of said plurality of portions of said panoramic video stream received from said interface to generate a stitched video, (ii) perform de-warping operations on said stitched video to generate a de-warped panoramic video stream, (iii) perform video analytics on said de-warped panoramic video stream to select a region of interest, (iv) crop said de-warped panoramic video based on said region of interest to generate a region of interest video frame, (v) enhance said region of interest video frame and (vi) present said enhanced region of interest video frame to said interface, wherein (a) said de-warping operations are implemented to correct distortion caused by said capture devices and (b) said region of interest is dynamically selected based on objects detected in response to said video analytics.
14. The apparatus according to claim 13 , wherein each of said plurality of capture devices is configured to capture one of said portions of said panoramic video stream.
15. The apparatus according to claim 13 , wherein each of said plurality of capture devices comprises a lens and a sensor.