Large volume video data transfer over limited capacity bus
Methods, systems, and techniques for projecting streamed video are provided. Example Enhanced Video Systems provide support for streaming high resolution video in limited bandwidth hardware environments. In one example, an Enhanced Video System comprises a real time, interactive rendering system, a display system, and one or more display units. The rendering system comprises a high resolution graphics engine (e.g., a VR/AR gaming engine) capable of generating high resolution video and two graphics computation units. The projection system comprises two video capture cards to capture the generated video stream and forward the captured video stream to a projection mapping engine. Projection mapping engine consolidates and stitches together the received video stream as appropriate to render the video stream over display units to the target viewing environment such as a dome/sphere. In the example described, an 8K resolution video is streamed and projected despite bandwidth limitations of current video capture card technology.
1. A streaming video rendering system, comprising:
a projection computing system, comprising one or more video capture cards attached to an interface bus of the projection computing system, wherein the maximum number of the one or more video capture cards available to process a maximum bandwidth of data at a highest speed is limited by hardware requirements of the interface bus;
a rendering computing system, comprising a high resolution graphics engine and at least one graphics computation unit,
wherein the high resolution graphics engine is configured to generate a high resolution video stream panoramic projection using projections from projection sources that exceed the maximum bandwidth of data that can be captured by the maximum number of the one or more video capture cards attached to the interface bus if each of the projections were forwarded to a discrete input path of each of the one or more video capture cards,
wherein the rendering computing system is configured to reframe the panoramic projection of the high resolution video stream to a plurality of data capture portions that can each be captured by a corresponding discrete input of the one or more video capture cards such that the entire data content of the panoramic projection is able to be captured by the maximum number of video capture cards attached to the interface bus, and
wherein the plurality of data capture portions are forwarded via the at least one graphics computation unit to the projection computing system;
wherein the projection computing system is configured to receive the data capture portions on the maximum number of video capture cards, recombine the captured data capture portions of video data into the panoramic projection, and transmit a stitched video stream for display; and
a plurality of display units, each configured to receive a portion of the stitched video stream and render the received portion on a surface.
2. The system of claim 1 wherein the maximum number of video capture cards available to process a maximum bandwidth of data at the highest speed is two.
3. The system of claim 2 wherein the video capture cards are Peripheral Component Interconnect Express (PCIe) 16× cards.
4. The system of claim 1 wherein each video capture card has two inputs, each of which can capture 4K resolution worth of data.
5. The system of claim 1 wherein the projections from projection sources are from at least six cameras or textures and the rendering computing system is configured to reframe the projections from the projection sources by reframing the projections into four data capture portions, each of which is less than or equal to 8 million pixels of data.
6. The system of claim 1 wherein the panoramic projection is a cube projection having six images corresponding to top, bottom, left, right, front, and back views of a scene.
7. The system of claim 1 wherein the panoramic projection is an equirectangular projection having image data corresponding to a top, bottom, left, right, front, and back views of a scene.
8. The system of claim 1 wherein the high resolution graphics engine is an augmented reality or virtual reality gaming engine.
9. The system of claim 1 wherein the surface upon which the stitched video stream is rendered is a portion of a sphere.
10. The system of claim 9 wherein the surface upon which the stitched video stream is rendered has a floor and images are projected on the floor.
11. The system of claim 1 wherein the plurality of display units are projectors.
12. A video stream rendering computer system, comprising:
a high resolution graphics engine; and
at least one graphics computation unit;
wherein the high resolution graphics engine is configured to:
generate a high resolution video stream as an equirectangular projection or a cube projection;
reframe the generated high resolution video stream from the equirectangular projection or cube projection as a different number of data capture portions, the size of content of each portion smaller than or equal to a maximum size of a corresponding video card input path;
transmit the data capture portions via the at least one graphics computation unit so that each data capture portion is capturable by a corresponding video capture card of one or more video capture cards attached to an interface bus and wherein the captured data capture portions are re-combinable into the equirectangular projection or cube projection to be divided into one or more display portions and sent to one or more corresponding display systems that each render the received display portion on a surface.
13. The rendering computer system of claim 12 wherein the number of the video capture cards attached to the interface bus is limited by hardware requirements of the interface bus to process video data at a maximum speed and throughput.
14. The rendering computer system of claim 12 wherein the number of the video capture cards is limited to two video capture cards.
15. The rendering computer system of claim 12 wherein the interface bus is a Peripheral Component Interconnect Express (PCIe) bus connected to a computing system.
16. The rendering computer system of claim 12 wherein the high resolution video stream is an 8K resolution video stream.
17. The rendering computer system of claim 12 wherein the high resolution video stream is a 12K or a 16K resolution video stream.
18. The rendering computer system of claim 12 wherein the number of data capture portions is four so that each data capture portion is less than or equal to a 4K resolution worth of data and is able to be processed by a single input path of a video capture card.
19. A method for producing a surround video, comprising:
generating a high resolution graphics video using a projection source that produces at least an 8K resolution image;
transforming the high resolution graphics video into a cube projection or equirectangular projection that includes at least 8K resolution worth of data;
reframing the cube projection or equirectangular projection into a number of data capture portions based upon a number of one or more video capture cards available and a resolution capacity of each input path of each video capture card, wherein each input path of each video capture card can process only a portion of the at least 8K resolution of data; and
transmitting and allocating the data capture portions between the input paths of the available video capture cards, wherein the available video capture cards capture the transmitted and allocated data capture portions and the captured data capture portions are recombined into the cube projection or equirectangular projection for rendering as a surround video by a plurality of display systems.
20. The method of claim 19 wherein the surround video is rendered by projected the surround video onto a dome, a portion of a sphere, or a polygon, or a three dimensional object.
21. The method of claim 19 wherein the generating a high resolution graphics video using projection sources uses at least six camera views or a panorama.