Method and system for selective content processing based on a panoramic camera and a virtual-reality headset
A method and a system for selective-content processing of panoramic multimedia signals are disclosed. Features of panoramic cameras and low-latency virtual-reality headsets are exploited to create an advanced efficient system for covering events of diverse and fast-motion actions for the purpose of both broadcasting and data streaming. The disclosed system employs a virtual-reality headset to produce a display of a multimedia signal and generate geometric data defining a view region of the display. A content-filtered signal is extracted from the multimedia signal, according to the geometric data, for broadcasting and dissemination to client devices of a universal streaming server.
1. A method of communication comprising:
acquiring a source signal from a source and extracting a pure signal from the source signal; and
employing a virtual-reality headset comprising a processor and a memory device to perform processes of:
producing a virtual-reality display of the pure signal;
generating geometric data defining a view region of said display;
deriving a content-filtered signal from said pure signal according to said geometric data; and
forwarding said content-filtered signal for dissemination; said forwarding comprising:
compressing said content-filtered signal to produce a compressed filtered signal; and
transmitting said compressed filtered signal to a server for communication over a network.
2. The method of claim 1 further comprising:
sensing a current gaze orientation of an operator wearing said virtual-reality headset; and
determining said view region according to said current gaze orientation.
3. The method of claim 1 wherein said extracting comprises:
detecting a descriptor indicating signal-processing functions performed at said source; and
identifying baseband content of said source signal based on said descriptor.
4. The method of claim 3 , further comprising:
selecting a matching pure-signal generator from a set of pure-signal generators based on said baseband content; and
supplying said baseband content to said matching pure-signal generator.
5. The method of claim 3 wherein said identifying comprises classifying said baseband content as one of:
a de-warped raw signal;
a raw signal;
a warped compressed signal; and
a de-warped compressed signal.
6. The method of claim 1 wherein said generating comprises:
determining a gaze position of a viewer of said virtual-reality display; and
determining said geometric data as representative spatial coordinates of a contour of a predefined form surrounding said gaze position.
7. The method of claim 6 wherein said deriving comprises determining samples of said pure signal corresponding to content within said contour.
8. The method of claim 1 wherein said deriving is performed within said virtual-reality headset.
9. The method of claim 1 wherein said deriving is performed at an independent content filter coupled to said virtual-reality headset and comprising a respective processor and a memory device storing processor executable instructions.
10. A method of: communication comprising:
acquiring a source signal from a source and extracting a pure signal from the source signal; and
employing a virtual-reality headset comprising a processor and a memory device to perform processes of:
producing a virtual-reality display of the pure signal;
generating geometric data defining a view region of said display;
deriving a content-filtered signal from said pure signal according to said geometric data; and
forwarding said content-filtered signal for dissemination; said forwarding comprising:
compressing said content-filtered signal to produce a compressed filtered signal; and
transmitting said compressed filtered signal to a broadcasting station.
11. A communication system comprising:
an acquisition module configured to acquire a source signal from a source and extract a pure signal from the source signal; and
a virtual-reality headset comprising a processor and a memory device configured to:
produce a virtual-reality display of the pure signal;
generate geometric data defining a view region of said display;
derive a content-filtered signal from said pure signal according to said geometric data; and
forward said content-filtered signal for dissemination;
a compression module configured to compress said content-filtered signal to produce a compressed filtered signal; and
a transmitter for transmitting said compressed filtered signal to a server for communication over a network.
12. The method of claim 10 wherein said producing comprises supplying said pure signal to at least one of:
an internal display device of said virtual-reality headset; and
an external display device.
13. The method of claim 10 further comprising relaying said source signal to a streaming apparatus enabling concurrent viewer-controlled content selection.
14. The communication system of claim 11 further comprising:
a sensor within the virtual-reality headset providing parameters defining a current gaze orientation of an operator wearing said virtual-reality headset; and
a content filter coupled to said virtual-reality headset and configured to define said view region according to said current gaze orientation.
15. The communication system of claim 11 wherein said acquisition module is configured to:
detect a descriptor indicating signal-processing functions performed at said source; and
identify baseband content of said source signal based on said descriptor.
16. The communication system of claim 15 wherein said acquisition module is further configured to:
select a matching pure-signal generator from a set of pure-signal generators based on said baseband content; and
supply said baseband content to said matching pure-signal generator.
17. The communication system of claim 15 wherein said baseband content is one of:
a de-warped raw signal;
a raw signal;
a warped compressed signal; and
a de-warped compressed signal.
18. The communication system of claim 11 wherein said geometric data comprises:
a gaze position of a viewer of said virtual-reality display; and
representative spatial coordinates of a contour of a predefined form surrounding said gaze position.
19. A communication system comprising:
an acquisition module configured to acquire a source signal from a source and extract a pure signal from the source signal; and
a virtual-reality headset comprising a processor and a memory device configured to:
produce a virtual-reality display of the pure signal;
generate geometric data defining a view region of said display;
derive a content-filtered signal from said pure signal according to said geometric data; and
forward said content-filtered signal for dissemination;
a compression module configured to compress said content-filtered signal to produce a compressed filtered signal; and
a transmitter for transmitting said compressed filtered signal to a broadcasting station.
20. The communication system of claim 19 wherein said pure signal is supplied to at least one of:
an internal display device of said virtual-reality headset; and
an external display device.
21. The communication system of claim 19 further comprising a streaming apparatus configured to:
concurrently receive said source signal; and
provide interactive viewer-defined content selection.
22. The communication system of claim 19 further comprising:
a sensor within the virtual-reality headset providing parameters defining a current gaze orientation of an operator wearing said virtual-reality headset; and
a content filter coupled to said virtual-reality headset and configured to define said view region according to said current gaze orientation.
23. The communication system of claim 19 wherein said acquisition module is configured to:
detect a descriptor indicating signal-processing functions performed at said source; and
identify baseband content of said source signal based on said descriptor.
24. The communication system of claim 23 wherein said acquisition module is further configured to:
select a matching pure-signal generator from a set of pure-signal generators based on said baseband content; and
supply said baseband content to said matching pure-signal generator.
25. The communication system of claim 23 wherein said baseband content is one of:
a de-warped raw signal;
a raw signal;
a warped compressed signal; and
a de-warped compressed signal.