IP Library Granted Patent US 11,601,689
Granted Patent B2
US 11,601,689 · App. 17/742,647 · Granted Mar 7, 2023

Remote virtual reality viewing of an event using crowdsourcing

Inventors: Saraswathi Sailaja Perumalla (Visakhapatnam, IN); Gautam Zalpuri (Boxborough, MA); Shanthan Chamala (Malvern, PA); Venkata Vara Prasad Karri (Visakhapatnam, IN); Akash U. Dhoot (Pune, IN)
Assignee: International Business Machines Corporation
H04N21/21805H04N13/117H04N21/2187H04N21/23418H04N21/2743
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,601,689
App. No.
17/742,647
Granted
Mar 7, 2023
Kind
B2
Abstract

A mechanism is provided for remote virtual reality viewing of an event using crowdsourcing. Each video perspective of a plurality of video perspectives of the event is analyzed to identify content and context of the event. A digital virtual reality (VR) experience (VRX) token stream of each video perspective of the plurality of video perspectives is produced based on the identified content and the identified context of the event. Responsive to a remote user initiating a viewing of a virtual reality presentation of the event, a set of digital VRX token streams of the event is presented to the remote user. Responsive to the remote user selecting one digital VRX token stream of the set of digital VRX token streams, the selected digital VRX token stream is presented to the remote user in a virtual reality format.

Claims (61)

1. A method, in a data processing system, for remote representation of an event using crowdsourcing, the method comprising:

receiving a plurality of crowdsource data streams from a plurality of different crowdsource computing devices present at an event, each crowdsource data stream from each crowdsource computing device providing a different perspective, in a plurality of perspectives, of the event;

receiving a request, from a remote user client computing device, to initiate a remote presentation of the event, wherein the request specifies a selected perspective from which to represent the event;

responsive to receiving the request, generating a remote user data stream, based on one or more of the crowdsource data streams, representing the selected perspective; and outputting, to the remote user client computing device, the remote user data stream, wherein generating the remote user data stream comprises:

analyzing each crowdsource data stream in the plurality of crowdsource data streams to identify a content and context data associated with the event; and

producing a plurality of digital virtual reality (VR) experience (VRX) token streams based on the identified content and identified context of the event, wherein the plurality of digital VRX token streams comprise a separate VRX token stream for each perspective in the plurality of perspectives, and wherein the request specifies the selected perspective as a selection of a digital VRX token stream from the plurality of digital VRX token streams.

2. The method of claim 1 , further comprising providing a control whereby a remote user, via the remote user client computing device, modifies the selected perspective to be a modified perspective and submits a modification request to modify the selected perspective to be the modified perspective, and wherein the method further comprises, in response to receiving the modification request via the control, modifying the remote user data stream, based on the one or more crowdsource data streams, to represent the modified perspective.

3. The method of claim 1 , wherein the identified content of the event identifies the material, matter, or medium within the perspective and wherein the identified context of the event comprises one or more of a date, a time, geospatial information, direction of the perspective in relation to where the perspective is captured.

4. The method of claim 1 , further comprising:

presenting the plurality of digital VRX token streams of the event to the remote user;

assigning a VRX metric to each VRX token stream by categorizing VRX data packets within the VRX token stream; and

utilizing the VRX metrics associated with each digital VRX token stream in the set of digital VRX token streams to rank the set of digital VRX token streams presented to the remote user.

5. The method of claim 4 , further comprising:

enhancing the VRX metric associated with a particular digital VRX token stream using social media information related to the video perspective from which the VRX token stream was generated thereby forming an enhanced VRX metric;

comparing the enhanced VRX metric to the assigned VRX metric to generate true VRX metrics; and

utilizing the true VRX metrics associated with each digital VRX token stream in the plurality of digital VRX token streams to re-rank the set of digital VRX token streams presented to the remote user.

6. The method of claim 5 , wherein enhancing the VRX metric associated with the particular digital VRX token stream using social media information comprises polling social circle information associated with at least one user of at least one crowdsource computing device from which the digital VRX token stream was obtained, to identify video, text, or audio indicating a response to the VRX token stream by other users.

7. The method of claim 1 , wherein the plurality of perspectives of the event are video perspectives collected from the plurality of different crowdsource computing devices while the event is happening, and wherein the remote user data stream is a digital virtual reality experience token stream for presenting a virtual reality representation of the event at the user client computing device.

8. The method of claim 1 , wherein the remote user data stream is synthesized from multiple media sources at the event including at least two of live data streams associated with the event, photos associated with the event, videos associated with the event, and recordings associated with the event.

9. The method of claim 1 , wherein the plurality of different crowdsource computing devices comprise fixed cameras at the event location and portable cameras associated with persons streaming the event.

10. A computer program product comprising a computer readable storage medium having a computer readable program for remote virtual reality viewing of an event using crowdsourcing stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to:

receive a plurality of crowdsource data streams from a plurality of different crowdsource computing devices present at an event, each crowdsource data stream from each crowdsource computing device providing a different perspective, in a plurality of perspectives, of the event;

receive a request, from a remote user client computing device, to initiate a remote presentation of the event, wherein the request specifies a selected perspective from which to represent the event;

generate, responsive to receiving the request, a remote user data stream, based on one or more of the crowdsource data streams, representing the selected perspective; and output, to the remote user client computing device, the remote user data stream, wherein generating the remote user data stream comprises:

analyzing each crowdsource data stream in the plurality of crowdsource data streams to identify a content and context data associated with the event; and

producing a plurality of digital virtual reality (VR) experience (VRX) token streams based on the identified content and identified context of the event, wherein the plurality of digital VRX token streams comprise a separate VRX token stream for each perspective in the plurality of perspectives, and wherein the request specifies the selected perspective as a selection of a digital VRX token stream from the plurality of digital VRX token streams.

11. The computer program product of claim 10 , wherein the computer readable program further causes the computing device to:

provide a control whereby a remote user, via the remote user client computing device, modifies the selected perspective to be a modified perspective and submits a modification request to modify the selected perspective to be the modified perspective; and

in response to receiving the modification request via the control, modify the remote user data stream, based on the one or more crowdsource data streams, to represent the modified perspective.

12. The computer program product of claim 10 , wherein the identified content of the event identifies the material, matter, or medium within the perspective and wherein the identified context of the event comprises one or more of a date, a time, geospatial information, direction of the perspective in relation to where the perspective is captured.

13. The computer program product of claim 10 , wherein the computer readable program further causes the computing device to:

present the plurality of digital VRX token streams of the event to the remote user;

assign a VRX metric to each VRX token stream by categorizing VRX data packets within the VRX token stream; and

utilize the VRX metrics associated with each digital VRX token stream in the set of digital VRX token streams to rank the set of digital VRX token streams presented to the remote user.

14. The computer program product of claim 13 , wherein the computer readable program further causes the computing device to:

enhance the VRX metric associated with a particular digital VRX token stream using social media information related to the video perspective from which the VRX token stream was generated thereby forming an enhanced VRX metric;

compare the enhanced VRX metric to the assigned VRX metric to generate true VRX metrics; and

utilize the true VRX metrics associated with each digital VRX token stream in the plurality of digital VRX token streams to re-rank the set of digital VRX token streams presented to the remote user.

15. The computer program product of claim 14 , wherein enhancing the VRX metric associated with the particular digital VRX token stream using social media information comprises polling social circle information associated with at least one user of at least one crowdsource computing device from which the digital VRX token stream was obtained, to identify video, text, or audio indicating a response to the VRX token stream by other users.

16. The computer program product of claim 10 , wherein the plurality of perspectives of the event are video perspectives collected from the plurality of different crowdsource computing devices while the event is happening, and wherein the remote user data stream is a digital virtual reality experience token stream for presenting a virtual reality representation of the event at the user client computing device.

17. The computer program product of claim 10 , wherein the remote user data stream is synthesized from multiple media sources at the event including at least two of live data streams associated with the event, photos associated with the event, videos associated with the event, and recordings associated with the event.

18. An apparatus for remote virtual reality viewing of an event using crowdsourcing comprising:

at least one processor; and

at least one memory coupled to the at least one processor, wherein the at least one memory comprises instructions which, when executed by the at least one processor, cause the at least one processor to:

receive a plurality of crowdsource data streams from a plurality of different crowdsource computing devices present at an event, each crowdsource data stream from each crowdsource computing device providing a different perspective, in a plurality of perspectives, of the event;

receive a request, from a remote user client computing device, to initiate a remote presentation of the event, wherein the request specifies a selected perspective from which to represent the event;

generate, responsive to receiving the request, a remote user data stream, based on one or more of the crowdsource data streams, representing the selected perspective; and output, to the remote user client computing device, the remote user data stream, wherein generating the remote user data stream comprises:

analyzing each crowdsource data stream in the plurality of crowdsource data streams to identify a content and context data associated with the event; and

producing a plurality of digital virtual reality (VR) experience (VRX) token streams based on the identified content and identified context of the event, wherein the plurality of digital VRX token streams comprise a separate VRX token stream for each perspective in the plurality of perspectives, and wherein the request specifies the selected perspective as a selection of a digital VRX token stream from the plurality of digital VRX token streams.

19. The apparatus of claim 18 , wherein the identified content of the event identifies the material, matter, or medium within the perspective and wherein the identified context of the event comprises one or more of a date, a time, geospatial information, direction of the perspective in relation to where the perspective is captured.

20. The apparatus of claim 18 , wherein the instructions further cause the at least one processor to:

present the plurality of digital VRX token streams of the event to the remote user;

assign a VRX metric to each VRX token stream by categorizing VRX data packets within the VRX token stream; and

utilize the VRX metrics associated with each digital VRX token stream in the set of digital VRX token streams to rank the set of digital VRX token streams presented to the remote user.

21. The apparatus of claim 20 , wherein the instructions further cause the at least one processor to:

enhance the VRX metric associated with a particular digital VRX token stream using social media information related to the video perspective from which the VRX token stream was generated thereby forming an enhanced VRX metric;

compare the enhanced VRX metric to the assigned VRX metric to generate true VRX metrics; and

utilize the true VRX metrics associated with each digital VRX token stream in the plurality of digital VRX token streams to re-rank the set of digital VRX token streams presented to the remote user.

22. The apparatus of claim 21 , wherein enhancing the VRX metric associated with the particular digital VRX token stream using social media information comprises polling social circle information associated with at least one user of at least one crowdsource computing device from which the digital VRX token stream was obtained, to identify video, text, or audio indicating a response to the VRX token stream by other users.

23. The apparatus of claim 18 , wherein the plurality of perspectives of the event are video perspectives collected from the plurality of different crowdsource computing devices while the event is happening, and wherein the remote user data stream is a digital virtual reality experience token stream for presenting a virtual reality representation of the event at the user client computing device.

24. The apparatus of claim 18 , wherein the remote user data stream is synthesized from multiple media sources at the event including at least two of live data streams associated with the event, photos associated with the event, videos associated with the event, and recordings associated with the event.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2023
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: ROBLOX CORPORATION
Reel/Frame 064882/0470 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2022
From: PERUMALLA, SARASWATHI SAILAJA; ZALPURI, GAUTAM; CHAMALA, SHANTHAN; KARRI, VENKATA VARA PRASAD; DHOOT, AKASH U.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 059987/0435 →
Continuity (2)
Continuation 17307720 · May 4, 2021
Related Publication 20220360826A1 · Nov 10, 2022