IP Library Granted Patent US 11,907,412
Granted Patent B2
US 11,907,412 · App. 17/034,353 · Granted Feb 20, 2024

Contextual spectator inclusion in a virtual reality experience

Inventors: Zachary A. Silverstein (Jacksonville, FL); Cesar Augusto Rodriguez Bravo (Alajuela, CR); Hemant Kumar Sivaswamy (Pune, IN); Carlos E Aguilera (Powder Springs, GA)
Assignee: International Business Machines Corporation
G06F3/011A63F13/213A63F13/86A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,907,412
App. No.
17/034,353
Granted
Feb 20, 2024
Kind
B2
Abstract

A method of generating a virtual reality (“VR”) experience includes detecting, using external sensors, a real-world spectator that is in a spectator space that is adjacent to a user that is wearing a VR headset and experiencing a VR space. The method also includes detecting a real-world physical state of the spectator, and rendering, in response to detecting, the spectator in the VR space as an avatar that reflects the real-world physical state of the spectator.

Claims (62)

1. A method of generating a virtual reality (“VR”) experience, the method comprising:

detecting, using external sensors, a real-world spectator that is in a spectator space that is adjacent to a user that is wearing a VR headset and experiencing a VR space;

detecting a real-world physical state of the spectator comprising sounds of the spectator;

rendering, in response to detecting the real-world physical state of the spectator, the spectator in the VR space as an avatar that reflects the real-world physical state of the spectator;

rendering a plurality of VR fans in the VR space;

boosting experience points of the user based on sounds from the spectator; and

transforming the sounds of the spectator to make the sounds sound like they are being made by at least some of the plurality of VR fans;

wherein the real-world physical state of the spectator reveals a real-world emotional state of the spectator;

wherein the avatar reflects the real-world emotional state of the spectator; and

wherein at least some of the plurality of VR fans reflect the real-world movements of the spectator, facial expressions of the spectator, or gestures of the spectator.

2. The method of claim 1 , wherein detecting the real-world physical state of the spectator is selected from the group consisting of detecting gestures of the spectator, detecting facial expressions of the spectator, detecting utterances of the spectator, and detecting noises of the spectator.

3. The method of claim 1 , wherein:

the real-world physical state of the spectator includes apparel worn by the spectator; and

the avatar is rendered to reflect a color and/or a pattern of the apparel.

4. The method of claim 1 , wherein a form of the avatar is a non-human entity.

5. A virtual reality (“VR”) system comprising:

a VR controller including one or more processors and a computer-readable storage medium coupled to the one or more processors storing program instructions, the VR controller being configured to generate a VR experience;

a VR headset communicatively connected to the VR controller that is configured to display a VR space to a user;

a sensor communicatively connected to the VR controller that is configured to monitor a spectator space proximate to the user;

a display communicatively connected to the VR controller that is viewable from the spectator space; and

boosting experience points of the user based on sounds from the spectator;

wherein the program instructions, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

detecting, using the sensor, a first person in the spectator space;

analyzing the first person to determine whether the first person is a spectator or a bystander based on whether the first person is engaged in another activity that is unrelated to the VR system;

prompting, in response to determining that the first person is a spectator because the first person is not engaged in the another activity, the first person to opt-in to the VR experience; and

rendering, in response to the first person opting-in, an avatar in the VR space that represents the spectator.

6. The VR system of claim 5 , wherein the sensor comprises:

a first plurality of cameras mounted on the VR headset; and

a second plurality of cameras that are mounted off of the VR headset.

7. The VR system of claim 5 , wherein rendering the avatar in the VR space that represents the spectator comprises:

rendering an entrance animation in the VR space involving the avatar in response to the first person opting-in.

8. The VR system of claim 5 , wherein rendering the avatar in the VR space that represents the spectator comprises:

rendering an exit animation in the VR space involving the avatar in response to the first person leaving the spectator space.

9. The VR system of claim 8 , wherein rendering the avatar in the VR space that represents the spectator comprises:

rendering an entrance animation in the VR space involving the avatar in response to the first person reentering the spectator space.

10. The VR system of claim 5 , wherein the program instructions, when executed by the one or more processors, cause the one or more processors to perform operations further comprising:

determining that the first person is no longer a spectator based on eye movements of the first person; and

rendering an exit animation in the VR space involving the avatar in response to determining that the first person is no longer a spectator.

11. The VR system of claim 5 , wherein the program instructions, when executed by the one or more processors, cause the one or more processors to perform further operations comprising:

detecting, using the sensor, a second person in the spectator space;

analyzing the second person to determine whether the second person is a spectator or a bystander based on whether the second person is engaged in another activity that is unrelated to the VR system;

determining that the second person is a bystander in response to the second person being engaged in the another activity; and

declining to prompt, in response to determining that the second person is a bystander, the second person to opt-in to the VR experience.

12. A method of generating a virtual reality (“VR”) experience, the method comprising:

detecting, using external sensors, a real-world spectator that is in a spectator space that is adjacent to a user that is wearing a VR headset and experiencing a VR space;

analyzing the VR space to determine a VR context, wherein analyzing the VR space to determine the VR context comprises analyzing music in the VR experience;

rendering, in response to analyzing, the spectator in the VR space as an avatar that reflects the VR context;

detecting a real-world physical state of the spectator comprising sounds of the spectator;

rendering, in response to detecting the real-world physical state of the spectator, the spectator in the VR space as an avatar that reflects the real-world physical state of the spectator;

boosting experience points of the user based on sounds from the spectator; and

recording a portion of the VR experience in response to a dramatic and/or loud expression by the spectator.

13. The method of claim 12 , wherein a form of the avatar is a non-human entity.

14. The method of claim 12 , wherein analyzing the VR space to determine the VR context further comprises:

analyzing the VR space for color themes, geography, wildlife, characters, architecture, vehicles, apparel, language, speech patterns, time period, and/or fictional beings.

15. The method of claim 12 , wherein analyzing the VR space to determine the VR context comprises:

analyzing a description of the VR space.

16. The method of claim 12 , wherein rendering the spectator in the VR space comprises:

selecting an avatar from a predetermined list of avatars for the VR context.

17. The method of claim 12 , wherein rendering the spectator in the VR space comprises:

rendering an entrance animation in the VR space involving the avatar.

18. The method of claim 12 , wherein rendering the spectator in the VR space comprises:

rendering an exit animation in the VR space involving the avatar in response to the real-world spectator leaving the spectator space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2020
From: SILVERSTEIN, ZACHARY A.; RODRIGUEZ BRAVO, CESAR AUGUSTO; SIVASWAMY, HEMANT KUMAR; AGUILERA, CARLOS E
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 053900/0768 →
Continuity (1)
Related Publication 20220100261A1 · Mar 31, 2022
Cited By (1)
US 12,443,283