IP Library › Granted Patent US 11,099,802
Granted Patent B2
US 11,099,802 · App. 16/847,856 · Granted Aug 24, 2021

Virtual reality

Inventors: Antti Johannes Eronen (Tampere, FI); Jussi Artturi Leppänen (Tampere, FI); Arto Juhani Lehtiniemi (Lempaala, FI); Miikka Tapani Vilermo (Siuro, FI)
Assignee: NOKIA TECHNOLOGIES OY
G06F3/1454G06F3/011G06F3/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,099,802
App. No.
16/847,856
Granted
Aug 24, 2021
Kind
B2
Abstract

An apparatus comprising means for: enabling a first virtual reality (VR) user to control movement of a first virtual user in a virtual space, wherein the one or more non-VR users are represented in the virtual space by one or more, respective, separate virtual visual elements; enabling selection in the virtual space of a virtual visual element representative of a non-VR user to select one of the one or more non-VR users; newly creating two-way audio communication between the selected one of the one or more non-VR users and a second VR user by enabling audio from the second VR user to be rendered to at least the selected one of the one or more non-VR users and audio from at least the selected one of the one or more non-VR users to be newly rendered to the second VR user.

Claims (45)

1. An apparatus comprising:

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

enable a first virtual reality user and user of the apparatus to control movement of a first virtual user in a virtual space, wherein a first point-of-view of the first virtual reality user in a real space controls at least part of a first virtual visual scene rendered to the first virtual reality user and to one or more non virtual reality users, wherein the one or more non virtual reality users are represented in the virtual space by one or more, respective, separate virtual visual elements, wherein the one or more separate virtual visual elements move, as a group, in the virtual space with the first virtual user;

enable selection in the virtual space of a virtual visual element representative of a non virtual reality user to select one of the one or more non virtual reality users; and

newly create two-way audio communication between the selected one of the one or more non virtual reality users and a second virtual reality user by enabling audio from the second virtual reality user to be rendered to at least the selected one of the one or more non virtual reality users and audio from at least the selected one of the one or more non virtual reality users to be newly rendered to the second virtual reality user, wherein at least one of the first virtual reality user or the second virtual reality user is able to control one or more of:

(a) whether or not audio from the second virtual reality user is rendered to the first virtual reality user;

(b) whether or not audio from the second virtual reality user is rendered to the one or more non virtual reality users;

(c) whether or not audio from the first virtual reality user is rendered to the second virtual reality user;

(d) whether or not audio from the first virtual reality user is rendered to the one or more non virtual reality users; or

(e) whether or not audio from the one or more non virtual reality users is rendered to the first virtual reality user.

2. The apparatus as claimed in claim 1 , further configured to enable the second virtual reality user to control movement of the second virtual user in the virtual space, wherein a second point-of-view of the second virtual reality user in real space controls at least part of a second virtual visual scene rendered at least to the second virtual reality user.

3. The apparatus as claimed in claim 1 , further configured to enable two-way visual communication between the selected one of the one or more non virtual reality users and the second virtual reality user by displaying a visual representation of the second virtual reality user or second virtual user within a window within the first virtual visual scene, the first visual scene being controlled at least in part by a first point-of-view of the first virtual reality user, and by displaying a visual representation of the selected non virtual reality user within a window within the second virtual visual scene, the second visual scene being controlled at least in part by a second point-of-view of the second virtual reality user.

4. The apparatus as claimed in claim 1 , wherein the one or more separate virtual visual elements are avatars of the respective one or more non virtual reality users and are visually distinct compared to virtual users.

5. The apparatus as claimed in claim 1 , wherein selection in the virtual space of the virtual visual element representative of a non virtual reality user switches a mode of the apparatus from a first mode to the second mode, wherein in the first mode, audio from the one or more non virtual reality users is not rendered to the second virtual reality user.

6. The apparatus as claimed in claim 5 , further configured to, in the first mode, enable audio from the first virtual reality user to be rendered to the second virtual reality user; and audio from the second virtual reality user to be rendered to the first virtual reality user and to be rendered to the one or more non virtual reality users.

7. The apparatus as claimed in claim 5 , further configured to enable, in the first mode, two-way audio communication between the first virtual reality user and the second virtual reality user while preventing audio communication from any of the one of the one or more non virtual reality users to the second virtual reality user.

8. The apparatus as claimed in claim 1 further configured to enable the second virtual user to move towards or move close to, in the rendered second virtual visual scene, a virtual visual element representative of a non virtual reality user as a necessary but not necessarily sufficient condition for selecting the non virtual reality user.

9. The apparatus as claimed in claim 1 , wherein audio from the second virtual reality user is rendered to the first virtual reality user via a head mounted device and is rendered to the one or more non virtual reality users differently and audio from the first virtual reality user is rendered to the second virtual reality user via a head mounted device and is rendered to the one or more non virtual reality users differently.

10. The apparatus as claimed in claim 1 , wherein audio from the second virtual reality user is rendered to the first virtual reality user via a head mounted device and is rendered to the one or more non virtual reality users by broadcast via one or more loudspeakers in a real space shared by the first virtual reality user and the one or more non virtual reality users.

11. The apparatus as claimed in claim 1 , wherein the non virtual reality users does not control a virtual user in the virtual space and wherein the one or more separate virtual visual elements are not moveable in the virtual space by the respective one or more non virtual reality users.

12. A method comprising:

enabling a first virtual reality user to control movement of the first virtual user in a virtual space, wherein a first point-of-view of the first virtual reality user in a real space controls at least part of a first virtual visual scene rendered to the first virtual reality user and to one or more non virtual reality users wherein the one or more non virtual reality users are represented in the virtual space by one or more, respective, separate virtual visual elements, wherein the one or more separate virtual visual elements move, as a group, in the virtual space with the first virtual user,

enabling selection in the virtual space of a virtual visual element representative of a non virtual reality user to select one of the one or more non virtual reality users;

newly creating two-way audio communication between the selected one of the one or more non virtual reality users and a second virtual reality user by enabling audio from the second virtual reality user to be rendered to at least the selected one of the one or more non virtual reality users and audio from at least the selected one of the one or more non virtual reality users to be newly rendered to the second virtual reality user, wherein at least one of the first virtual reality user or the second virtual reality user is able to control one or more of:

(a) whether or not audio from the second virtual reality user is rendered to the first virtual reality user;

(b) whether or not audio from the second virtual reality user is rendered to the one or more non virtual reality users;

(c) whether or not audio from the first virtual reality user is rendered to the second virtual reality user;

(d) whether or not audio from the first virtual reality user is rendered to the one or more non virtual reality users; or

(e) whether or not audio from the one or more non virtual reality users is rendered to the first virtual reality user.

13. The method as claimed in claim 12 , further comprising enabling a second virtual reality user to control movement of a second virtual user in the virtual space, wherein a second point-of-view of the second virtual reality user in real space controls at least part of a second virtual visual scene rendered at least to the second virtual reality user.

14. The method as claimed in claim 12 , further comprising enabling two-way visual communication between the selected one of the one or more non virtual reality users and the second virtual reality user by displaying a visual representation of the second virtual reality user or second virtual user within a window within the first virtual visual scene, the first visual scene being controlled at least in part by a first point-of-view of the first virtual reality user, and by displaying a visual representation of the selected non virtual reality user within a window within the second virtual visual scene, the second visual scene being controlled at least in part by a second point-of-view of the second virtual reality user.

15. The method as claimed in claim 12 , wherein the one or more separate virtual visual elements are avatars of the respective one or more non virtual reality users and are visually distinct compared to virtual users.

16. The method as claimed in claim 12 , wherein selection in the virtual space of the virtual visual element representative of a non virtual reality user switches a mode of the apparatus from a first mode to the second mode, wherein in the first mode, audio from the one or more non virtual reality users is not rendered to the second virtual reality user.

17. The method as claimed in claim 16 , further comprising, in the first mode, enabling audio from the first virtual reality user to be rendered to the second virtual reality user; and audio from the second virtual reality user to be rendered to the first virtual reality user and to be rendered to the one or more non virtual reality users.

18. A non-transitory computer readable medium comprising program instructions stored thereon for performing at least the following:

enable a first virtual reality user to control movement of the first virtual user in a virtual space, wherein a first point-of-view of the first virtual reality user in a real space controls at least part of a first virtual visual scene rendered to the first virtual reality user and to one or more non virtual reality users, wherein the one or more non virtual reality users are represented in the virtual space by one or more, respective, separate virtual visual elements, wherein the one or more separate virtual visual elements move, as a group, in the virtual space with the first virtual user;

enable selection in the virtual space of a virtual visual element representative of a non virtual reality user to select one of the one or more non virtual reality users; and

newly create two-way audio communication between the selected one of the one or more non virtual reality users and a second virtual reality user by enabling audio from the second virtual reality user to be rendered to at least the selected one of the one or more non virtual reality users and audio from at least the selected one of the one or more non virtual reality users to be newly rendered to the second virtual reality user, wherein at least one of the first virtual reality user or the second virtual reality user is able to control one or more of:

(a) whether or not audio from the second virtual reality user is rendered to the first virtual reality user;

(b) whether or not audio from the second virtual reality user is rendered to the one or more non virtual reality users;

(c) whether or not audio from the first virtual reality user is rendered to the second virtual reality user;

(d) whether or not audio from the first virtual reality user is rendered to the one or more non virtual reality users; or

(e) whether or not audio from the one or more non virtual reality users is rendered to the first virtual reality user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2020
From: ERONEN, ANTTI JOHANNES; LEPPÄNEN, JUSSI ARTTURI; LEHTINIEMI, ARTO JUHANI; VILERMO, MIIKKA TAPANI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 052446/0801 →
Priority Claims (1)
EP 19169357 · Apr 15, 2019 · regional
Continuity (1)
Related Publication 20200326902A1 · Oct 15, 2020
Cited By (1)
US 12,333,654