IP Library › Granted Patent US 11,443,492
Granted Patent B2
US 11,443,492 · App. 17/253,543 · Granted Sep 13, 2022

Sharing virtual content in a mixed reality scene

Inventors: Matthieu Fradet (Chanteloup, FR); Caroline Baillard (Cesson-Sévigné, FR); Anthony Laurent (Vignoc, FR)
Assignee: InterDigital CE Patent Holdings
G06T19/006G06F3/04815H04L67/131
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,492
App. No.
17/253,543
Granted
Sep 13, 2022
Kind
B2
Abstract

A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Claims (49)

1. A method of controlling access to virtual content in a mixed reality scene rendered on at least two user devices, the method comprising:

enabling, at a first mixed reality (MR) device, a user of the first MR device to select a virtual content object displayed by a display of the first MR device;

enabling, at the first MR device, the user of the first MR device to select a second MR device visible in the display of the first MR device,

wherein the selected virtual content object was at least one of not previously displayed by the second MR device and not previously accessible to the second MR device; and

responsive to at least one of: the user selecting the virtual content object, and the user selecting the second MR device, performing at least one of:

displaying the virtual content object on the second MR device; and

making the virtual content object accessible to the second MR device.

2. The method according to claim 1 , wherein said enabling comprises receiving a user input for selecting the content to be shared in the rendered mixed reality scene.

3. The method according to claim 2 , wherein the mixed reality scene rendered on the first MR device comprises the second MR device and/or a user of the second MR device and/or a graphical symbol representing the second MR device or user of the second user device and wherein said enabling comprises detecting a user input for selecting the rendered second MR device, user of the second MR device or graphical symbol in the rendered mixed reality scene.

4. The method according to claim 3 , wherein the mixed reality scene is rendered on a touchscreen of the first MR device and the detected user input is a gesture performed by a user on the touchscreen.

5. The method according to claim 4 , wherein the performed gesture comprises:

selecting the content to be shared by touching the touchscreen at the location of the displayed content to be shared;

dragging the selected content to the location of the rendered second MR device, user of the second MR device or graphical symbol; and

sharing the selected content by dropping it onto the rendered second MR device, user of the second MR device or graphical symbol.

6. The method according to claim 3 , wherein the second MR device and/or user of the second MR device is represented by a 3D shape.

7. The method according to claim 1 , further comprising:

receiving from the first MR device information related to a virtual content in the mixed reality scene which is selected by the first MR device with the second MR device; and

rendering the selected virtual content with regard to a viewing position and/or orientation of the second MR device onto the mixed reality scene.

8. The method according to claim 7 , further comprising:

receiving a notification that the first MR device wants to share virtual content; and

detecting a user input accepting or declining sharing of the virtual content.

9. The method according to claim 1 , wherein the first and second MR devices exchange information via a server.

10. The method according to claim 9 , wherein the first MR device, when being turned on, requests from the server at least one of the following data:

a scene configuration of the mixed reality scene;

position data for the current location of other MR devices; or

a list of sharable virtual content.

11. The method according to claim 1 , further comprising:

rendering the selected virtual content on the first MR device using a viewing position and/or orientation of the first MR device and 3D position of the selected virtual content.

12. The method according to claim 1 , wherein enabling the user to select the virtual content comprises enabling the user to select the virtual content object within the mixed reality scene using a touchscreen of the first MR device.

13. The method according to claim 1 , wherein enabling the user to select the virtual content comprises enabling the user to select the virtual content object within the mixed reality scene using gaze detection by the first MR device.

14. The method according to claim 1 , wherein enabling the user to select the virtual content and enabling the user to select the second MR device concurrently comprise enabling the user to use a drag and drop gesture.

15. The method according to claim 1 , wherein enabling the user to select the second MR device comprises enabling the user to select the second MR device within the mixed reality scene using a touchscreen of the first MR device.

16. The method according to claim 1 , wherein enabling the user to select the second MR device comprises enabling the user to select the second MR device within the mixed reality scene using gaze detection by the first MR device.

17. The method according to claim 1 , wherein enabling the user to select the second MR device comprises enabling the user to select an icon displayed in proximity to the second MR device within the mixed reality scene displayed on the first MR device.

18. An apparatus comprising:

a processor; and

a non-transitory computer-readable medium storing instructions operative, when executed by the processor, to cause the apparatus to:

enable, at a first mixed reality (MR) device, a user of the first MR device to select a virtual content object displayed by a display of the first MR device;

enable, at the first MR device, the user of the first MR device to select a second MR device visible in the display of the first MR device,

wherein the selected virtual content object was at least one of not previously displayed by the second MR device and not previously accessible to the second MR device; and

responsive to at least one of: the user selecting the virtual content object, and the user selecting the second MR device, perform at least one of:

display the virtual content object on the second MR device; and

make the virtual content object accessible to the second MR device.

19. The apparatus according to claim 18 , further comprising:

a touchscreen configured to display the rendered mixed reality scene including the content to be shared and for detecting a user input being a gesture performed by a user on the touchscreen.

20. A method comprising:

receiving from a first MR device information related to a virtual content in the mixed reality scene which is selected by the first MR device,

wherein the received information comprises a 3D position of the selected virtual content; and

rendering, onto the mixed reality scene, the selected virtual content with regard to the 3D position of the selected virtual content and a viewing position and/or orientation of a second MR device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2022
From: FRADET, MATTHIEU; BAILLARD, CAROLINE; LAURENT, ANTHONY
To: INTERDIGITAL CE PATENT HOLDINGS
Reel/Frame 058791/0134 →
Priority Claims (1)
EP 18305761 · Jun 19, 2018 · regional
Continuity (1)
Related Publication 20210272373A1 · Sep 2, 2021
Cited By (1)
US 12,190,461