IP Library Granted Patent US 11,087,563
Granted Patent B2
US 11,087,563 · App. 16/971,603 · Granted Aug 10, 2021

Object creation with physical manipulation

Inventors: Tim Zurmoehle (Plantation, FL); Andrea Isabel Montoya (Plantation, FL); Robert John Cummings MacDonald (Plantation, FL); Sakina Groth (Plantation, FL); Genevieve Mak (Plantation, FL)
Assignee: Magic Leap, Inc.
G06T19/20G06F3/011G06F3/016G06F3/017G06F3/0346G06T19/006G06T2200/24G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,563
App. No.
16/971,603
Granted
Aug 10, 2021
Kind
B2
Abstract

Described are improved systems and methods for navigation and manipulation of interactable objects in a 3D mixed reality environment. Improved systems and methods are provided to implement physical manipulation for creation and placement of interactable objects, such as browser windows and wall hangings. A method includes receiving data indicating a selection of an interactable object contained within a first prism at the start of a user interaction. The method also includes receiving data indicating an end of the user interaction with the interactable object. The method further includes receiving data indicating a physical movement of the user corresponding to removing the interactable object from the first prism between the start and the end of the user interaction. Moreover, the method includes creating a second prism to contain the data associated with the interactable object at the end of the user interaction with the interactable object.

Claims (36)

1. A method, comprising:

receiving data indicating a selection of an interactable object contained within a first prism at a start of a user interaction, wherein the data indicating the selection of the interactable object corresponds to at least a portion of a body of a user interacting with a link;

generating a preview of the link by accessing content for a Uniform Resource Locator (URL) associated with the link;

displaying the preview including at least a portion of the content for the URL associated with the link;

receiving data indicating an end of the user interaction with the interactable object;

receiving data indicating a physical movement of the user corresponding to removing the interactable object from the first prism between the start and the end of the user interaction, wherein the physical movement of the user corresponds to a movement of the preview such that visual display of the preview moves during the user interaction according to the physical movement; and

creating a second prism to contain the interactable object at the end of the user interaction with the interactable object.

2. The method of claim 1 , further comprising displaying the preview at a location of the interactable object between the start and the end of the user interaction when the interactable object is located outside of bounds of the first prism.

3. The method of claim 1 , further comprising providing, by a user input device, the data indicating the selection of the interactable object and the data indicating the end of the user interaction with the interactable object.

4. The method of claim 3 , wherein the user input device is a haptics controller.

5. The method of claim 4 , wherein the haptics controller corresponds to a totem device having at least six degrees of freedom.

6. The method of claim 4 , wherein the physical movement of the user is translated into event objects at a processing system associated with the haptics controller, where the event objects correlate to data for movement or positioning of the haptics controller.

7. The method of claim 4 , wherein a location of the interactable object at the end of the user interaction is determined by identifying a location at which a trigger is released for the haptics controller after the selection of the interactable object.

8. The method of claim 3 , wherein the user input device is a camera to detect a user gesture.

9. The method of claim 8 , wherein the data indicating the selection of the interactable object corresponds to a selection gesture.

10. The method of claim 8 , wherein the data indicating the end of the user interaction with the interactable object corresponds to a release gesture.

11. The method of claim 1 , wherein the interactable object is both opened and placed with the user interaction.

12. The method of claim 1 , further comprising determining an orientation for the interactable object by:

determining a surface normal of a location of the interactable object at the end of the user interaction;

determining an orientation data of the interactable object; and

aligning the surface normal of the location with the orientation data of the interactable object.

13. The method of claim 1 , wherein the interactable object comprises a wall hanging.

14. A method, comprising:

receiving data indicating a selection of an interactable object at a start of a user interaction, wherein the data indicating the selection of the interactable object corresponds to at least a portion of a body of a user interacting with a link;

generating a preview of the link by accessing content for a Uniform Resource Locator (URL) associated with the link;

displaying the preview including at least a portion of the content for the URL associated with the link;

receiving data indicating an end of the user interaction with the interactable object;

determining a location of the interactable object at the end of the user interaction;

receiving data indicating a physical movement of the user, wherein the physical movement of the user corresponds to a movement of the preview such that visual display of the preview moves during the user interaction according to the physical movement; and

creating a new prism for the interactable object at the end of the user interaction when the location of the interactable object at the end of the user interaction is outside of an initial prism of the interactable object.

15. A method, comprising:

receiving data indicating the selection of an interactable object contained within a first prism at a start of a user interaction, wherein the data indicating the selection of the interactable object corresponds to at least a portion of a body of a user interacting with a link;

generating a preview of the link by accessing content for a Uniform Resource Locator (URL) associated with the link;

displaying the preview including at least a portion of the content for the URL associated with the link;

receiving data indicating a physical movement of the user, wherein the physical movement of the user corresponds to a movement of the preview such that visual display of the preview moves during the user interaction according to the physical movement; and

creating a second prism at a location of the interactable object at an end of the user interaction to contain the interactable object when the data indicating the physical movement of the user indicates that the interactable object is outside of the first prism at the end of the user interaction.

Assignments (1)
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →