IP Library › Granted Patent US 11,017,605
Granted Patent B2
US 11,017,605 · App. 16/660,746 · Granted May 25, 2021

Method and system for addressing and segmenting portions of the real world for visual digital authoring in a mixed reality environment

Inventor: Andrew Peter Maneri (Bellevue, WA)
Assignee: Unity IPR ApS
G06T19/006G02B27/017G06F3/011G06F3/012G06F3/017G06K9/00671G06T7/70G06T19/20G02B2027/014G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,017,605
App. No.
16/660,746
Granted
May 25, 2021
Kind
B2
Abstract

A method of generating a digital island is disclosed. A base shape of a digital island virtual object is created with respect to a local coordinate system of a digital island. Conditions are associated with the digital island. The conditions include criteria for properties of objects within an environment. Additional virtual objects are associated with the digital island. Data describing the environment is received. The data is analyzed to determine one or more parts of the environment that match the conditions. Based on the matching of conditions, a display of the digital island is positioned, scaled, and oriented in a mixed reality display device contemporaneously with a view of the environment. The digital island with is aligned with at least one part of the one or more parts based on the conditions and a movement of one or more sensors and the mixed reality display device.

Claims (41)

1. A system comprising:

one or more computer processors;

one or more computer memories;

one or more modules incorporated into the one or more computer memories, the one or more modules configuring the one or more computer processors to perform operations for generating a digital island, the operations comprising:

creating a base shape of a digital island virtual object with respect to a local coordinate system of the digital island;

associating conditions with the digital island, the conditions including criteria for properties of objects within an environment, the environment being a virtual environment or a real-world environment;

associating additional virtual objects with the digital island;

receiving data describing the environment, the data describing the environment being created from a sensor scan;

analyzing the data to determine one or more parts of the environment that match the conditions;

based on the matching of the conditions, positioning, scaling, and orienting a display of the digital island and the associated additional virtual objects in a mixed reality display device contemporaneously with a view of the environment; and

aligning the digital island with at least one part of the one or more parts based on the conditions and a movement of one or more sensors and the mixed reality display device.

2. The system of claim 1 , wherein the data describing the environment is received from the one or more sensors within the environment.

3. The system of claim 1 , wherein the data describing the environment is received from a database over a network.

4. The system of claim 1 , wherein the associating of the additional virtual objects with the digital island is done using a drag and drop method within a mixed reality environment.

5. The system of claim 1 , wherein the one or more sensors include at least one of the following: cameras and depth sensors.

6. The system of claim 1 , wherein the criteria for properties of objects within an environment include specifying one or more of the following: geometry of the object, a texture of the object, a relative placement of the object within the environment, color of the object, and lighting of the object.

7. A method comprising:

creating a base shape of a digital island virtual object with respect to a local coordinate system of a digital island;

associating conditions with the digital island, the conditions including criteria for properties of objects within an environment, the environment being a virtual environment or a real-world environment;

associating additional virtual objects with the digital island;

receiving data describing the environment, the data describing the environment being created from a sensor scan;

analyzing the data to determine one or more parts of the environment that match the conditions;

based on the matching of the conditions, positioning, scaling, and orienting a display of the digital island and the associated additional virtual objects in a mixed reality display device contemporaneously with a view of the environment; and

aligning the digital island with at least one part of the one or more parts based on the conditions and a movement of one or more sensors and the mixed reality display device.

8. The method of claim 7 , wherein the data describing the environment is received from the one or more sensors within the environment.

9. The method of claim 7 , wherein the data describing the environment is received from a database over a network.

10. The method of claim 7 , wherein the associating of the additional virtual objects with the digital island is done using a drag and drop method within a mixed reality environment.

11. The method of claim 7 , wherein the one or more sensors include at least one of the following: cameras and depth sensors.

12. The method of claim 7 , wherein the criteria for properties of objects within an environment include specifying one or more of the following: a geometry of the object, a texture of the object, a relative placement of the object within the environment, color of the object, and lighting of the object.

13. A non-transitory machine-readable storage medium storing a set of instructions that, when executed by one or more computer processors, cause the one or more computer processors to perform operations comprising:

creating a base shape of a digital island virtual object with respect to a local coordinate system of a digital island;

associating conditions with the digital island, the conditions including criteria for properties of objects within an environment, the environment being a virtual environment or a real-world environment;

associating additional virtual objects with the digital island;

receiving data describing the environment, the data describing the environment being created from a sensor scan;

analyzing the data to determine one or more parts of the environment that match the conditions;

based on the matching of the conditions, positioning, scaling, and orienting a display of the digital island and the associated additional virtual objects in a mixed reality display device contemporaneously with a view of the environment; and

aligning the digital island with at least one part of the one or more parts based on the conditions and a movement of one or more sensors and the mixed reality display device.

14. The non-transitory machine-readable storage medium of claim 13 , wherein the data describing the environment is received from the one or more sensors within the environment.

15. The non-transitory machine-readable storage medium of claim 13 , wherein the data describing the environment is received from a database over a network.

16. The non-transitory machine-readable storage medium of claim 13 , wherein the associating of the additional virtual objects with the digital island is done using a drag and drop method within a mixed reality environment.

17. The non-transitory machine-readable storage medium of claim 13 , wherein the one or more sensors include at least one of the following: cameras and depth sensors.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2025
From: UNITY IPR APS
To: UNITY TECHNOLOGIES APS
Reel/Frame 072926/0322 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2020
From: MANERI, ANDREW PETER
To: UNITY IPR APS
Reel/Frame 051509/0250 →
Continuity (2)
Provisional Application 62749064 · Oct 22, 2018
Related Publication 20200126310A1 · Apr 23, 2020