IP Library › Granted Patent US 11,263,824
Granted Patent B2
US 11,263,824 · App. 16/684,425 · Granted Mar 1, 2022

Method and system to generate authoring conditions for digital content in a mixed reality environment

Inventors: Jonathan Manzer Forbes (San Francisco, CA); Hugo van Heuven (Brooklyn, NY)
Assignee: Unity IPR ApS
G06T19/20G06F16/285G06T7/70G06T17/00G06T19/006G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,263,824
App. No.
16/684,425
Filed
Nov 14, 2019
Granted
Mar 1, 2022
Kind
B2
Examiner
HOANG, PHI
Art Unit
2613
USPC
345/419
Abstract

Systems and methods for spawning a digital object in an environment are disclosed. Data describing the environment is received. The data includes data describing properties of the environment, a state of the environment, and properties of a plurality of objects within the environment. The data is analyzed to detect and categorize one or more of the plurality of objects, and to detect one or more surfaces related to the plurality of objects. Data is received that describes a placement of the digital object on one of the detected surfaces or detected objects and determines properties of the placement. Conditions are associated with the placed digital object, the conditions including data describing properties of the placement, data describing properties of the detected object, and data describing a state of the detected object. The spawning of the digital object is performed in the environment based on the conditions.

Claims (47)

1. A system comprising:

one or more computer processors;

one or more computer memories;

one or more modules incorporated into the one or more computer memories, the one or more modules configuring the one or more computer processors to perform operations for generating conditions for spawning a digital object in an environment, the operations comprising:

receiving data describing the environment, the data describing the environment including data describing properties of the environment, a state of the environment, and properties of a plurality of objects within the environment;

analyzing the data describing the environment to detect one or more surfaces related to the plurality of objects;

determining a first set of conditions, the first set of conditions being a range of values representing properties of one of the detected surfaces, the properties including one or more of a position, orientation, or scale of the one of the detected surfaces with respect to a local coordinate system-associated with the one of the detected surfaces;

determining a second set of conditions, the second set of conditions describing a placement or orientation of the digital object with respect to the one of the detected surfaces;

associating a final set of conditions with the digital object the final set of conditions being selected from the first set of conditions and the second set of conditions; and associating the final set of conditions with additional digital objects of a same type as the placed digital object.

2. The system of claim 1 , wherein the data describing the environment is received from a mixed reality (MR) enabled device moving through the environment and collecting data.

3. The system of claim 2 , wherein the data describing the environment is generated by sensors on the MR enabled device, the sensors including video cameras, motion sensors, and depth sensors.

4. The system of claim 1 , wherein the data describing the environment is 3D environment data from a 3D digital model.

5. The system of claim 1 , wherein data describing the placement is received from a MR capable device in the environment, and wherein the data describing the placement is generated by sensors on the MR capable device as the sensors monitor the placement of the digital object.

6. The system of claim 1 , the operations including performing the spawning of the digital object in the environment based on the conditions, the performing including:

analyzing the data describing the environment to determine one or more parts of the environment that match the final set of conditions selected from the first set of conditions and the second set of conditions;

based on the matching of the final set of conditions with the one or more parts, positioning, scaling, and orienting a display of the digital object in a mixed reality display device contemporaneously with a view of the environment;

aligning the digital object with at least one part of the one or more parts based on the conditions and a movement of the mixed reality display device.

7. A method comprising:

performing operations for generating conditions for spawning a digital object in an environment, the operations comprising:

receiving data describing the environment, the data describing the environment including data describing properties of the environment, a state of the environment, and properties of a plurality of objects within the environment;

analyzing the data describing the environment to detect one or more surfaces related to the plurality of objects;

determining a first set of conditions, the first set of conditions being a range of values representing properties of one of the detected surfaces, the properties including one or more of a position, orientation, or scale of the one of the detected surfaces with respect to a local coordinate system-associated with the one of the detected surfaces;

determining a second set of conditions, the second set of conditions describing a placement or orientation of the digital object with respect to the one of the detected surfaces:

associating a final set of conditions with the digital object, the final set of conditions being selected from the first set of conditions and the second set of conditions; and

associating the final set of conditions with additional digital objects of a same type as the placed digital object.

8. The method of claim 7 , wherein the data describing the environment is received from a mixed reality (MR) enabled device moving through the environment and collecting data.

9. The method of claim 8 , wherein the data describing the environment is generated by sensors on the MR enabled device, the sensors including video cameras; motion sensors, and depth sensors.

10. The method of claim 7 , wherein the data describing the environment is 3D environment data from a 3D digital model.

11. The method of claim 7 , wherein the data describing a placement is received from a MR capable device in the environment; and wherein the data is generated by sensors on the MR capable device as the sensors monitors a placement of a digital object within environment.

12. The method of claim 7 , wherein data describing the placement is received from a MR capable device in the environment, and wherein the data describing the placement is generated by sensors on the MR capable device as the sensors monitor the placement of the digital object.

13. The method of claim 7 , the operations including performing the spawning of the digital object in the environment based on the conditions, the performing including:

analyzing the data to determine one or more parts of the environment that match the conditions;

analyzing the data describing the environment to determine one or more parts of the environment that match the final set of conditions selected from the first set of conditions and the second set of conditions;

based on the matching of the final set of conditions with the one or more parts, positioning, scaling, and orienting a display of the digital object in a mixed reality display device contemporaneously with a view of the environment

aligning the digital object with at least one part of the one or more parts based on the conditions and a movement of the mixed reality display device.

14. A non-transitory machine-readable storage medium storing a set of instructions, the set of instructions configuring one or more computer processers to perform operations for spawning a digital object in an environment, the operations comprising:

receiving data describing the environment, the data describing the environment including data describing properties of the environment, a state of the environment, and properties of a plurality of objects within the environment;

analyzing the data describing the environment to detect one or more surfaces related to the plurality of objects;

determining a first set of conditions, the first set of conditions being a range of values representing properties of one of the detected surfaces, the properties including one or more of a position, orientation, or scale of the one of the detected surfaces with respect to a local coordinate system-associated with the one of the detected surfaces;

determining a second set of conditions, the second set of conditions describing a placement or orientation of the digital object with respect to the one of the detected surfaces;

associating a final set of conditions with the digital object, the final set of conditions being selected from the first set of conditions and the second set of conditions; and

associating the final set of conditions with additional digital objects of a same type as the placed digital object.

15. The non-transitory machine-readable storage medium of claim 14 , wherein the data describing the environment is received from a mixed reality (MR) enabled device moving through the environment and collecting data.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the data describing the environment is generated by sensors on the MR enabled device, the sensors including video cameras, motion sensors, and depth sensors.

17. The non-transitory machine-readable storage medium of claim 14 , wherein the data describing the environment is 3D environment data from a 3D digital model.

18. The non-transitory machine-readable storage medium of claim 14 , wherein data describing the placement is received from a MR capable device in the environment, and wherein the data describing the placement is generated by sensors on the MR capable device as the sensors monitor the placement of the digital object.

19. The non-transitory machine-readable storage medium of claim 14 , further comprising associating the final set of conditions with the placed digital object and associating the final set of conditions with additional digital objects of a same type as the placed digital object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2025
From: UNITY IPR APS
To: UNITY TECHNOLOGIES APS
Reel/Frame 072926/0322 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2020
From: FORBES, JONATHAN MANZER; VAN HEUVEN, HUGO
To: UNITY IPR APS
Reel/Frame 051674/0721 →
Continuity (2)
Provisional Application 62767330 · Nov 14, 2018
Related Publication 20200151965A1 · May 14, 2020
Cited By (3)
US 12,608,115 US 12,633,044 US 12,711,724