IP Library Granted Patent US 10,586,302
Granted Patent B1
US 10,586,302 · App. 15/684,877 · Granted Mar 10, 2020

Systems and methods to generate an environmental record for an interactive space

Inventors: Conner Brooks (San Mateo, CA); Joshua Hernandez (Redwood City, CA); Moqian Tian (Redwood City, CA)
Assignee: Meta View, Inc.
G06T1/0007G06K9/00671G06T1/20G06T7/74G06T19/006G06K9/4671G06K9/6202H04L67/38
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,586,302
App. No.
15/684,877
Granted
Mar 10, 2020
Kind
B1
Abstract

Systems and methods to generate an environmental record for an interactive space are presented herein. An environmental record may represent a set of local environments and may define archival location compositions for the local environments. An archival location composition for a local environment may define aspects of the local environment associated with one or more objects and/or surfaces previously determined to be present in the local environment. A headset worn by a user in the local environment may generate a current location composition based on output signals from sensors included in the headset. The archival and current location compositions may be compared to determine updates for the environmental record.

Claims (59)

1. A system configured to generate an environmental record for an interactive space, the system comprising:

one or more client devices;

one or more sensors coupled to each client device configured to:

generate first output signals conveying visual information, the visual information defining images of a local environment within a real-world environment over time; and

generate second output signals conveying position and/or orientation information, the position and/or orientation information specifying position and/or orientation of the client device over time;

a first set of one or more physical processors coupled to the client device configured by machine-readable instructions to:

obtain, from non-transitory electronic storage coupled to an environmental record server, a portion of an environmental record of the real-world environment that contains an archival location composition characterizing a first set of one or more objects and/or surfaces previously determined to be present in the local environment;

obtain the first and second output signals from the one or more sensors;

generate, based on the first and second output signals from the one or more sensors, a current location composition for the local environment characterizing a second set of one or more objects and/or surfaces currently present in the local environment;

the environmental record server that includes a second set of one or more physical processors configured by machine-readable instructions to:

obtain information indicating differences between the current location composition and the archival location composition, wherein the differences information includes information describing a new object or surface not presently included in the environmental record;

determine whether the information describing the new object or surface has been consistently obtained from the one or more client devices over a predetermined time period, wherein consistency is determined as a function of a threshold frequency with which the information describing the new object or surface has been obtained from the one or more client devices or as a function of a threshold number of the one or more client devices have obtained the information describing the new object or surface; and

responsive to determining that information describing the new object or surface has been consistently obtained, update the portion of the environmental record that contains an archival location composition to include the information describing the new object or surface.

2. The system of claim 1 , wherein the first set of one or more physical processors are configured by machine-readable instructions to:

determine the differences between the current location composition and the archival location composition by comparing the description of the first set of one or more objects and/or surfaces with the description of the second set of one or more objects and/or surfaces.

3. The system of claim 1 , wherein the second set of one or more physical processors are configured by machine-readable instructions to:

determine the differences between the current location composition and the archival location composition by comparing the description of the first set of one or more objects and/or surfaces with the description of the second set of one or more objects and/or surfaces.

4. The system of claim 3 , wherein determining the differences between the current location composition and the archival location composition comprises one or both of:

determining whether the first set of one or more objects and/or surfaces previously determined to be present in the local environment are currently present in the local environment; or

determining whether the second set of one or more objects and/or surfaces currently present in the local environment includes objects and/or surfaces that were not previously determined to be present in the local environment.

5. The system of claim 4 , wherein one of the first set of one or more physical processors or the second set of one or more physical processors are configured by machine-readable instructions to:

responsive to determining that one or more of the objects and/or surfaces in the first set of one or more objects and/or surfaces are present in both the archival location composition and current location composition, determine if there are any changes in position and/or orientation to those objects and/or surfaces; and

responsive to determining that there are such changes in position and/or orientation of the objects and/or surfaces determined to be present in both the archival location composition and current location composition, update the portion of the environmental record with information indicating those changes, wherein the changes represent the differences.

6. The system of claim 4 , wherein one of the first set of one or more physical processors or the second set of one or more physical processors are configured by machine-readable instructions to:

responsive to determining that one or more of the objects and/or surfaces in the first set of one or more objects and/or surfaces are not currently present in the local environment:

generate first information indicating which objects and/or surfaces are no longer present in the local environment;

generate second information including the information identifying the new object or surface; and

update the portion of the environmental record based on the information indicating the differences determined between the objects and/or surfaces present in the current location composition and the archival location composition based on the first and second generated information.

7. The system of claim 4 , wherein one of the first set of one or more physical processor or the second set of one or more physical processors are configured by machine-readable instructions to:

responsive to determining that the second set of one or more objects and/or surfaces currently present in the local environment includes the same objects and/or surfaces that were previously present in the local environment, determine there are no additions or updates to the archival location composition.

8. The system of claim 1 , wherein the interactive space is an augmented reality space and the client device includes one or more image-forming components configured to generate images of virtual content superimposed over the user's view of the real-world environment.

9. The system of claim 8 , wherein the client device is a headset.

10. A method to generate an environmental record for an interactive space viewable b\ one or more client devices, the method comprising:

obtaining first output signals conveying visual information to one of the one or more client devices, the visual information defining images of a local environment within a real-world environment over time;

obtaining second output signals conveying position and/or orientation information, the position and/or orientation information specifying position and/or orientation the client device over time;

obtaining a portion of an environmental record of the real-world environment that contains an archival location composition that defines a first set of one or more objects and/or surfaces previously determined to be present in the local environment;

generating, based on the first and second output signals, a current location composition for the local environment that define a second set of one or more objects and/or surfaces currently present in the local environment;

obtaining information indicating differences between the current location composition and the archival location composition, wherein the differences information describes a new object or surface not presently included in the environmental record;

determining that the information describing the new object or surface has been consistently obtained from the one or more client devices over a predetermined time period, wherein consistency is determined as a function of a threshold frequency with which the information describing the new object or surface has been obtained from the one or more client devices or a threshold number of the one or more client devices obtaining the information describing the new object or surface; and

responsive to determining that information describing the new object or surface has been consistently obtained, update the portion of the environmental record that contains an archival location composition to include the information describing the new object or surface.

11. The method of claim 10 , further comprising:

determining, at an environmental record server, the differences between the current location composition and the archival location composition by comparing the first set of one or more objects and/or surfaces with the second set of one or more objects and/or surfaces.

12. The method of claim 10 , further comprising:

determining, at a client device, the differences between the current location composition and the archival location composition by comparing the first set of one or more objects and/or surfaces with the second set of one or more objects and/or surfaces.

13. The method of claim 12 , wherein determining the differences between the current location composition and the archival location composition comprises one or both of:

determining whether the first set of one or more objects and/or surfaces previously determined to be present in the local environment are currently present in the local environment; or

determining whether the second set of one or more objects and/or surfaces currently present in the local environment includes objects and/or surfaces that were not previously determined to be present in the local environment.

14. The method of claim 13 , further comprising:

responsive to determining that one or more of the objects and/or surfaces in the first set of one or more objects and/or surfaces are present in both the archival location composition and current location composition, determine if there are any changes in position and/or orientation to those objects and/or surfaces; and

responsive to determining that there are such changes in position and/or orientation of the objects and/or surfaces determined to be present in both the archival location composition and current location composition, update the portion of the environmental record with information indicating those changes, wherein the changes represent the differences.

15. The method of claim 13 , further comprising:

responsive to determining that one or more of the objects and/or surfaces in the first set of one or more objects and/or surfaces are not currently present in the local environment:

generating first information indicating which objects and/or surfaces are no longer present in the local environment;

generating second information including the information identifying the canonical object; and

updating the portion of the environmental record based on the information indicating the differences determined between the objects and/or surfaces present in the current location composition and the archival location composition based on the generated first and second information.

16. The method of claim 13 , further comprising:

responsive to determining that the second set of one or more objects and/or surfaces currently present in the local environment includes the same objects and/or surfaces that were previously present in the local environment, determining there are no additions or updates to the archival location composition.

17. The method of claim 10 , wherein the interactive space is an augmented reality space facilitated by a client device including one or more image-forming components configured to generate images of virtual content superimposed over the user's view of the real-world environment.

18. The method of claim 17 , wherein the client device is a headset.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: CAMPFIRE 3D, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 067209/0066 →
CHANGE OF NAME Recorded Feb 16, 2024
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 066619/0413 →
CHANGE OF NAME Recorded Feb 8, 2024
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 066422/0129 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 15/587,105 PREVIOUSLY RECORDED AT REEL: 047240 FRAME: 0864. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 22, 2019
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 048964/0953 →
RELEASE OF SECURITY INTEREST Recorded Mar 1, 2019
From: K&L GATES LLP
To: META VIEW, INC.
Reel/Frame 050110/0688 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2019
From: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
To: META VIEW, INC.
Reel/Frame 049038/0277 →
SECURITY INTEREST Recorded Oct 16, 2018
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 047240/0864 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2017
From: BROOKS, CONNER; HERNANDEZ, JOSHUA; TIAN, MOQIAN
To: META COMPANY
Reel/Frame 043827/0009 →
SECURITY INTEREST Recorded Oct 10, 2017
From: META COMPANY
To: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
Reel/Frame 043829/0038 →