Systems and methods for augmented and virtual reality

1. An augmented reality system, comprising:

at least one server comprising a processor and configured to:

receive first data corresponding to a first location and second data corresponding to a second location respectively from the first virtual or augmented reality display system and the second virtual or augmented reality display system through one or more networks communicably connecting a first and second virtual or augmented reality display systems to the at least one server, wherein

the first data corresponds to the first location at which the first virtual or augmented reality display system is located,

the second data corresponds to the second location at which the second virtual or augmented reality display system is located, and

the first virtual or augmented reality display system is different from the second virtual or augmented reality display system,

reduce the first location to a first node and the second location to a second node using at least the first data and the second data,

create a plurality of virtual keyframes based at least in part upon a plurality of existing keyframes, which have been captured by the first and second virtual or augmented reality display systems, at least by performing a plurality of analyses on corresponding normals of the plurality of existing keyframes, wherein a virtual keyframe is created to provide a new position to view a plurality of existing points or features;

determine a set of shared points from a first set of points and a second set of points that are respectively identified from the first data and the second data based at least in part upon performing one or more analyses using at least one or more corresponding virtual keyframes of the plurality of virtual keyframes,

construct at least a portion of a map of a real world at least by connecting the first node for the first location and the second node for the second location with an edge that is determined based in part or in whole upon a total number of shared points in the set of shared points;

identify, at the at least one server from a storage device, detailed environment data pertaining to the first location and virtual contents from the at least one server to the second virtual or augmented reality display system based at least in part upon an anticipated position of the second virtual or augmented reality display system.

2. The augmented reality system of claim 1 , wherein the first augmented reality display system is a head-mounted augmented reality display system or a room-based sensor system, the first data comprises one or more pose tagged images corresponding to the first location, and the map is transmitted to at least one of the first and second augmented reality display systems.

3. The augmented reality display system of claim 2 , wherein a virtual object is rendered in at least the portion of the real world by at least one of the first and second augmented reality display systems based at least in part on the at least the portion of the map of the real world.

4. The augmented reality display system of claim 1 , further comprising determining the anticipated position based at least in part upon a current position and an intended direction or orientation pertaining to the second virtual or augmented reality display system, by localizing the second virtual or augmented reality display system using the at least the portion of the map, instead of using detailed parametric or geometric information about the anticipated location.

5. The augmented reality display system of claim 4 , further comprising: establishing a correspondence between the detailed environment data pertaining to a plurality of locations and a plurality of nodes comprising the first node and the second node by using the map and a world model.

6. The augmented reality display system of claim 5 , further comprising: identifying the detailed environment data from a storage device accessible by the at least one server based in part or in whole upon the correspondence and results of localizing the second virtual or augmented reality display system using the at least the portion of the map, rather than sorting through detailed data in a model representing the real world.

7. The augmented reality display system of claim 1 , wherein

the first data or the second data includes at least an image captured at the first or second location, or the first data or the second data corresponds to sensor data,

the processor extracts a set of map points from the first and second data captured from the first and second augmented reality display systems, and the set of map points is used to construct the at least the portion of the map of the real world, or

a part of the map corresponding to the first augmented reality display system is transmitted to the second augmented reality display system.

8. The augmented reality display system of claim 1 , wherein the at least one server configured to create the plurality of keyframes is further configured to:

perform a first analysis of the plurality of analyses, wherein performance of the first analysis determines a first direction relative to the plurality of existing keyframes for the plurality of virtual keyframes;

identifying a first virtual keyframe from the one or more corresponding virtual keyframes;

position the first virtual keyframe based at least in part on the first direction;

render a plurality of geometric entities from the first virtual keyframe to the plurality of existing points or features including the first set of shared points and the second set of points;

determine one or more new points based at least in part upon one or more characteristics of the geometric entities; and

add the one or more new points to the map of the real world.

9. The augmented reality display system of claim 8 , wherein the one or more characteristics of the geometric entities comprise a plurality of points of intersection of the plurality of geometric entities or a pitch pixel that corresponds to the plurality of points of intersection of the plurality of geometric entities.

10. The augmented reality display system of claim 1 , wherein the first and second data comprises pose information of the first and second augmented reality display systems, wherein the at least the portion of the map is constructed based at least in part on the pose information.

11. The augmented reality display system of claim 1 , the server further configured to:

receive the first data captured by the first virtual or augmented reality display system;

associate first parametric geometry with the first node in the map, wherein the first parametric geometry is stored separately from the map;

receive the second data captured by the second virtual or augmented reality display system; and

associate second parametric geometry with the second node in the map, wherein the second parametric geometry is stored separately from the map.

12. The augmented reality display system of claim 11 , the server further configured to:

generate a first signature for the first node using at least the first data; and

generate a second signature for the second node using at least the second data.

13. The augmented reality display system of claim 12 , the server further configured to:

receive third data from a third virtual or augmented reality display system;

generate a third signature based in part or in whole upon the third data;

identify a repository of a plurality of signatures; and

determining whether the third signature matches at least one signature in the repository.

14. The augmented reality display system of claim 13 , the server further configured to:

generate a third node and add the third node to the map when the third signature is determined not to match the at least one signature in the repository; and

identify a corresponding location associated with the at least one signature when the third signature is determined to match the at least one signature in the repository; and

determine a third location for the third virtual or augmented reality display system to be the corresponding location associated with the at least one signature when the third signature is determined to match the at least one signature in the repository.

15. The augmented reality display system of claim 12 , further comprising:

one or more first sensors of the first virtual or augmented reality display system configured to capture first additional information pertaining to one or more first real world locations of the first virtual or augmented reality display system at the first location; and

one or more sensor sensors of the second virtual or augmented reality display system configured to capture second additional information pertaining to one or more second real world locations of the second virtual or augmented reality display system at the second location.

16. The augmented reality display system of claim 15 , the server further configured to:

hashing the first additional information with the first data into first hashed data;

hashing the second additional information with the second data into second hashed data,

wherein

the first or second additional information comprises at least one of global positioning system (GPS) location information, Wi-Fi location information, received signal strength information, one or more histograms generated from one or more images captured by the first or second virtual or augmented reality system at the first or the second location, or object information of one or more objects around the first or second virtual or augmented reality display system.

17. The augmented reality display system of claim 16 , the server further configured to:

identifying a first real world location of a user at the first location using the first hashed data, without understanding or having to understand or processing all geometries associated with the one or more first real world location.

18. The augmented reality display system of claim 16 , the first virtual or augmented reality display system further configured to:

present one or more virtual objects to the user in relation to one or more real world objects at the actual real world location by using at least the map.

19. The augmented reality display system of claim 11 , the server further configured to:

identify a relation between the first node and the second node; and

represent the relation at least by generating a first edge that connects the first node and the second node in the map.

20. The augmented reality display system of claim 11 , the server further configured to:

identify a geometric map or geometric configuration of the first location;

overlaying the map on the geometric map or the geometric configuration; and

identifying loop-closure stresses in the geometric map or the geometric configuration based in part or in whole upon alignment information between the map and the geometric map or the geometric configuration.