IP Library › Granted Patent US 12,051,157
Granted Patent B2
US 12,051,157 · App. 17/985,019 · Granted Jul 30, 2024

Meta-binding spatial publishing platform

Inventors: Trevor Stout (Los Altos, CA); Oliver Wagner (Albuquerque, NM)
Assignee: Yap Studios, LLC
G06T17/20G06F3/011G06T15/10G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,051,157
App. No.
17/985,019
Filed
Nov 10, 2022
Granted
Jul 30, 2024
Kind
B2
Art Unit
2625
USPC
345/156
Abstract

The present technology pertains to systems and methods for creating and mapping three-dimensional spaces to provide an interactive experience with physical spaces and objects. Preferred embodiments of the method include generating a geometric layout by scanning a physical space; overlaying the geometric layout onto a virtual three-dimensional map of the physical space, the three-dimensional map supported by a content management system; defining an anchor in the three-dimensional map; associating a content with the anchor; receiving, from a device in within the physical space, the device's physical location and orientation; determining, by the content management system, a device location within the three-dimensional map; and outputting to the device, when the device is near and orientated with the anchor, the content associated with the anchor or an indication of the content associated with the anchor.

Claims (65)

1. A system for creating and using a 3D virtual space based on physical locations and objects to facilitate virtual interactive experiences, the system comprising:

a content management system, the content management system supporting a three-dimensional map of a physical space;

an operator scanning device, the operator scanning device configured to scan the physical space;

a processor and a memory communicatively coupled to the processor, the memory storing instructions which when executed by the processor perform a method, the method comprising:

overlaying a geometric layout onto the three-dimensional map of the physical space, the geometric layout being generated by the operator scanning device scanning a physical space;

defining an anchor and at least one user-customizable anchor border in the three-dimensional map;

associating a content with the anchor;

receiving, from a user device within the physical space, the user device's physical location and orientation;

determining the user device's location within the three-dimensional map; and

outputting to the user device, the anchor, the at least one user-customizable anchor border, and the content associated with the anchor when the user device is near and orientated with the anchor.

2. The system of claim 1 , the instructions further comprising differentiating between planes and objects in the scanning of the physical space, the objects being identified using point cloud data analysis.

3. The system of claim 2 , the point cloud data analysis including geometric mesh detection.

4. The system of claim 1 , further comprising the operator scanning device using optical scanning, laser pulse-based scanning, laser triangulation, photogrammetry, structured light scanning, or any combination thereof.

5. The system of claim 1 , wherein the orienting is determined using a directional heading of the geometric layout with a directional heading of the three-dimensional map.

6. The system of claim 5 , further comprising:

receiving from a user, a reference locus at an intersection of three planes, the reference locus being used for aligning the directional heading of the geometric layout with the directional heading of the three-dimensional map.

7. The system of claim 6 , wherein the three planes comprise two wall planes and a floor plane.

8. The system of claim 1 , wherein the anchor is comprised of at least one point, line, plane, two-dimensional shape, or three-dimensional shape in the three-dimensional map, or any combination thereof.

9. The system of claim 1 , wherein the user device is a smartphone, computing device, tablet, smart glasses, or augmented reality/virtual reality headset.

10. The system of claim 1 , further comprising the user device's physical location being determined by a Global Positioning System application, ultra-wide band, Wi-Fi systems, magnetometer position tracking, or Real-Time Location services, or any combination thereof.

11. The system of claim 1 , further comprising:

providing at least one user-selectable user-interface element for activating displaying of the anchor, the at least one user-customizable anchor border, and the content or an indication of the content associated with the anchor.

12. The system of claim 1 , wherein the three-dimensional map is a received Computer Aided Design drawing.

13. A method for creating a 3D virtual space based on physical locations and objects to facilitate virtual interactive experiences, the method comprising:

generating a geometric layout by scanning a physical space;

overlaying the geometric layout onto a three-dimensional map of the physical space, the three-dimensional map being supported by a content management system;

defining an anchor and at least one user-customizable anchor border in the three-dimensional map;

associating a content with the anchor;

receiving, from a device within the physical space, the device's physical location and orientation;

determining, by the content management system, a device location within the three-dimensional map; and

outputting to the device, the anchor, the at least one user-customizable anchor border, and the content associated with the anchor when the device is near and orientated with the anchor.

14. The method of claim 13 , further comprising differentiating between planes and objects in the scanning of the physical space, the objects being identified using point cloud data analysis.

15. The method of claim 14 , the point cloud data analysis including geometric mesh detection.

16. The method of claim 13 , further comprising the orienting being determined using a directional heading of the geometric layout with a directional heading of the three-dimensional map.

17. The method of claim 13 , wherein the anchor is comprised of at least one point, line, plane, two-dimensional shape, or three-dimensional shape in the three-dimensional map, or any combination thereof.

18. The method of claim 13 , wherein the device is a smartphone, computing device, tablet, smart glasses, or augmented reality/virtual reality headset.

19. The method of claim 13 , wherein the device's physical location is determined by a Global Positioning System application, ultra-wide band, Wi-Fi systems, magnetometer position tracking, or Real-Time Location services, or any combination thereof.

20. The method of claim 13 , wherein the content includes hyperlinks, media, or product or object information, or any combination thereof.

21. The method of claim 13 , further comprising:

providing at least one user-selectable user-interface element for activating displaying of the anchor, the at least one user-customizable anchor border, and the content or an indication of the content associated with the anchor.

22. The method of claim 13 , wherein the three-dimensional map is a received Computer Aided Design drawing.

23. A method for using a 3D virtual space based on physical locations and objects to facilitate virtual interactive experiences, the method comprising:

entering a physical space, the physical space having a virtual space counterpart stored in a content management system;

viewing, by a user device, a physical object at a location in the physical space, the location having a virtual location counterpart in the virtual space counterpart, the physical object having an anchor and at least one user-customizable anchor border at or near the virtual location counterpart;

scanning the physical object by way of the user device;

transmitting results from the scanning to the content management system, the results being linked to the anchor; and

retrieving, from the content management system, a content associated with the physical object.

24. The method of claim 23 , further comprising the virtual space counterpart being created by an operator of the physical space by the method comprising:

generating a geometric layout by scanning a physical space;

overlaying the geometric layout onto a virtual three-dimensional map of the physical space, the three-dimensional map supported by the content management system;

defining the anchor in the three-dimensional map;

associating a content with the anchor;

receiving, from a device in within the physical space, the device's physical location and orientation;

determining, by the content management system, a device location within the three-dimensional map; and

outputting to the device, when the device is near and orientated with the anchor, the content associated with the anchor or an indication of the content associated with the anchor.

25. The method of claim 24 , further comprising the orienting being determined using a directional heading of the geometric layout with a directional heading of the three-dimensional map.

26. The method of claim 24 , wherein the device's physical location is determined by a Global Positioning System application, ultra-wide band, Wi-Fi systems, magnetometer position tracking, or Real-Time Location services, or any combination thereof.

27. The method of claim 24 , wherein the virtual three-dimensional map is a received Computer Aided Design drawing.

28. The method of claim 23 , wherein the user device is a smartphone, computing device, tablet, smart glasses, or augmented reality/virtual reality headset.

29. The method of claim 23 , wherein the content includes hyperlinks, media, or product or object information, or any combination thereof.

30. The method of claim 23 , further comprising:

taking a snapshot of the physical object; and

accessing or viewing the content associated with the physical object within the snapshot.

31. The method of claim 23 , further comprising:

providing at least one user-selectable user-interface element for activating displaying of the anchor, the at least one user-customizable anchor border, and the content or an indication of the content associated with the anchor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2022
From: STOUT, TREVOR; WAGNER, OLIVER
To: YAP STUDIOS, LLC
Reel/Frame 061725/0635 →
Continuity (2)
Provisional Application 63281020 · Nov 18, 2021
Related Publication 20230154110A1 · May 18, 2023