IP Library Granted Patent US 11,210,843
Granted Patent B1
US 11,210,843 · App. 16/929,912 · Granted Dec 28, 2021

Virtual-world simulator

Inventors: Dane M. Coffey (Burbank, CA); Evan M. Goldberg (Burbank, CA); Steven M. Chapman (Newbury Park, CA); Daniel L. Baker (Los Angeles, CA); Matthew Deuel (Playa Vista, CA); Mark R. Mine (Canyon Country, CA)
Assignee: Disney Enterprises, Inc.
G06T15/20G05B19/4155G06T7/20G06T15/005G05B2219/37074G06T2207/10028G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,210,843
App. No.
16/929,912
Granted
Dec 28, 2021
Kind
B1
Abstract

In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

Claims (96)

1. A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:

a computing platform including a hardware processor and a memory storing a software code;

a tracking system communicatively coupled to the computing platform; and

a handheld device configured for use by a user in the real-world venue and communicatively coupled to the computing platform;

the hardware processor configured to execute the software code to:

obtain a map of a geometry of the real-world venue;

identify one or more virtual effects for display in the real-world venue;

track, using the tracking system, a moving perspective of one of the user in the real-world venue or a camera in the real-world venue; and

control the handheld device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

2. The virtual-world simulator of claim 1 , wherein the map is a three-dimensional (3D) map of the geometry of the real-world venue.

3. The virtual-world simulator of claim 1 , further comprising a mapping device communicatively coupled to the computing platform, wherein the hardware processor is further configured to execute the software code to generate, using the mapping device, the map of the geometry of the real-world venue.

4. The virtual-world simulator of claim 3 , wherein the mapping device comprises at least one of a mapping camera or a light detection and ranging (LIDAR) device.

5. The virtual-world simulator of claim 1 , wherein the map of the geometry of the real-world venue comprises a three-dimensional (3D) map of the geometry of the real-world venue.

6. The virtual-world simulator of claim 1 , wherein the tracked moving perspective is the moving perspective of the user in the real-world venue, and wherein the hardware processor is further configured to execute the software code to:

track a second moving perspective of a second user in the real-world venue; and

control the handheld device to further simulate the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

7. The virtual-world simulator of claim 1 , wherein the tracked moving perspective is the moving perspective of the user in the real-world venue, and wherein the hardware processor is further configured to execute the software code to:

detect a user device utilized by a second user in the real-world venue;

track a second moving perspective of the second user in the real-world venue;

generate a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user; and

transmit the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

8. The virtual-world simulator of claim 1 , wherein the tracked moving perspective is the moving perspective of the camera, and wherein the camera is configured to obtain an image of the user in the simulated virtual-world.

9. The virtual-world simulator of claim 1 , wherein the handheld device is a projection device.

10. A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a handheld device configured for use by a user in the real-world venue, the method comprising:

obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;

identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a moving perspective of one of the user in the real-world venue or a camera in the real-world venue; and

controlling, by the software code executed by the hardware processor, the handheld device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

11. The method of claim 10 , wherein the map is a three-dimensional (3D) map of the geometry of the real-world venue.

12. The method of claim 10 , wherein the virtual-world simulator further comprises a mapping device communicatively coupled to the computing platform, the method further comprising:

generating, by the software code executed by the hardware processor and using the mapping device, the map of the geometry of the real-world venue.

13. The method of claim 10 , wherein the mapping device comprises at least one of a mapping camera or a light detection and ranging (LIDAR) device.

14. The method of claim 10 , wherein the map of the geometry of the real-world venue comprises a three-dimensional (3D) map of the geometry of the real-world venue.

15. The method of claim 10 , wherein the tracked moving perspective is the moving perspective of the user in the real-world venue, the method further comprising:

tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue; and

controlling, by the software code executed by the hardware processor, the handheld device to further simulate the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

16. The method of claim 10 , wherein the tracked moving perspective is a moving perspective of the user in the real-world venue, the method further comprising:

detecting, by the software code executed by the hardware processor, a user device utilized by a second user in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of the second user in the real-world venue;

generating, by the software code executed by the hardware processor, a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the second moving perspective of the second user; and

transmitting, by the software code executed by the hardware processor, the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the present vantage point of the moving perspective of the user.

17. The method of claim 10 , wherein the tracked moving perspective is the moving perspective of the camera, and wherein the camera is configured to obtain an image of the user in the simulated virtual-world.

18. The method of claim 10 , wherein the handheld device is a projection device.

19. A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:

a computing platform including a hardware processor and a memory storing a software code;

a tracking system communicatively coupled to the computing platform; and

a projection device communicatively coupled to the computing platform;

the hardware processor configured to execute the software code to:

obtain a map of a geometry of the real-world venue;

identify one or more virtual effects for display in the real-world venue;

track, using the tracking system, a first moving perspective of a first user in the real-world venue;

track, using the tracking system, a second moving perspective of a second user in the real-world venue; and

control the projection device to concurrently simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective and a second present vantage point of the tracked second moving perspective.

20. A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:

a computing platform including a hardware processor and a memory storing a software code;

a tracking system communicatively coupled to the computing platform; and

a projection device communicatively coupled to the computing platform;

the hardware processor configured to execute the software code to:

obtain a map of a geometry of the real-world venue;

identify one or more virtual effects for display in the real-world venue;

track, using the tracking system, a first moving perspective of a first user in the real-world venue;

control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective;

detect a user device utilized by a second user in the real-world venue;

track, using the tracking system, a second moving perspective of a second user in the real-world venue;

generate a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the tracked second moving perspective; and

transmit the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the first vantage point of the tracked first moving perspective.

21. A virtual-world simulator in a real-world venue, the virtual-world simulator comprising:

a computing platform including a hardware processor and a memory storing a software code;

a tracking system communicatively coupled to the computing platform; and

a projection device communicatively coupled to the computing platform;

the hardware processor configured to execute the software code to:

obtain a map of a geometry of the real-world venue;

identify one or more virtual effects for display in the real-world venue;

track, using the tracking system, a moving perspective of a camera in the real-world venue; and

control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective, wherein the camera is configured to obtain an image of the user in the simulated virtual-world.

22. A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a projection device, the method comprising:

obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;

identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a first moving perspective of a first user in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue; and

controlling, by the software code executed by the hardware processor, the projection device to concurrently simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective and a second present vantage point of the tracked second moving perspective.

23. A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a projection device, the method comprising:

obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;

identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a first moving perspective of a first user in the real-world venue;

controlling, by the software code executed by the hardware processor, the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a first present vantage point of the tracked first moving perspective;

detecting, by the software code executed by the hardware processor, a user device utilized by a second user in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue;

generating, by the software code executed by the hardware processor, a simulation of the virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a second present vantage point of the tracked second moving perspective; and

transmitting, by the software code executed by the hardware processor, the generated simulation to the user device for display to the second user while concurrently simulating the virtual-world from the first vantage point of the tracked first moving perspective.

24. A method for use by a virtual-world simulator in a real-world venue, the virtual-world simulator including a computing platform having a hardware processor and a memory storing a software code, the computing platform communicatively coupled to a tracking system and a projection device, the method comprising:

obtaining, by the software code executed by the hardware processor, a map of a geometry of the real-world venue;

identifying, by the software code executed by the hardware processor, one or more virtual effects for display in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a moving perspective of a camera in the real-world venue;

tracking, by the software code executed by the hardware processor and using the tracking system, a second moving perspective of a second user in the real-world venue; and

controlling, by the software code executed by the hardware processor, the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective, wherein the camera is configured to obtain an image of the user in the simulated virtual-world.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2020
From: COFFEY, DANE M.; GOLDBERG, EVAN M.; CHAPMAN, STEVEN M.; BAKER, DANIEL L.; DEUEL, MATTHEW; MINE, MARK R.
To: DISNEY ENTERPRISES, INC.
Reel/Frame 053221/0212 →
Cited By (3)
US 12,430,857 US 12,465,865 US 12,678,697