IP Library Granted Patent US 11,307,968
Granted Patent B2
US 11,307,968 · App. 16/421,155 · Granted Apr 19, 2022

System and method for developing, testing and deploying digital reality applications into the real world via a virtual world

Inventor: Cevat Yerli (Frankfurt am Main, DE)
Assignee: THE CALANY Holding S. À R.L.
G06F11/3664G06F3/011G06F11/3672G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,307,968
App. No.
16/421,155
Granted
Apr 19, 2022
Kind
B2
Abstract

A system and method for developing, testing, and deploying digital reality applications into the real world via a persistent virtual world system. The system includes a server that stores and computes a persistent virtual world system comprising at least one virtual replica of a corresponding real object, an application development environment module, and an application management environment module. A user device connected to the server via a network accesses one or more of the persistent virtual world system, the application development environment module, and application management environment module. Users view and interact with the digital reality applications in a merged reality comprised of a real world layer comprising real objects, a virtual world layer configured on top of the real world layer and comprising the purely virtual objects and virtual replicas of respective real objects, and one or more digital reality application layers comprising the deployed digital reality applications.

Claims (37)

1. A system for facilitating development, testing, and deployment of digital reality applications, the system comprising:

at least one server comprising memory and at least one processor, the memory storing one or more digital reality applications and a persistent virtual world system comprising at least one virtual replica of a corresponding real object, wherein virtual 3D world coordinates and virtual properties of the at least one virtual replica are based on 3D world coordinates and properties of the corresponding real object;

wherein the persistent virtual world system is configured to allow one or more users to view and interact with the one or more digital reality applications in a merged reality comprising a real world layer, a virtual world layer configured on top of the real world layer, and one or more digital reality application layers configured on top of the virtual world layer; and

wherein the one or more digital reality applications include one or more positional digital reality applications on a predetermined 3D world location or one or more areal digital reality application services on a predetermined geographical area configured to provision an application service to a user within or in proximity to the predetermined geographical area.

2. The system of claim 1 , wherein the memory further stores an application development environment module configured to enable access to the persistent virtual world system for developing the one or more digital reality applications, and an application management environment module configured to enable access to the persistent virtual world system for receiving, managing and deploying one or more developed digital reality applications.

3. The system of claim 2 , wherein the application development environment module further comprises a testing sub-module configured to test the one or more digital reality applications in a development space, in a virtual world final positional or areal location in virtual reality through the persistent virtual world system, and in the real world final positional or areal location in augmented reality through the persistent virtual world system, and wherein the application management environment module further comprises an application management testing sub-module configured to test the one or more digital reality applications developed and test deployed via the application development environment module.

4. The system of claim 2 , wherein the application development environment module further comprises a settings sub-module configured to specify positional or areal location and space, time, and target user parameter settings of the one or more digital reality applications or one or more digital application layers with respect to the persistent virtual world system.

5. The system of claim 4 , wherein the settings sub-module is further configured to enable an adaptive characteristics configuration of the one or more digital reality applications.

6. The system of claim 4 , wherein the settings sub-module is further configured to attach the one or more positional digital reality applications to the at least one virtual replica existing in the persistent virtual world system or to one or more empty locations of the persistent virtual world system not linked to a specific virtual replica, or to attach the one or more areal digital reality application services to one or more geographic areas of the persistent virtual world system not linked to a specific virtual replica.

7. The system of claim 1 , wherein the system is configured for processing and provisioning of the one or more digital reality applications based on proximity of at least one user device to the one or more digital reality applications, and wherein the provisioning and processing are server-based, client-based, or combinations thereof.

8. The system of claim 7 , wherein the server is configured to compute and composite media content of a plurality of digital reality applications in a field of view or wide view of the one or more users and transmit the computed and composited media content to the at least one user device where the at least one user device is in proximity to the plurality of digital reality applications.

9. The system of claim 1 , wherein the one or more digital reality applications are configured to filter and process a plurality of elements of the virtual world layer that are relevant to the one or more digital reality applications.

10. A method for facilitating development, testing, and deployment of digital reality applications, the method comprising:

providing, by at least one server comprising memory and at least one processor, one or more digital reality applications and a persistent virtual world system comprising at least one virtual replica of a corresponding real object, wherein virtual 3D world coordinates and virtual properties of the at least one virtual replica are based on 3D world coordinates and properties of the corresponding real object; and

receiving, by the at least one server, input from at least one user device accessing the persistent virtual world system, wherein the at least one user device is connected to the at least one server via a network, and wherein the persistent virtual world system allows one or more users to view and interact with the one or more digital reality applications in a merged reality comprising a real world layer, a virtual world layer configured on top of the real world layer, and one or more digital reality application layers configured on top of the virtual world layer; and

wherein the one or more digital reality applications include one or more positional digital reality applications on a predetermined 3D world location or one or more areal digital reality application services on a predetermined geographical area configured to provision an application service to a user within or in proximity to the predetermined geographical area.

11. The method of claim 10 , wherein the input is related to development of the one or more digital reality applications, and wherein the development comprises setting up application configuration, testing the one or more digital reality applications in a development space, and carrying out further testing in augmented and virtual reality final locations.

12. The method of claim 10 , wherein the input is related to development of the one or more digital reality applications, and wherein the development is performed in an application development environment module stored in the memory, and wherein management of the one or more digital reality applications is performed in an application management environment module.

13. The method of claim 12 , wherein the application development environment module comprises a testing sub-module configured to test the one or more digital reality applications in a development space, in a virtual world final positional or areal location in virtual reality through the persistent virtual world system, and in the real world final positional or areal location in augmented reality through the persistent virtual world system, and wherein the application management environment module further comprises an application management testing sub-module configured to test the one or more digital reality applications developed and test deployed via the application development environment module.

14. The method of claim 12 , wherein the application development environment module comprises a settings sub-module configured to specify positional or areal location and space, time, and target user parameter settings of the one or more digital reality applications or one or more digital application layers with respect to the persistent virtual world system.

15. The method of claim 10 , wherein the settings sub-module is configured to attach the one or more positional digital reality applications to the at least one virtual replica existing in the persistent virtual world system or to one or more empty locations of the persistent virtual world system not linked to a specific virtual replica, or to attach the one or more areal digital reality application services to one or more geographic areas of the persistent virtual world system not linked to a specific virtual replica.

16. The method of claim 10 further comprising processing and provisioning the one or more digital reality applications, wherein the processing and provisioning are based on proximity of the at least one user device to the one or more digital reality applications, and wherein the provisioning and processing are server-based, client-based, or combinations thereof.

17. The method of claim 16 further comprising, where the at least one user device is in proximity to a plurality of positional digital reality applications or areal digital reality application services:

computing and compositing media content of the plurality of positional digital reality applications or areal digital reality application services in a field of view or wide view of the one or more users; and

transmitting the computed and composited media content to the at least one user device.

18. The method of claim 10 wherein the at least one server implements software tools to facilitate the following actions:

sharing the one or more digital reality applications with an application administrator;

testing, by the application administrator, the one or more digital reality applications for compliance;

approving or rejecting the one or more digital reality applications;

sending, if required, application adjustment requests to the application developer;

adjusting by the application developer, if required, the one or more digital reality application; and

deploying by the application administrator, the one or more digital reality applications into an online application library from the application management environment module.

19. One or more non-transitory computer readable-media having stored thereon instructions configured to cause a server computer system comprising memory and at least one processor to perform a method for facilitating development, testing, and deployment of digital reality applications, comprising the steps of:

providing one or more digital reality applications and a persistent virtual world system comprising at least one virtual replica of a corresponding real object, wherein virtual 3D world coordinates and virtual properties of the at least one virtual replica are based on 3D world coordinates and properties of the corresponding real object; and

receiving input from at least one user device accessing the persistent virtual world system, wherein the at least one user device is connected to the at least one server via a network, and wherein the persistent virtual world system allows one or more users to view and interact with the one or more digital reality applications in a merged reality comprising a real world layer, a virtual world layer configured on top of the real world layer, and one or more digital reality application layers configured on top of the virtual world layer; and

wherein the one or more digital reality applications include one or more positional digital reality applications on a predetermined 3D world location or one or more areal digital reality application services on a predetermined geographical area configured to provision an application service to a user within or in proximity to the predetermined geographical area.

20. The one or more non-transitory computer readable-media of claim 19 , wherein the input is related to development of the one or more digital reality applications, wherein the development is performed in an application development environment module, wherein management of the one or more digital reality applications is performed in an application management environment module, wherein the application development environment module comprises a settings sub-module, and wherein the settings sub-module is configured to attach the one or more positional digital reality applications to the at least one virtual replica existing in the persistent virtual world system or to one or more empty locations of the persistent virtual world system not linked to a specific virtual replica, or to attach the one or more areal digital reality application services to one or more geographic areas of the persistent virtual world system not linked to a specific virtual replica.

Assignments (2)
CHANGE OF NAME Recorded Jul 9, 2021
From: TMRW FOUNDATION IP & HOLDING S. À R.L.
To: THE CALANY HOLDING S. À R.L.
Reel/Frame 056805/0154 →
CHANGE OF NAME Recorded May 24, 2019
From: TMRW ENTERTAINMENT EUROPE S. À R.L.
To: TMRW FOUNDATION IP & HOLDING S. À R.L.
Reel/Frame 049287/0855 →
Continuity (2)
Provisional Application 62676072 · May 24, 2018
Related Publication 20190361797A1 · Nov 28, 2019
Cited By (16)
US 12,189,422 US 12,236,008 US 12,265,655 US 12,360,557 US 12,360,558 US 12,374,028 US 12,380,238 US 12,395,451 US 12,430,859 US 12,474,816 US 12,530,102 US 12,530,103 US 12,537,877 US 12,619,774 US 12,669,848 US 12,688,058