IP Library Granted Patent US 12,377,872
Granted Patent B2
US 12,377,872 · App. 17/730,987 · Granted Aug 5, 2025

Location-based autonomous navigation using a virtual world system

Inventor: Cevat Yerli (Frankfurt am Main, DE)
Assignee: TMRW Group IP
B60W60/001G05B19/4155B60W2556/45G05B2219/50391
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,377,872
App. No.
17/730,987
Granted
Aug 5, 2025
Kind
B2
Abstract

A system, method, autonomous mobile robot, and computer readable media enabling location-based autonomous navigation using a virtual world system. The system comprises at least one server computing device having at least one processor and a memory. The memory stores a virtual world system and computer-readable instructions. The virtual world system comprises at least one virtual object being spatially defined by virtual three-dimensional coordinates that correspond to three-dimensional coordinates of a corresponding physical object in a physical environment. The instructions cause the at least one server computing device to provide a navigation engine configured to compute a navigation route of at least one autonomous mobile robot using at least the virtual three-dimensional coordinates of the at least one virtual object, enabling the at least one autonomous mobile robot to autonomously navigate the physical environment by reference to a virtual replica of the physical environment comprised in the virtual world system.

Claims (46)

1. A system comprising:

at least one server computing device having at least one processor and a memory that stores:

a virtual world system comprising a plurality of virtual objects being spatially defined by virtual three-dimensional coordinates that correspond to three-dimensional coordinates of corresponding physical objects in a physical environment; and

computer-readable instructions that, in response to execution by the at least one processor, cause the at least one server computing device to provide a navigation engine configured to compute a navigation route of an autonomous mobile robot using at least the virtual three-dimensional coordinates of a virtual object, enabling the autonomous mobile robot to autonomously navigate the physical environment by reference to a virtual replica of the physical environment comprised in the virtual world system;

wherein at least one of the plurality of virtual objects includes a virtual corridor that virtually couples two physical objects via a connection between two other virtual objects of the plurality of virtual objects that correspond to the two physical objects, respectively,

wherein the two physical objects comprise a sensing mechanism to enrich and synchronize the two other virtual objects based on sensed speed or acceleration data related to at least one of the two physical objects,

wherein the virtual corridor is calculated ad hoc by the navigation engine based on the sensed speed or acceleration data.

2. The system of claim 1 , wherein the navigation route is computed by the navigation engine using at least data captured by at least one sensor of the autonomous mobile robot.

3. A method comprising:

creating, in a virtual world system provided in memory of at least one server computing device, a plurality of virtual objects, wherein the plurality of virtual objects are spatially defined by virtual three-dimensional coordinates that correspond to three-dimensional coordinates of corresponding physical objects in a physical environment;

receiving, by a navigation engine stored in memory of the at least one server computing device, data defining a destination of an autonomous mobile robot; and

computing, by the navigation engine, a navigation route for the autonomous mobile robot using at least the data defining the destination and the virtual three-dimensional coordinates of a virtual object, enabling the autonomous mobile robot to autonomously navigate the physical environment by reference to a virtual replica of the physical environment comprised in the virtual world system;

wherein at least one of the plurality of virtual objects includes a virtual corridor that virtually couples two physical objects via a connection between two other virtual objects of the plurality of virtual objects that correspond to the two physical objects, respectively,

wherein the two physical objects comprise a sensing mechanism to enrich and synchronize the two other virtual objects based on sensed speed or acceleration data related to at least one of the two physical objects,

wherein the virtual corridor is calculated ad hoc by the navigation engine based on the sensed speed or acceleration data.

4. The method of claim 3 , wherein computing the navigation route includes computing the navigation route using at least data captured by at least one sensor mounted on the autonomous mobile robot.

5. An autonomous mobile robot, comprising:

a control unit comprising at least one processor and a memory;

a drive unit configured to convert signals from the control unit into a movement of the autonomous mobile robot, wherein the drive unit comprises actuators, wherein the actuators comprise electric motors, hydraulic cylinders, pneumatic cylinders, or combinations thereof;

a communication unit configured to communicatively couple the autonomous mobile robot to at least one server computing device storing a navigation engine and a virtual world system, wherein the communication unit comprises one or more transceivers, wherein the one or more transceivers comprise antennas; and

wherein the memory has instructions stored thereon that, in response to execution by the at least one processor, cause the autonomous mobile robot to perform actions comprising:

receiving a navigation route computed by the navigation engine of the at least one server computing device using at least virtual three-dimensional coordinates of a plurality of virtual objects in the virtual world system that correspond to three-dimensional coordinates of corresponding physical objects in a physical environment and navigation destination data; and

autonomously navigating the physical environment using the navigation route;

wherein at least one of the plurality of virtual objects includes a virtual corridor that virtually couples two physical objects via a connection between two other virtual objects of the plurality of virtual objects that correspond to the two physical objects, respectively,

wherein the two physical objects comprise a sensing mechanism to enrich and synchronize the two other virtual objects based on sensed speed or acceleration data related to at least one of the two physical objects,

wherein the virtual corridor is calculated ad hoc by the navigation engine based on the sensed speed or acceleration data.

6. The autonomous mobile robot of claim 5 , further comprising at least one sensor, wherein the actions further comprise:

transmitting data captured by the at least one sensor to the at least one server computing device for computing the navigation route.

7. A non-transitory computer-readable medium having computer-executable instructions stored thereon that, in response to execution by one or more processors of a server computing device, cause the server computing device to perform actions comprising:

creating, in a virtual world system provided in memory of at least one server computing device, a plurality of virtual objects, wherein the plurality of virtual objects are spatially defined by virtual three-dimensional coordinates that correspond to three-dimensional coordinates of corresponding physical objects in a physical environment;

receiving, by a navigation engine stored in memory of the at least one server computing device, data defining a destination of an autonomous mobile robot;

computing, by the navigation engine, a navigation route for the autonomous mobile robot using at least the data defining the destination and the virtual three-dimensional coordinates of a virtual object, enabling the autonomous mobile robot to autonomously navigate the physical environment by reference to a virtual replica of the physical environment comprised in the virtual world system;

wherein at least one of the plurality of virtual objects includes a virtual corridor that virtually couples two physical objects via a connection between two other virtual objects of the plurality of virtual objects that correspond to the two physical objects, respectively,

wherein the two physical objects comprise a sensing mechanism to enrich and synchronize the two other virtual objects based on sensed speed or acceleration data related to at least one of the two physical objects,

wherein the virtual corridor is calculated ad hoc by the navigation engine based on the sensed speed or acceleration data.

8. The system of claim 1 , wherein the plurality of virtual objects in the virtual world system includes a navigational virtual object representing a navigable structure of the physical environment, the navigational virtual object comprising navigation data defining one or more possible navigation paths associated with the navigable structure.

9. The system of claim 8 , wherein the navigation route is computed by the navigation engine using at least the navigation data of the navigational virtual object.

10. The system of claim 8 , wherein the navigational virtual object is transmitted to the autonomous mobile robot via a network as the autonomous mobile robot approaches the navigable structure.

11. The method of claim 3 , wherein the plurality of virtual objects in the virtual world system include a navigational virtual object representing a navigable structure of the physical environment, the navigational virtual object comprising navigation data defining one or more possible navigation paths associated with the navigable structure.

12. The method of claim 11 , wherein computing the navigation route includes computing the navigation route using at least the navigation data of the navigational virtual objects.

13. The method of claim 11 , further comprising transmitting the navigational virtual object to the autonomous mobile robot via a network as the autonomous mobile robot approaches a physical structure.

14. The autonomous mobile robot of claim 5 , wherein the plurality of virtual objects in the virtual world system includes a navigational virtual object representing a navigable structure of the physical environment, the navigational virtual object comprising navigation data defining one or more possible navigation paths associated with the navigable structure.

15. The autonomous mobile robot of claim 14 , wherein the navigation route is computed by the navigation engine using at least the navigation data of the navigational virtual object.

16. The autonomous mobile robot of claim 14 , wherein the actions further comprise receiving the navigational virtual object from the at least one server computing device as the autonomous mobile robot approaches the navigable structure.

17. The non-transitory computer-readable medium of claim 7 , wherein the plurality of virtual objects in the virtual world system includes a navigational virtual object representing a navigable structure of the physical environment, the navigational virtual object comprising navigation data defining one or more possible navigation paths associated with the navigable structure.

18. The non-transitory computer-readable medium of claim 17 , wherein the actions further comprise transmitting the navigational virtual object to the autonomous mobile robot via a network as the autonomous mobile robot approaches a physical structure.

Assignments (2)
CHANGE OF NAME Recorded Apr 18, 2025
From: TMRW FOUNDATION IP S.À R.L.
To: TMRW GROUP IP
Reel/Frame 070891/0005 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2022
From: YERLI, CEVAT
To: TMRW FOUNDATION IP S. À R.L.
Reel/Frame 059753/0194 →
Continuity (1)
Related Publication 20230347923A1 · Nov 2, 2023
References Cited (12)
US 10371544B2 · Yoo et al. · 2019 [cited by applicant]
US 20170287214A1 · Anderson · 2017 [cited by examiner]
US 20190361589A1 · Yerli · 2019 [cited by examiner]
US 20200150655A1 · Artes · 2020 [cited by examiner]
US 20200209005A1 · Hou et al. · 2020 [cited by applicant]
US 20210287459A1 · Cella et al. · 2021 [cited by applicant]
EP 3742360A1 · 2020 [cited by applicant]
EP 3754468A1 · 2020 [cited by applicant]
WO 2017172180A1 · 2017 [cited by applicant]
WO 2021189374A1 · 2021 [cited by applicant]
Whitty, M. et al., “Autonomous Navigation using a Real-Time 3D Point Cloud,” ResearchGate, Jan. 2010, 11 pages. [cited by applicant]
Evans, J.M., et al., “Three Dimensional Data Capture in Indoor Environments for Autonomous Navigation,” NIST Internal Report #6912, Sep. 2002, pp. 1-7. [cited by applicant]