IP Library Granted Patent US 11,590,423
Granted Patent B2
US 11,590,423 · App. 17/216,381 · Granted Feb 28, 2023

Multi-user route tracking in an augmented reality environment

Inventors: John Hanke (Piedmont, CA); Chihiro Kanno (Kawasaki, JP); Yuki Sonoda (Saitama, JP); Tatsuo Nomura (Tokyo, JP); Kousuke Kawahira (Tokyo, JP); Kentaro Morikawa (Tokyo, JP); Hiroki Asakawa (Tokyo, JP); Shunsuke Uematsu (Tokyo, JP); Madoka Katayama (Tokyo, JP); Motoki Yano (Kyoto, JP)
Assignee: Niantic, Inc.
A63F13/65A63F13/216A63F13/57A63F13/69A63F2300/205A63F2300/5573A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,590,423
App. No.
17/216,381
Granted
Feb 28, 2023
Kind
B2
Abstract

A system provides an augmented reality (AR) experience in a parallel-reality application in which a geography of a virtual world parallels a geography of the real world. The system receives a connection request from a client device and receives a route that the client device traversed in the real world. The route comprises a plurality of locations in the real world. The system determines a plurality of virtual locations to place virtual elements at, where each virtual element corresponds to a location in the real world of the route. The system updates a global state of the AR experience to include the plurality of virtual elements at the plurality of virtual locations. The system provides, to a second client device, AR data including some of the virtual locations for display of some of the virtual elements at the corresponding locations in the real world.

Claims (47)

1. A method for providing an augmented reality (AR) experience in a parallel-reality application in which a geography of a virtual world parallels a geography of at least a portion of a real world, the method comprising: receiving a connection request from a client device;

receiving a route that the client device traversed in the real world, the route comprising a plurality of locations in the real world;

determining a plurality of virtual locations at which to place virtual elements, each virtual location corresponding to one of the locations in the real world of the route;

updating a global state of the AR experience to include the plurality of virtual elements at the plurality of virtual locations; and

providing, to a second client device, AR data that causes the second client device to display at least some of the virtual elements at at least some of the virtual locations corresponding to at least some of the locations in the real world.

2. The method of claim 1 , wherein each of the plurality of virtual elements are included in the global state at the virtual location in real-time responsive to receiving an indication from the client device that the client device is located at the location in the real world corresponding to the virtual location of the route.

3. The method of claim 1 , wherein each of the plurality of locations in the real world is represented by global positioning system coordinates.

4. The method of claim 1 , wherein providing the AR data to the second client device comprises:

receiving a current location of the second client device; and

subsequent to determining that the second client device is within a threshold distance of the route, providing, to the second client device, the AR data for display.

5. The method of claim 1 , further comprising:

determining a type of virtual element associated with a user of the client device, wherein each of the plurality of virtual elements are of the type associated with the user.

6. The method of claim 1 , wherein the plurality of virtual elements are of a first type, the method further comprising:

determining that one or more of the plurality of virtual elements are within a threshold distance of one or more of a second plurality of virtual elements mapped to virtual locations corresponding to a second route in the real world, the second route traversed by the second client device or a third client device, wherein the second plurality of virtual elements is of a second type; and

generating a third plurality of virtual elements of a third type, wherein the third type is selected from a plurality of possible types based on the first type and the second type.

7. The method of claim 1 , further comprising: subsequent to determining that the second client device or a third client device is within a threshold distance of one or more of the plurality of virtual elements, changing a property of the one or more of the plurality of virtual elements.

8. The method of claim 7 , wherein the virtual elements are representations of flowers and the change in property is an increase in a growth speed of the representation of the flowers.

9. The method of claim 1 , further comprising: providing, to the client device, second AR data for the AR experience, the second AR data representing the virtual world.

10. A non-transitory computer-readable storage medium comprising instructions for providing an augmented reality (AR) experience in a parallel-reality application in which a geography of a virtual world parallels a geography of at least a portion of a real world, the instructions executable by a computing system and comprising:

instructions for receiving a connection request from a client device;

instructions for receiving a route that the client device traversed in the real world, the route comprising a plurality of locations in the real world;

instructions for determining a plurality of virtual locations at which to place virtual elements, each virtual location corresponding to one of the locations in the real world of the route;

instructions for updating a global state of the AR experience to include the plurality of virtual elements at the plurality of virtual locations; and

instructions for providing, to a second client device, AR data that causes the second client device to display at least some of the virtual elements at at least some of the virtual locations corresponding to at least some of the locations in the real world.

11. The non-transitory computer-readable storage medium of claim 10 , wherein each of the plurality of virtual elements are included in the global state at the virtual location in real-time responsive to receiving an indication from the client device that the client device is located at the location in the real world corresponding to the virtual location of the route.

12. The non-transitory computer-readable storage medium of claim 10 , wherein each of the plurality of locations in the real world is represented by global positioning system coordinates.

13. The non-transitory computer-readable storage medium of claim 10 , wherein the instructions for providing the AR data to the second client device comprise:

instructions for receiving a current location of the second client device; and

instructions for providing, to the second client device and subsequent to determining that the second client device being within a threshold distance of the route, the AR data for display.

14. The non-transitory computer-readable storage medium of claim 10 , the instructions further comprising:

instructions for determining a type of virtual element associated with a user of the client device, wherein each of the plurality of virtual elements are of the type associated with the user.

15. The non-transitory computer-readable storage medium of claim 10 , wherein the plurality of virtual elements are of a first type, the instructions further comprising:

instructions for determining that one or more of the plurality of virtual elements are within a threshold distance of one or more of a second plurality of virtual elements mapped to virtual locations corresponding to a second route in the real world, the second route traversed by the second client device or a third client device, wherein the second plurality of virtual elements is of a second type; and

instructions for generating a third plurality of virtual elements of a third type, wherein the third type is selected from a plurality of possible types based on the first type and the second type.

16. The non-transitory computer-readable storage medium of claim 10 , the instructions further comprising:

instructions for changing, subsequent to determining that the second client device or a third client device is within a threshold distance of one or more of the plurality of virtual elements, a property of the one or more of the plurality of virtual elements.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the virtual elements are representations of flowers and the change in property is an increase in a growth speed of the representation of the flowers.

18. The non-transitory computer-readable storage medium of claim 10 , the instructions further comprising:

instructions for providing, to the client device, second AR data for the AR experience, the second AR data representing a virtual world.

19. A computer system comprising:

a computer processor; and

a non-transitory computer-readable storage medium storing instructions for providing an augmented reality (AR) experience in a parallel-reality application in which a geography of a virtual world parallels a geography of at least a portion of a real world, the instructions that when executed by the computer processor cause the computer processor to perform actions comprising:

receiving a connection request from a client device;

receiving a route that the client device traversed in the real world, the route comprising a plurality of locations in the real world;

determining a plurality of virtual locations at which to place virtual elements, each virtual location corresponding to one of the locations in the real world of the route; updating a global state of the AR experience to include the plurality of virtual elements at the plurality of virtual locations; and

providing, to a second client device, AR data that causes the second client device to display at least some of the virtual elements at at least some of the virtual locations corresponding to at least some of the locations in the real world.

20. The computer system of claim 19 , wherein each of the plurality of virtual elements are included in the global state at the virtual location in real-time responsive to receiving an indication from the client device that the client device is located at the location in the real world corresponding to the virtual location of the route.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2025
From: NIANTIC, INC.
To: NIANTIC SPATIAL, INC.
Reel/Frame 071555/0833 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: HANKE, JOHN
To: NIANTIC, INC.
Reel/Frame 060334/0312 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: YANO, MOTOKI
To: NIANTIC INTERNATIONAL TECHNOLOGY LIMITED; NIANTIC, INC.
Reel/Frame 060334/0330 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: KANNO, CHIHIRO; SONODA, YUKI; NOMURA, TATSUO; KAWAHIRA, KOUSUKE; MORIKAWA, KENTARO; ASAKAWA, HIROKI; UEMATSU, SHUNSUKE; KATAYAMA, MADOKA
To: NIANTIC INTERNATIONAL TECHNOLOGY LIMITED
Reel/Frame 060334/0443 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2022
From: NIANTIC INTERNATIONAL TECHNOLOGY LIMITED
To: NIANTIC, INC.
Reel/Frame 060326/0333 →
Continuity (1)
Related Publication 20220305388A1 · Sep 29, 2022