IP Library › Granted Patent US 12,502,609
Granted Patent B2
US 12,502,609 · App. 18/467,425 · Granted Dec 23, 2025

Augmented reality riding course generation

Inventors: Edmund Graves Brown (Los Angeles, CA); Benjamin Lucas (San Francisco, CA); Jonathan M. Rodriguez, II (La Habra, CA); Richard Zhuang (San Diego, CA)
Assignee: Snap Inc.
A63F13/65A63F13/213A63F13/537A63F13/5378B60K35/10B60K35/213B60K35/22B60K35/60A63F2300/8082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,502,609
App. No.
18/467,425
Granted
Dec 23, 2025
Kind
B2
Abstract

AR-enhanced gameplay includes a map of a course including a plurality of virtual objects, the map corresponding to a location in the real world and defining a track along which participants can ride on personal mobility systems such as scooters. Virtual objects are displayed in the fields of view of participants' augmented reality devices in a positions corresponding to positions in the real world on the course. Proximity of a participant or their personal mobility system with the position of a virtual object in the real world is detected, and in response to the detection of proximity, a performance characteristic of the participant's personal mobility system is modified.

Claims (62)

1 . A method, performed by one or more processors, of generating a virtual course in a real world environment, along which a user of a personal mobility device can ride, the method comprising:

receiving user input to begin generating a course;

capturing sequential location data from location components associated with the user or the personal mobility device while the user is riding the personal mobility device;

determining at least one edge of the virtual course either by comparing the captured sequential location data to known map data or by performing image processing on images captured by a head-worn device worn by the user while riding the personal mobility device;

displaying a menu comprising a plurality of available interactive virtual objects;

receiving user input to place one or more interactive virtual objects on the course while the user is riding the personal mobility device, by dragging and dropping one or more available interactive virtual objects from the menu onto the course;

receiving user input to stop generating the course;

generating the course using the captured sequential location data, the user input to place one or more interactive objects on the course, and the determined at least one edge to define a course track and a course boundary including the one or more interactive virtual objects; and

saving or forwarding the generated course based on further user input.

2 . The method of claim 1 , further comprising:

defining an augmented-reality overlay corresponding to the course track or an area outside of the course track, the augmented-reality overlay in use being displayed by the head-worn device over the real world environment to indicate the course track.

3 . The method of claim 2 , further comprising:

defining an action based on detecting departure of a subsequent personal mobility device from the course in use, wherein the action comprises pulsing the augmented-reality overlay based on detecting departure of the subsequent personal mobility device from the course in use.

4 . The method of claim 1 , further comprising:

defining an action based on detecting departure of a subsequent personal mobility device from the course in use.

5 . The method of claim 4 , wherein the action comprises reducing functioning of the subsequent personal mobility device based on detecting departure of the subsequent personal mobility device from the course in use.

6 . The method of claim 1 ,

wherein the one or more interactive virtual objects have parameters associated therewith to modify an operational characteristic of a subsequent personal mobility device in use when a location of the subsequent personal mobility device corresponds with the specific location on the course of a particular interactive virtual object.

7 . The method of claim 6 , further comprising:

defining an augmented-reality overlay corresponding to the course track or an area outside of the course track, the augmented-reality overlay in use being displayed by the head-worn device over the real world environment to indicate the course track.

8 . The method of claim 6 , further comprising:

defining an action based on detecting departure of a subsequent personal mobility device from the course in use.

9 . A computing apparatus for generating a virtual course in a real world environment, along which a user of a personal mobility device can ride, the computing apparatus comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, configure the apparatus to perform operations comprising:

receiving user input to begin generating a course;

capturing sequential location data from location components associated with the user or the personal mobility device while the user is riding the personal mobility device;

determining at least one edge of the virtual course either by comparing the captured sequential location data to known map data or by performing image processing on images captured by a head-worn device worn by the user while riding the personal mobility device;

displaying a menu comprising a plurality of available interactive virtual objects;

receiving user input to place one or more interactive virtual objects on the course while the user is riding the personal mobility device, by dragging and dropping one or more available interactive virtual objects from the menu onto the course;

receiving user input to stop generating the course;

generating the course using the captured sequential location data, the user input to place one or more interactive objects on the course, and the determined at least one edge to define a course track and a course boundary including the one or more interactive virtual objects; and

saving or forwarding the generated course based on further user input.

10 . The computing apparatus of claim 9 , wherein the operations further comprise:

defining an augmented-reality overlay corresponding to the course track or an area outside of the course track, the augmented-reality overlay in use being displayed by the head-worn device over the real world environment to indicate the course track.

11 . The computing apparatus of claim 10 , wherein the operations further comprise:

defining an action based on detecting departure of a subsequent personal mobility device from the course in use, wherein the action comprises pulsing the augmented-reality overlay based on detecting departure of the subsequent personal mobility device from the course in use.

12 . The computing apparatus of claim 9 , wherein the operations further comprise:

defining an action based on detecting departure of a subsequent personal mobility device from the course in use, wherein the action comprises reducing functioning of the subsequent personal mobility device based on detecting departure of the subsequent personal mobility device from the course in use.

13 . The computing apparatus of claim 9 , wherein

the one or more interactive virtual objects have parameters associated therewith to modify an operational characteristic of a subsequent personal mobility device in use when a location of the subsequent personal mobility device corresponds with the specific location on the course of a particular interactive virtual object.

14 . The computing apparatus of claim 13 , wherein the operations further comprise:

defining an augmented-reality overlay corresponding to the course track or an area outside of the course track, the augmented-reality overlay in use being displayed by the head-worn device over the real world environment to indicate the course track.

15 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations for generating a virtual course in a real world environment, along which a user of a personal mobility device can ride, the operations comprising:

receiving user input to begin generating a course;

capturing sequential location data from location components associated with the user or the personal mobility device while the user is riding the personal mobility device;

determining at least one edge of the virtual course either by comparing the captured sequential location data to known map data or by performing image processing on images captured by a head-worn device worn by the user while riding the personal mobility device;

displaying a menu comprising a plurality of available interactive virtual objects;

receiving user input to place one or more interactive virtual objects on the course while the user is riding the personal mobility device, by dragging and dropping one or more available interactive virtual objects from the menu onto the course;

receiving user input to stop generating the course;

generating the course using the captured sequential location data, the user input to place one or more interactive objects on the course, and the determined at least one edge to define a course track and a course boundary including the one or more interactive virtual objects; and

saving or forwarding the generated course based on further user input.

16 . The computer-readable storage medium of claim 15 , wherein the operations further comprise:

defining an augmented-reality overlay corresponding to the course track or an area outside of the course track, the augmented-reality overlay in use being displayed by the head-worn device over the real world environment to indicate the course track.

17 . The computer-readable storage medium of claim 16 , wherein the operations further comprise:

defining an action based on detecting departure of a subsequent personal mobility device from the course in use, wherein the action comprises pulsing the augmented-reality overlay based on detecting departure of the subsequent personal mobility device from the course in use.

18 . The computer-readable storage medium of claim 15 , wherein the operations further comprise:

defining an action based on detecting departure of a subsequent personal mobility device from the course in use, wherein the action comprises reducing functioning of the subsequent personal mobility device based on detecting departure of the subsequent personal mobility device from the course in use.

19 . The computer-readable storage medium of claim 15 , wherein

the one or more interactive virtual objects have parameters associated therewith to modify an operational characteristic of a subsequent personal mobility device in use when a location of the subsequent personal mobility device corresponds with the specific location on the course of a particular interactive virtual object.

20 . The computer-readable storage medium of claim 19 , wherein the operations further comprise:

defining an augmented-reality overlay corresponding to the course track or an area outside of the course track, the augmented-reality overlay in use being displayed by the head-worn device over the real world environment to indicate the course track.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2023
From: BROWN, EDMUND GRAVES; LUCAS, BENJAMIN; RODRIGUEZ, JONATHAN M., II; ZHUANG, RICHARD
To: SNAP INC.
Reel/Frame 064909/0527 →
Continuity (2)
Continuation 17453123 · Nov 1, 2021
Related Publication 20230415044A1 · Dec 28, 2023
References Cited (60)
US 5659691A · Durward et al. · 1997 [cited by applicant]
US 6200138B1 · Ando et al. · 2001 [cited by applicant]
US 9330478B2 · Anderson · 2016 [cited by examiner]
US 9566517B2 · Hardy et al. · 2017 [cited by applicant]
US 10391361B2 · Watterson · 2019 [cited by applicant]
US 10872584B2 · Jones et al. · 2020 [cited by applicant]
US 10957105B2 · Carr et al. · 2021 [cited by applicant]
US 11045736B2 · Hayashi et al. · 2021 [cited by applicant]
US 11085787B2 · Yu · 2021 [cited by examiner]
US 11103784B2 · Yabuki et al. · 2021 [cited by applicant]
US 11278810B1 · Sarria, Jr. et al. · 2022 [cited by applicant]
US 11294467B2 · Forest et al. · 2022 [cited by applicant]
US 11484783B2 · Hayashi et al. · 2022 [cited by applicant]
US 11504622B1 · Sanchez · 2022 [cited by examiner]
US 11697069B1 · Sanchez · 2023 [cited by examiner]
US 20060223637A1 · Rosenberg · 2006 [cited by applicant]
US 20090005140A1 · Rose · 2009 [cited by examiner]
US 20100222179A1 · Temple et al. · 2010 [cited by applicant]
US 20140002444A1 · Bennett et al. · 2014 [cited by applicant]
US 20140285523A1 · Gruenler · 2014 [cited by examiner]
US 20140304335A1 · Fung et al. · 2014 [cited by applicant]
US 20150323993A1 · Levesque et al. · 2015 [cited by applicant]
US 20150325052A1 · Kuehne · 2015 [cited by applicant]
US 20150356774A1 · Gal et al. · 2015 [cited by applicant]
US 20160250519A1 · Watterson · 2016 [cited by applicant]
US 20170060286A1 · Gasselin De Richebourg et al. · 2017 [cited by applicant]
US 20170287217A1 · Kim et al. · 2017 [cited by applicant]
US 20180189568A1 · Powderly et al. · 2018 [cited by applicant]
US 20180369702A1 · Hake · 2018 [cited by applicant]
US 20190049968A1 · Dean et al. · 2019 [cited by applicant]
US 20190105572A1 · Bell et al. · 2019 [cited by applicant]
US 20190337532A1 · Myers · 2019 [cited by examiner]
US 20190377345A1 · Bachrach et al. · 2019 [cited by applicant]
US 20200056892A1 · Haque et al. · 2020 [cited by applicant]
US 20200184233A1 · Berberian · 2020 [cited by examiner]
US 20200257900A1 · Dubroy · 2020 [cited by examiner]
US 20200357300A1 · Galasso et al. · 2020 [cited by applicant]
US 20210012113A1 · Petill et al. · 2021 [cited by applicant]
US 20210072817A1 · Bond et al. · 2021 [cited by applicant]
US 20210121781A1 · Benedetto · 2021 [cited by examiner]
US 20210178265A1 · Wada · 2021 [cited by examiner]
US 20210215499A1 · Kassner · 2021 [cited by examiner]
US 20210256767A1 · Velasquez · 2021 [cited by examiner]
US 20220005358A1 · Haghighat Kashani et al. · 2022 [cited by applicant]
US 20220083790A1 · Samona · 2022 [cited by examiner]
US 20220241688A1 · Brucculeri · 2022 [cited by applicant]
US 20220314120A1 · Sarria, Jr. et al. · 2022 [cited by applicant]
US 20230057816A1 · Sanchez · 2023 [cited by examiner]
US 20230098451A1 · Brown et al. · 2023 [cited by applicant]
US 20230139739A1 · Brown et al. · 2023 [cited by applicant]
DE 102019210383A1 · 2021 [cited by applicant]
FR 3079389A1 · 2019 [cited by applicant]
WO WO2023076506A1 · 2023 [cited by applicant]
Sodikart (WO 2019/185867 A1) (English translation from IP.com) (Year: 2019). [cited by examiner]
“International Application Serial No. PCT/US2022/048075, International Search Report mailed Feb. 10, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/048075, Written Opinion mailed Feb. 10, 2023”, 8 pgs. [cited by applicant]
“Mario Kart History: How Nintendo Transformed Racing”, [Online] Retrieved from the Internet: <https://www.teechu.com/how-super-mario-kart-history>, (Oct. 6, 2018), 12 pgs. [cited by applicant]
“Mario Kart Wii Wiki Guide: Power Ups”, IGN-GameGuides, [Online] Retrieved from the Internet: <https://www.ign.com/wikis/mario-kart-wii/Power_Ups>, (Aug. 23, 2020), 6 pgs. [cited by applicant]
Charnas, Ian, “Real Life Mario Kart using Microsoft HoloLens Augmented Reality”, [Online] Retrieved from the Internet: <https://www.youtube.com/watch?v=X5yNTfBnubl>, (2019), 11 pgs. [cited by applicant]
Goodwill, Joe, “How and Why to Use Strava for Cycling”, [Online] Retrieved from the Internet: <https://averagejoecyclist.com/why-cyclists-should-use-strava/>, (May 3, 2016). [cited by applicant]