AR-based guidance for a user of a personal mobility system

1 . A method, performed by one or more processors, of providing guidance using a head-worn device including a camera and one or more display devices, the method comprising:

capturing images using the camera of the head-worn device;

identifying an area, represented in the captured images, having a certain characteristic associated therewith, in real time and by performing object detection and recognition techniques on the captured images;

overlaying an augmented reality (AR) effect on the area;

displaying the captured images with the overlaid AR effect on the one or more displays of the head-worn device;

detecting movement of the head-worn device into or out of the area;

based on detecting movement of the head-worn device into or out of the area, altering functioning of an associated personal mobility system carrying a user of the head-worn device; and

dynamically and in real time, altering one or more visual characteristics of the overlaid AR effect, including at least one of color, opacity, or flashing, upon detection of the head-worn device moving into or out of the area.

2 . The method of claim 1 , wherein overlaying an AR effect on the area comprises providing an AR overlay on a forbidden area.

3 . The method of claim 2 , further comprising:

detecting movement of the head-worn device into the forbidden area; and

altering one or more visual characteristics of the overlaid AR effect to indicate movement of the head-worn device into the forbidden area.

4 . The method of claim 2 , further comprising:

based on detecting movement of the head-worn device into the forbidden area, reducing functioning of the associated personal mobility system carrying the user of the head-worn device.

5 . The method of claim 1 , wherein overlaying an AR effect on the area comprises providing an AR overlay on a hazardous area.

6 . The method of claim 5 , further comprising:

detecting movement of the head-worn device out of the hazardous area; and

altering one or more visual characteristics of the overlaid AR effect to indicate movement of the head-worn device out of the hazardous area.

7 . The method of claim 5 , further comprising:

based on detecting movement of the head-worn device out of the hazardous area, reducing functioning of the associated personal mobility system carrying the user of the head-worn device.

8 . The method of claim 1 , wherein altering the functioning of the personal mobility system comprises providing full functioning of the personal mobility system.

9 . The method of claim 1 , wherein altering the functioning of the personal mobility system comprises providing reduced functioning of the personal mobility system.

10 . The method of claim 1 , wherein the area comprises a pathway within which travel is permitted, and wherein detecting movement of the head-worn device into or out of the area comprises detecting movement of the head-worn device into or out of the pathway within which travel is permitted.

11 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations for providing guidance using a head-worn device including a camera and one or more display devices, the operations comprising:

capturing images using the camera of the head-worn device;

identifying an area, represented in the captured images, having a certain characteristic associated therewith, in real time and by performing object detection and recognition techniques on the captured images;

overlaying an augmented reality (AR) effect on the area;

displaying the captured images with the overlaid AR effect on the one or more displays of the head-worn device;

detecting movement of the head-worn device into or out of the area;

based on detecting movement of the head-worn device into or out of the area, altering functioning of an associated personal mobility system carrying a user of the head-worn device; and

dynamically and in real time, altering one or more visual characteristics of the overlaid AR effect, including at least one of color, opacity, or flashing, upon detection of the head-worn device moving into or out of the area.

12 . The computer-readable storage medium of claim 11 , wherein altering the functioning of the personal mobility system comprises providing full functioning of the personal mobility system.

13 . The computer-readable storage medium of claim 11 , wherein the operations further comprise:

altering the functioning of the personal mobility system comprises providing reduced functioning of the personal mobility system.

14 . The computer-readable storage medium of claim 11 , wherein the area comprises a pathway within which travel is permitted, and wherein detecting movement of the head-worn device into or out of the area comprises detecting movement of the head-worn device into or out of the pathway within which travel is permitted.

15 . A computing system comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the computing system to perform operations for providing guidance using a head-worn device including a camera and one or more display devices, the operations comprising:

capturing images using the camera of the head-worn device;

identifying an area, represented in the captured images, having a certain characteristic associated therewith, in real time and by performing object detection and recognition techniques on the captured images;

overlaying an augmented reality (AR) effect on the area;

displaying the captured images with the overlaid AR effect on the one or more displays of the head-worn device;

detecting movement of the head-worn device into or out of the area;

based on detecting movement of the head-worn device into or out of the area, altering functioning of an associated personal mobility system carrying a user of the head-worn device; and

dynamically and in real time, altering one or more visual characteristics of the overlaid AR effect, including at least one of color, opacity, or flashing, upon detection of the head-worn device moving into or out of the area.

16 . The computing system of claim 15 , wherein altering the functioning of the personal mobility system comprises providing full functioning of the personal mobility system.

17 . The computing system of claim 15 , wherein the area comprises a pathway within which travel is permitted, and wherein detecting movement of the head-worn device into or out of the area comprises detecting movement of the head-worn device into or out of the pathway within which travel is permitted.

18 . The computing system of claim 15 , wherein altering the functioning of the personal mobility system comprises providing reduced functioning of the personal mobility system.

19 . The computing system of claim 15 , wherein overlaying an AR effect on the area comprises providing an AR overlay on a hazardous area.

20 . The computing system of claim 15 , wherein overlaying an AR effect on the area comprises providing an AR overlay on a forbidden area.