IP Library › Granted Patent US 12,208,056
Granted Patent B1
US 12,208,056 · App. 18/748,339 · Granted Jan 28, 2025

Feedback unit, wearable device comprising the feedback unit and methods for visual guiding the movement of a visually impaired user having moderate impairment

Inventor: Cornel-Marian Amariei (Comuna Floresti-Stoenesti, RO)
Assignee: DOTLUMEN S.R.L.
A61H3/061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,208,056
App. No.
18/748,339
Granted
Jan 28, 2025
Kind
B1
Abstract

This patent relates to a feedback unit for visual guiding the movement of a visually impaired user having moderate impairment, comprising means to receive navigation information from an environment processing unit; a processing module for processing the navigation information and outputting visual guidance instructions to the user; a visual representation module displaying the visual guidance instructions to the user, which include: visual guiding modes along the path: light guiding strip, visual cues signalling the direction, milestones visual, tunnel; and visual guiding modes in respect to a selected obstacle or point of interest: contour highlight, surface highlight, object trajectory visual mode. The patent further relates to a wearable device comprising the feedback unit and three alternative methods for visual guiding.

Claims (96)

1. A computer-implemented method comprising:

receiving, by a feedback unit of a wearable device, navigation information indicating a path through an environment or an obstacle in the environment;

selecting, by the feedback unit, (i) one or more particular visual guiding modes for generating a visual representation of the path through the environment, from among multiple visual guiding modes that generate different visual representations of paths, or (ii) one or more particular obstacle enhancement modes for generating a visual enhancement for the obstacle in the environment, from among multiple obstacle enhancement modes that generate different visual enhancements for obstacles, or (iii) the one or more particular visual guiding modes for generating the visual representation of the path through the environment and the one or more particular obstacle enhancement modes for generating the visual enhancement for the obstacle in the environment;

generating, by the feedback unit, (i) the visual representation of the path using the selected, one or more particular visual guiding modes, or (ii) the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes, or (iii) the visual representation of the path using the selected, one or more particular visual guiding modes and the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes; and

providing, by the feedback unit, the visual representation of the path or the visual enhancement for the obstacle, or the visual representation of the path and the visual enhancement for the obstacle, for output to a user of the wearable device,

wherein:

the one or more particular visual guiding modes comprise a milestones guiding mode, and

the visual representation of the path comprises a series of virtual objects in a field of view of the user that are aligned along the path.

2. The method of claim 1 , wherein:

the one or more particular visual guiding modes comprise a light strip guiding mode, and

the visual representation of the path comprises a strip of light following the path on a ground plane in a field of view of the user.

3. The method of claim 1 , wherein:

the one or more particular visual guiding modes comprise a direction-signaling visual cues guiding mode, and

the visual representation of the path comprises a single virtual object in a field of view of the user that is oriented in a direction of the path.

4. The method of claim 1 , wherein:

the one or more particular visual guiding modes comprise a tunnel visual guiding mode, and

the visual representation of the path comprises parallel lines following the path on a ground plane in a field of view of the user or virtual walls rising from the parallel lines.

5. The method of claim 1 , wherein:

the one or more particular visual guiding modes comprise two or more of a light strip guiding mode, a direction-signaling visual cues guiding mode, a milestones guiding mode, and a tunnel visual guiding mode.

6. The method of claim 1 , wherein:

the visual representation of the path is placed above the path on a vertical axis.

7. The method of claim 1 , wherein:

the visual representation appears at an adjustable visual cue distance from the user.

8. The method of claim 1 , wherein:

the visual representation is a geometric shape.

9. The method of claim 1 , wherein:

the visual representation appears to move as the user moves along the path.

10. The method of claim 1 , wherein:

the visual representation appears to stay in a same position as the user moves along the path.

11. The method of claim 1 , wherein:

the visual representation appears at a distance from the user that is based on a walking speed of the user.

12. The method of claim 1 , wherein:

the visual representation appears at a distance from the user that is based on a complexity of the environment.

13. The method of claim 1 , wherein:

a shape of the visual representation is selectable by the user.

14. The method of claim 1 , wherein:

the visual representation of the path is updated in real time as the user moves along the path.

15. The method of claim 1 , wherein the obstacle comprises a point of interest.

16. The method of claim 1 , wherein the multiple obstacle enhancement modes comprise:

a contour highlight mode that visually enhances contours of obstacles;

a surface highlight mode that visually enhances surfaces of obstacles;

an obstacle trajectory mode that visually indicates trajectories of obstacles; and

a simplified map mode that visually represents obstacles as simplified geometrical shapes.

17. A non-transitory, computer-readable medium storing instructions that, when executed by a processor, cause the processor of a wearable device to perform one or more operations comprising:

receiving navigation information indicating a path through an environment or an obstacle in the environment;

selecting (i) one or more particular visual guiding modes for generating a visual representation of the path through the environment, from among multiple visual guiding modes that generate different visual representations of paths, or (ii) one or more particular obstacle enhancement modes for generating a visual enhancement for the obstacle in the environment, from among multiple obstacle enhancement modes that generate different visual enhancements for obstacles, or (iii) the one or more particular visual guiding modes for generating the visual representation of the path through the environment and the one or more particular obstacle enhancement modes for generating the visual enhancement for the obstacle in the environment;

generating (i) the visual representation of the path using the selected, one or more particular visual guiding modes, or (ii) the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes, or (iii) the visual representation of the path using the selected, one or more particular visual guiding modes and the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes; and

providing the visual representation of the path or the visual enhancement for the obstacle, or the visual representation of the path and the visual enhancement for the obstacle, for output to a user of the wearable device,

wherein:

the one or more particular visual guiding modes comprise a milestones guiding mode, and

the visual representation of the path comprises a series of virtual objects in a field of view of the user that are aligned along the path.

18. The medium of claim 17 , wherein:

the one or more particular visual guiding modes comprises a tunnel visual guiding mode, and

the visual representation of the path comprises parallel lines following the path on a ground plane in a field of view of the user or virtual walls rising from the parallel lines.

19. A wearable device comprising:

one or more processors; and

one or more non-transitory computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving, by a feedback unit, navigation information indicating a path through an environment or an obstacle in the environment;

selecting, by the feedback unit, (i) one or more particular visual guiding modes for generating a visual representation of the path through the environment, from among multiple visual guiding modes that generate different visual representations of paths, or (ii) one or more particular obstacle enhancement modes for generating a visual enhancement for the obstacle in the environment, from among multiple obstacle enhancement modes that generate different visual enhancements for obstacles, or (iii) the one or more particular visual guiding modes for generating the visual representation of the path through the environment and the one or more particular obstacle enhancement modes for generating the visual enhancement for the obstacle in the environment;

generating, by the feedback unit, (i) the visual representation of the path using the selected, one or more particular visual guiding modes, or (ii) the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes, or (iii) the visual representation of the path using the selected, particular one or more visual guiding modes and the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes; and

providing, by the feedback unit, the visual representation of the path or the visual enhancement for the obstacle, or the visual representation of the path and the visual enhancement for the obstacle, for output to a user of the wearable device,

wherein:

the one or more particular visual guiding modes comprise a milestones guiding mode, and

the visual representation of the path comprises a series of virtual objects in a field of view of the user that are aligned along the path.

20. A computer-implemented method comprising:

receiving, by a feedback unit of a wearable device, navigation information indicating a path through an environment or an obstacle in the environment;

selecting, by the feedback unit, (i) one or more particular visual guiding modes for generating a visual representation of the path through the environment, from among multiple visual guiding modes that generate different visual representations of paths, or (ii) one or more particular obstacle enhancement modes for generating a visual enhancement for the obstacle in the environment, from among multiple obstacle enhancement modes that generate different visual enhancements for obstacles, or (iii) the one or more particular visual guiding modes for generating the visual representation of the path through the environment and the one or more particular obstacle enhancement modes for generating the visual enhancement for the obstacle in the environment;

generating, by the feedback unit, (i) the visual representation of the path using the selected, one or more particular visual guiding modes, or (ii) the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes, or (iii) the visual representation of the path using the selected, one or more particular visual guiding modes and the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes; and

providing, by the feedback unit, the visual representation of the path or the visual enhancement for the obstacle, or the visual representation of the path and the visual enhancement for the obstacle, for output to a user of the wearable device,

wherein the multiple obstacle enhancement modes comprise:

a contour highlight mode that visually enhances contours of obstacles;

a surface highlight mode that visually enhances surfaces of obstacles;

an obstacle trajectory mode that visually indicates trajectories of obstacles; and

a simplified map mode that visually represents obstacles as simplified geometrical shapes.

21. A non-transitory, computer-readable medium storing instructions that, when executed by a processor, cause the processor of a wearable device to perform one or more operations comprising:

receiving navigation information indicating a path through an environment or an obstacle in the environment;

selecting (i) one or more particular visual guiding modes for generating a visual representation of the path through the environment, from among multiple visual guiding modes that generate different visual representations of paths, or (ii) one or more particular obstacle enhancement modes for generating a visual enhancement for the obstacle in the environment, from among multiple obstacle enhancement modes that generate different visual enhancements for obstacles, or (iii) the one or more particular visual guiding modes for generating the visual representation of the path through the environment and the one or more particular obstacle enhancement modes for generating the visual enhancement for the obstacle in the environment;

generating (i) the visual representation of the path using the selected, one or more particular visual guiding modes, or (ii) the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes, or (iii) the visual representation of the path using the selected, one or more particular visual guiding modes and the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes; and

providing the visual representation of the path or the visual enhancement for the obstacle, or the visual representation of the path and the visual enhancement for the obstacle, for output to a user of the wearable device,

wherein the multiple obstacle enhancement modes comprise:

a contour highlight mode that visually enhances contours of obstacles;

a surface highlight mode that visually enhances surfaces of obstacles;

an obstacle trajectory mode that visually indicates trajectories of obstacles; and

a simplified map mode that visually represents obstacles as simplified geometrical shapes.

22. A wearable device comprising:

one or more processors; and

one or more non-transitory computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving, by a feedback unit, navigation information indicating a path through an environment or an obstacle in the environment;

selecting, by the feedback unit, (i) one or more particular visual guiding modes for generating a visual representation of the path through the environment, from among multiple visual guiding modes that generate different visual representations of paths, or (ii) one or more particular obstacle enhancement modes for generating a visual enhancement for the obstacle in the environment, from among multiple obstacle enhancement modes that generate different visual enhancements for obstacles, or (iii) the one or more particular visual guiding modes for generating the visual representation of the path through the environment and the one or more particular obstacle enhancement modes for generating the visual enhancement for the obstacle in the environment;

generating, by the feedback unit, (i) the visual representation of the path using the selected, one or more particular visual guiding modes, or (ii) the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes, or (iii) the visual representation of the path using the selected, particular one or more visual guiding modes and the visual enhancement for the obstacle using the selected, one or more particular obstacle enhancement modes; and

providing, by the feedback unit, the visual representation of the path or the visual enhancement for the obstacle, or the visual representation of the path and the visual enhancement for the obstacle, for output to a user of the wearable device,

wherein the multiple obstacle enhancement modes comprise:

a contour highlight mode that visually enhances contours of obstacles;

a surface highlight mode that visually enhances surfaces of obstacles;

an obstacle trajectory mode that visually indicates trajectories of obstacles; and

a simplified map mode that visually represents obstacles as simplified geometrical shapes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2024
From: AMARIEI, CORNEL-MARIAN
To: DOTLUMEN S.R.L.
Reel/Frame 067779/0906 →
Priority Claims (1)
EP 23188524 · Jul 28, 2023 · regional
References Cited (6)
US 10565755B2 · Thuillier et al. · 2020 [cited by applicant]
US 11525684B2 · Kozhaya et al. · 2022 [cited by applicant]
US 20180271740A1 · Lydecker · 2018 [cited by examiner]
GB 2585241 · 2021 [cited by applicant]
WO WO2008119187 · 2008 [cited by applicant]
Extended Search Report in EP Appln. No. 23188524.5, dated Jan. 29, 2024, 12 pages. [cited by applicant]