IP Library › Granted Patent US 10,795,446
Granted Patent B2
US 10,795,446 · App. 16/355,333 · Granted Oct 6, 2020

Portable electronic haptic vision device

Inventors: Johannes Väänänen (Tallinn, EE); Mika Pukari (Oulu, FI)
Assignee: Seventh Sense OÜ
G06F3/016G06K9/3241G06T7/73H04N5/23296G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,795,446
App. No.
16/355,333
Granted
Oct 6, 2020
Kind
B2
Abstract

The invention provides a portable electronic haptic vision device configured to be attached to or worn by a user. The portable electronic haptic vision device is arranged to provide haptic feedback with pressurized air on skin of the user based upon detected objects in the surroundings of the user. The information about the detected objects in the surroundings is captured with a digital camera, radar and/or sonar device, and/or a 3-D capture device such as a 3-D scanner or 3-D camera attached to the portable electronic haptic vision device. The portable electronic haptic vision device is realised as a helmet with at least two cameras placed in the position of the eyes of the user, or as a t-shirt or other wearable.

Claims (46)

1. A portable electronic haptic vision device, configured to be at least one of attached to or worn by a user, and arranged to provide haptic feedback with pressurized air on skin of the user based upon detected objects in the surroundings of the user,

wherein information about the detected objects in the surroundings is captured using at least one of a digital camera, a 3-D capturing device, a 3-D scanner, a radar, or a sonar device coupled to the portable electronic haptic vision device,

wherein the information about the detected objects in the surroundings is recorded as at least one of video or a 3D point cloud,

wherein the information about the detected objects in the surroundings relates to spatial surroundings around the user and is captured with a 360 degree field of view from the portable electronic haptic vision device, and

wherein the portable electronic haptic vision device is configured to:

track an eye of the user and perform an eye-track action comprising at least one of: (i) zooming a camera in or out, (ii) photographing surroundings, or (iii) videoing surroundings, based upon the eye tracking of the user, and

draw a symbol on the skin of the user using pressurized air, wherein the symbol is based upon at least one of an image, a video, or a 3-D point cloud relating to the eye-track action, and wherein the symbol relates to at least one of: (i) a route, (ii) a pedestrian walkway, (iii) a street, (iv) stairs, (v) a corridor, (vi) furniture, (vii) a wall, (viii) an obstacle, (ix) an impression or expression from another person's face, or (x) a video signal obtained from a screen.

2. A portable electronic haptic vision device, as claimed in claim 1 , wherein information about the detected objects in the surroundings are captured within the field of view of the user, creating a sense-based vision.

3. A portable electronic haptic vision device, as claimed in claim 1 , wherein the portable electronic haptic vision device comprises at least one of the following: a helmet, a shirt, a belt or another wearable.

4. A portable electronic haptic vision device, as claimed in claim 1 , wherein the portable electronic haptic vision device comprises a light to illuminate surroundings of the user.

5. A portable electronic haptic vision device, as claimed in claim 4 , wherein the light comprises at least one of an LED, a narrow emission band LED, an infrared light, a flash, or another low power light.

6. A portable electronic haptic vision device, as claimed in claim 1 , wherein the user is at least one of blind or a gaming user playing a virtual reality game.

7. A portable electronic haptic vision device, as claimed in claim 1 , wherein the pressurized air is configured to be directed to the skin of the user via at least one of a: (i) nozzle, (ii) straw, (iii) pipe or (iv) funnel.

8. A portable electronic haptic vision device, as claimed in claim 1 , wherein the portable electronic haptic vision device is connected to another peripheral device on the same user providing haptic feedback.

9. A software program product for a portable electronic haptic vision device, configured to be at least one of attached to or worn by a user, and arranged to provide haptic feedback with pressurized air on skin of the user based upon detected objects in the surroundings of the user, the software program product comprising a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation, the operation comprising:

capturing information about the detected objects in the surroundings using at least one of a digital camera, a 3-D capturing device, a 3-D scanner, a radar, or a sonar device coupled to the portable electronic haptic vision device;

recording the information about the detected objects in the as at least one of video or a 3D point cloud, wherein the information about the detected objects in the surroundings relates to spatial surroundings around the user and is captured with a 360 degree field of view from the portable electronic haptic vision device;

tracking an eye of the user and performing an eye-track action comprising at least one of: (i) zooming a camera in or out, (ii) photographing surroundings, or (iii) videoing surroundings, based upon the eye tracking of the user; and

drawing a symbol on the skin of the user using pressurized air, wherein the symbol is based upon at least one of an image, a video, or a 3-D point cloud relating to the eye-track action, and wherein the symbol relates to at least one of: (i) a route, (ii) a pedestrian walkway, (iii) a street, (iv) stairs, (v) a corridor, (vi) furniture, (vii) a wall, (viii) an obstacle, (ix) an impression or expression from another person's face, or (x) a video signal obtained from a screen.

10. A software program product as claimed in claim 9 , wherein the symbol is drawn on the skin of the user using at least one nozzle to spray the pressurized air, at least one pump, and a valve controller.

11. A software program product as claimed in claim 9 , wherein information about the detected objects in the surroundings is captured within a field of view of the user, creating a sense based vision.

12. A software program product as claimed in claim 9 , wherein portable electronic haptic vision device comprises at least one of the following: a helmet, a shirt, a belt, or another wearable.

13. A software program product as claimed in claim 9 , wherein the portable electronic haptic vision device comprises a light to illuminate surroundings of the user.

14. A software program product as claimed in claim 13 , wherein the light comprises at least one of an LED, a narrow emission band LED, an infrared light, a flash, or another low power light.

15. A software program product as claimed in claim 9 , wherein the user is at least one of blind or a gaming user playing a virtual reality game.

16. A software program product as claimed in claim 9 , wherein the pressurized air is configured to be directed to the skin of the user via at least one of a: (i) nozzle, (ii) straw, (iii) pipe or (iv) funnel.

17. A software program product as claimed in claim 9 , wherein the portable electronic haptic vision device is connected to another peripheral device on the same user providing haptic feedback.

18. A method for operating a portable electronic haptic vision device, configured to be at least one of attached to or worn by a user, and arranged to provide haptic feedback with pressurized air on skin of the user based upon detected objects in the surroundings of the user, the method comprising:

capturing information about the detected objects in the surroundings using at least one of a digital camera, a 3-D capturing device, a 3-D scanner, a radar, or a sonar device coupled to the portable electronic haptic vision device;

recording the information about the detected objects in the surroundings as at least one of video or a 3D point cloud, wherein the information about the detected objects in the surroundings relates to spatial surroundings around the user and is captured with a 360 degree field of view from the portable electronic haptic vision device;

tracking an eye of the user and performing an eye-track action comprising at least one of: (i) zooming a camera in or out, (ii) photographing surroundings, or (iii) videoing surroundings, based upon the eye tracking of the user; and

drawing a symbol on the skin of the user using pressurized air, wherein the symbol is based upon at least one of an image, a video, or a 3-D point cloud relating to the eye-track action, and wherein the symbol relates to at least one of: (i) a route, (ii) a pedestrian walkway, (iii) a street, (iv) stairs, (v) a corridor, (vi) furniture, (vii) a wall, (viii) an obstacle, (ix) an impression or expression from another person's face, or (x) a video signal obtained from a screen.

19. A method as claimed in claim 18 , wherein the symbol is drawn on the skin of the user using at least one nozzle to spray the pressurized air, at least one pump, and a valve controller at least one pump and valve controller.

20. A method as claimed in claim 18 , wherein capturing information about the detected objects in the surroundings within the field of view of the user, creates a sense based vision for the user.

21. A method as claimed in claim 18 , wherein the portable electronic haptic vision device comprises at least one of the following: a helmet, a shirt, a belt, or another wearable.

22. A method as claimed in claim 18 , wherein the portable electronic haptic vision device comprises a light to illuminate surroundings of the user.

23. A method as claimed in claim 22 , wherein the light comprises at least one of an LED, a narrow emission band LED, an infrared light, a flash, or another low power light.

24. A method as claimed in claim 18 , wherein the user is at least one of blind or a gaming user playing a virtual reality game.

25. A method as claimed in claim 18 , wherein the pressurized air is configured to be directed to the skin of the user via at least one of a: (i) nozzle, (ii) straw, (iii) pipe or (iv) funnel.

26. A method as claimed in claim 18 , wherein the portable electronic haptic vision device is connected to another peripheral device on the same user providing haptic feedback.

27. The portable electronic haptic vision device of claim 3 , wherein the portable electronic haptic vision device comprises a helmet with at least two cameras place in front the position of the eyes of the user.

28. The portable electronic haptic vision device of claim 8 , wherein the other peripheral device on the same user provides haptic feedback using pressurized air.

29. The software program product of claim 12 , wherein the portable electronic haptic vision device comprises a helmet with at least two cameras place in front the position of the eyes of the user.

30. The software program product of claim 17 , wherein the other peripheral device on the same user provides haptic feedback using pressurized air.

31. The method of claim 22 , wherein the portable electronic haptic vision device comprises a helmet with at least two cameras place in front the position of the eyes of the user.

32. The method of claim 26 , wherein the other peripheral device on the same user provides haptic feedback using pressurized air.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2019
From: VÄÄNÄNEN, JOHANNES; PUKARI, MIKA
To: SEVENTH SENSE OÜ
Reel/Frame 048615/0956 →
Continuity (2)
Provisional Application 62662616 · Apr 25, 2018
Related Publication 20190332175A1 · Oct 31, 2019