IP Library › Granted Patent US 11,215,846
Granted Patent B1
US 11,215,846 · App. 16/998,089 · Granted Jan 4, 2022

Wearable proximity sensing array for the visually impaired

Inventors: Stephen Pomes (Santa Monica, CA); Yu Jiang Tham (San Diego, CA)
Assignee: Snap Inc.
G02C11/04G08B7/06G06F3/012G06F3/013H04N13/239
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,215,846
App. No.
16/998,089
Filed
Aug 20, 2020
Granted
Jan 4, 2022
Kind
B1
Art Unit
2689
USPC
340/691.5
Abstract

Eyewear having a light array and vibration sensors for indicating to a user the direction and distance of an object relative to the eyewear to help a user understand and avoid objects. To compensate for partial blindness, the front portion of the eyewear frame may include the light array, where one or more lights of the light array is illuminated to indicate a corresponding direction of a proximate object. The relative brightness of the one or more lights indicates how close the object is, where brighter light(s) indicates a close object. To compensate for more severe partial blindness or complete blindness, the eyewear has haptics, such as a plurality of vibration devices on the front portion of the eyewear, such as in the bridge, which selectively vibrate to indicate a direction of the object. The stronger the vibration, the closer the object.

Claims (37)

1. Eyewear, comprising:

a frame having a first side, a second side and a center;

a first temple adjacent the first side of the frame;

an optical element supported by the frame;

a sensor supported by the frame;

lights forming a portion of the frame; and

an electronic processor configured to:

process signals received from the sensor to determine direction and distance of an object relative to the sensor;

generate an indicator discernable by a user of the eyewear that is indicative of the direction and distance of the object relative to the sensor;

illuminate at least one of the lights as the indicator; and

wherein the lights comprise an array of lights at the first side of the frame, wherein the processor is configured to selectively illuminate a first said light that is indicative of the object being left of the frame center a predetermined first angle, and to illuminate a second said light that is indicative of the object being left of the frame center a second predetermined angle that is greater than the first angle.

2. The eyewear of claim 1 , wherein the lights comprise at least one left light positioned on the frame first side and at least one right light positioned on the frame second side.

3. The eyewear of claim 2 , wherein the lights comprise an array of lights that extend from the first side of the frame to the second side of the frame.

4. The eyewear of claim 3 , wherein the processor is configured to illuminate one light of the array of lights that corresponds to a direction of the object relative to the sensor.

5. The eyewear of claim 3 , wherein the processor is configured to illuminate one light of the array of lights at a brightness that corresponds to a distance of the object relative to the sensor.

6. The eyewear of claim 3 , wherein the lights are positioned on a bridge of the frame extending between the frame first side and the frame second side.

7. The eyewear of claim 1 , further comprising vibration devices, wherein the processor is configured to selectively enable one of the vibration devices as the indicator.

8. The eyewear of claim 7 , wherein the vibration devices comprise at least one left vibration device positioned by the frame first side and at least one right vibration device positioned by the frame second side.

9. The eyewear of claim 8 , wherein the vibration devices comprise an array of vibration devices that extend from the first side of the frame to the second side of the frame.

10. The eyewear of claim 9 , wherein the processor is configured to enable one vibration device of the array of vibration devices that corresponds to a direction of the object relative to the sensor.

11. The eyewear of claim 9 , wherein the processor is configured to enable one vibration device of the array of vibration devices at an intensity that corresponds to a distance of the object relative to the sensor.

12. The eyewear of claim 9 , wherein the vibration devices are positioned on a bridge extending between the frame first side and the frame second side.

13. A method for use with eyewear, the eyewear having a frame having a first side and a center, a first temple adjacent the first side of the frame, an optical element supported by the frame, a sensor supported by the frame and configured to sense an object, lights forming a portion of the frame, and an electronic processor, wherein the lights comprise an array of lights at the first side of the frame, wherein the processor is configured to selectively illuminate a first said light that is indicative of the object being left of the frame center a first predetermined angle, and to illuminate a second said light that is indicative of the object being left of the frame center a second predetermined angle that is greater than the first angle, the processor:

processing signals received from the sensor to determine direction and distance of an object relative to the sensor;

generating an indicator discernable by a user of the eyewear that is indicative of the direction and distance of the object relative to the sensor;

illuminating at least one of the lights as the indicator; and

illuminating the first light when the object is left of the frame center the first predetermined angle, and illuminating the second light when the object is left of the frame center the second predetermined angle.

14. The method of claim 13 , wherein the lights comprise at least one left light positioned on the frame first side and at least one right light positioned on a frame second side.

15. The method of claim 13 , wherein the processor illuminates one light of the array of lights at a brightness that corresponds to a distance of the object relative to the sensor.

16. The method of claim 14 , wherein the eyewear further comprises vibration devices, wherein the processor selectively enables one of the vibration devices that corresponds to a direction of the object relative to the sensor.

17. A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor of eyewear having a frame having a first side and a center, a first temple adjacent a first side of the frame, an optical element supported by the frame, a sensor supported by the frame and configured to sense an object, and lights forming a portion of the frame, wherein the lights comprise an array of lights at the first side of the frame, wherein the processor is configured to selectively illuminate a first said light that is indicative of the object being left of the frame center a first predetermined angle, and to illuminate a second said light that is indicative of the object being left of the frame center a second predetermined angle that is greater than the first angle, to perform the steps of:

processing signals received from the sensor to determine direction and distance of an object relative to the sensor;

generating an indicator discernable by a user of the eyewear that is indicative of the direction and distance of the object relative to the sensor;

illuminating at least one of the lights as the indicator; and

illuminating the first light when the object is left of the frame center the first predetermined angle, and illuminating the second light when the object is left of the frame center the second predetermined angle.

18. The non-transitory computer readable medium as specified in claim 17 , wherein the lights comprise at least one left light positioned on the frame first side and at least one right light positioned on a frame second side.

19. The non-transitory computer readable medium as specified in claim 17 , wherein the program code, when executed, is operative to cause the processor to selectively enable one vibration device of an array of vibration devices that corresponds to a direction of the object relative to the sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2021
From: POMES, STEPHEN; THAM, YU JIANG
To: SNAP INC.
Reel/Frame 058275/0127 →
Continuity (1)
Provisional Application 62894381 · Aug 30, 2019
Cited By (2)
US 12,346,158 US 12,656,633