IP Library Granted Patent US 10,744,058
Granted Patent B2
US 10,744,058 · App. 15/959,042 · Granted Aug 18, 2020

Method and system for providing information to a user

Inventors: Scott Novich (Houston, TX); David Eagleman (Palo Alto, CA); Michael Vincent Perrotta (Palo Alto, CA)
Assignee: NeoSensory, Inc.
A61H3/061A61F9/08G06K9/00671G06K9/00677A61H2003/001A61H2003/007A61H2003/063A61H2201/165A61H2201/1619
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,744,058
App. No.
15/959,042
Granted
Aug 18, 2020
Kind
B2
Abstract

A method for providing information to a user, preferably including: determining environmental information; determining a set of features based on the information; determining output parameters based on the features; and controlling a sensory output system to generate outputs based on the output parameters. A sensory output device, preferably including a plurality of sensory output actuators. A system for providing information to a user, preferably including one or more: sensory output devices, sensors, and computing systems.

Claims (84)

1. A method for providing information to a user, the method comprising:

determining a first position of a first object relative to the user, wherein determining the first position comprises, at a first sensor mechanically coupled to the user, sampling a first measurement indicative of the first position;

determining a second position of a second object relative to the user, wherein determining the second position comprises:

determining a user location and a user orientation of the user;

at a second sensor not mechanically coupled to the user, sampling a second measurement indicative of a location of the second object; and

based on the location, the user location, and the user orientation, determining the second position; and

at a tactile output device mechanically coupled to the user, the tactile output device comprising: a first plurality of tactile actuators defining a first band; and a second plurality of tactile actuators defining a second band distinct from the first band:

based on the first position, determining a first set of control instructions for the first plurality of tactile actuators, comprising: selecting a first tactile actuator of the first plurality such that the first object is closer to the first tactile actuator than to any other tactile actuator of the first plurality;

in response to determining the first set of control instructions, controlling the first plurality of tactile actuators based on the first set of control instructions, comprising controlling the first tactile actuator to actuate;

based on the second position, determining a second set of control instructions for the second plurality of tactile actuators, comprising: selecting a second tactile actuator of the second plurality such that the second object is closer to the second tactile actuator than to any other tactile actuator of the second plurality; and

substantially concurrent with controlling the first plurality of tactile actuators based on the first set of control instructions, in response to determining the second set of control instructions: controlling the second plurality of tactile actuators based on the second set of control instructions, comprising controlling the second tactile actuator to actuate.

2. The method of claim 1 , further comprising:

determining that the user is moving toward a bottom of a staircase;

in response to determining that the user is moving toward the bottom of the staircase, at the tactile output device, determining a third set of control instructions for a third plurality of tactile actuators, wherein the third plurality of tactile actuators comprises:

a lower set of actuators;

a middle set of actuators arranged above the lower set; and

an upper set of actuators arranged above the middle set; and

in response to determining the third set of control instructions, controlling the third plurality of tactile actuators based on the third set of control instructions, comprising:

controlling the lower set of actuators to actuate;

after controlling the lower set of actuators, controlling the middle set of actuators to actuate; and

after controlling the middle set of actuators, controlling the upper set of actuators to actuate.

3. The method of claim 2 , wherein the upper, middle, and lower sets of actuators cooperatively define a region intersecting the first band and the second band.

4. The method of claim 1 , wherein the first sensor comprises an optical sensor.

5. The method of claim 1 , wherein:

the first object is an inanimate object; and

the second object is a person mechanically coupled to a user device comprising the second sensor.

6. The method of claim 5 , further comprising, before controlling the second plurality of tactile actuators based on the second set of control instructions:

determining, based on social graph information, that the person is associated with the user.

7. The method of claim 1 , further comprising:

classifying the first object as an obstacle type;

based on classifying the first object as the obstacle type, associating the first object with the first band, wherein the first set of control instructions are determined in response to associating the first object with the first band;

classifying the second object as a person type; and

based on classifying the second object as the person type, associating the second object with the second band, wherein the second set of control instructions are determined in response to associating the second object with the second band.

8. The method of claim 7 , further comprising:

determining a third position of a third object relative to the user;

classifying the third object as the obstacle type; and

based on classifying the third object as the obstacle type, associating the third object with the first band;

wherein:

determining the first set of control instructions for the first plurality of tactile actuators further comprises: based on the third position and on associating the third object with the first band, selecting a third tactile actuator of the first plurality such that the third object is closer to the third tactile actuator than to any other tactile actuator of the first plurality; and

controlling the first plurality of tactile actuators based on the first set of control instructions further comprises: substantially concurrent with controlling the first tactile actuator to actuate, controlling the third tactile actuator to actuate.

9. The method of claim 8 , wherein:

a first object distance between the first position and the user is greater than a third object distance between the third position and the user;

based on the first object distance, the first tactile actuator is controlled to actuate at a first actuator intensity; and

based on the third object distance, the third tactile actuator is controlled to actuate at a third actuator intensity greater than the first actuator intensity.

10. The method of claim 1 , wherein:

while controlling the first plurality of tactile actuators, a third tactile actuator of the second plurality does not actuate, wherein the first object is closer to the third tactile actuator than to any other tactile actuator of the second plurality; and

while controlling the second plurality of tactile actuators, a fourth tactile actuator of the first plurality does not actuate, wherein the second object is closer to the fourth tactile actuator than to any other tactile actuator of the first plurality.

11. The method of claim 1 , wherein:

the tactile output device comprises a garment encircling a body part of the user, the body part defining a longitudinal axis;

the first band substantially encircles the body part;

the second band substantially encircles the body part; and

the first band is displaced from the second band along the longitudinal axis.

12. The method of claim 11 , wherein:

the body part is a torso; and

the tactile output device further comprises an array of tactile actuators substantially encircling the torso, wherein the array comprises the first and second pluralities of tactile actuators.

13. A method for providing information to a user, the method comprising:

determining a first position of a first object relative to the user;

determining a second position of a second object relative to the user; and

at a tactile output device mechanically coupled to the user, the tactile output device comprising: a first plurality of tactile actuators defining a first band; and a second plurality of tactile actuators defining a second band distinct from the first band:

based on the first position, determining a first set of control instructions for the first plurality of tactile actuators, comprising: selecting a first tactile actuator of the first plurality such that the first object is closer to the first tactile actuator than to any other tactile actuator of the first plurality;

in response to determining the first set of control instructions, controlling the first plurality of tactile actuators based on the first set of control instructions, comprising controlling the first tactile actuator to actuate;

based on the second position, determining a second set of control instructions for the second plurality of tactile actuators, comprising: selecting a second tactile actuator of the second plurality such that the second object is closer to the second tactile actuator than to any other tactile actuator of the second plurality;

substantially concurrent with controlling the first plurality of tactile actuators based on the first set of control instructions, in response to determining the second set of control instructions: controlling the second plurality of tactile actuators based on the second set of control instructions, comprising controlling the second tactile actuator to actuate;

determining that the user is moving toward a bottom of a staircase;

in response to determining that the user is moving toward the bottom of the staircase, at the tactile output device, determining a third set of control instructions for a third plurality of tactile actuators, wherein the third plurality of tactile actuators comprises:

a lower set of actuators;

a middle set of actuators arranged above the lower set; and

an upper set of actuators arranged above the middle set; and

in response to determining the third set of control instructions, controlling the third plurality of tactile actuators based on the third set of control instructions, comprising:

controlling the lower set of actuators to actuate;

after controlling the lower set of actuators, controlling the middle set of actuators to actuate; and

after controlling the middle set of actuators, controlling the upper set of actuators to actuate.

14. A method for providing information to a user, the method comprising:

determining a first position of a first object relative to the user;

classifying the first object as an obstacle type;

determining a second position of a second object relative to the user;

classifying the second object as a person type; and

at a tactile output device mechanically coupled to the user, the tactile output device comprising: a first plurality of tactile actuators defining a first band; and a second plurality of tactile actuators defining a second band distinct from the first band:

based on classifying the first object as the obstacle type, associating the first object with the first band;

based on classifying the second object as the person type, associating the second object with the second band;

in response to associating the first object with the first band and based on the first position, determining a first set of control instructions for the first plurality of tactile actuators, comprising: selecting a first tactile actuator of the first plurality such that the first object is closer to the first tactile actuator than to any other tactile actuator of the first plurality;

in response to determining the first set of control instructions, controlling the first plurality of tactile actuators based on the first set of control instructions, comprising controlling the first tactile actuator to actuate;

in response to associating the second object with the second band and based on the second position, determining a second set of control instructions for the second plurality of tactile actuators, comprising: selecting a second tactile actuator of the second plurality such that the second object is closer to the second tactile actuator than to any other tactile actuator of the second plurality; and

substantially concurrent with controlling the first plurality of tactile actuators based on the first set of control instructions, in response to determining the second set of control instructions: controlling the second plurality of tactile actuators based on the second set of control instructions, comprising controlling the second tactile actuator to actuate.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2026
From: NEOSENSORY, INC.
To: ESSILOR INTERNATIONAL
Reel/Frame 074271/0953 →
RELEASE OF SECURITY INTEREST Recorded May 27, 2025
From: WTI FUND X, INC.
To: NEOSENSORY, INC.
Reel/Frame 071229/0943 →
SECURITY INTEREST Recorded Mar 14, 2024
From: NEOSENSORY, INC.
To: WTI FUND X, INC.
Reel/Frame 066779/0502 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2018
From: NOVICH, SCOTT; EAGLEMAN, DAVID; PERROTTA, MICHAEL VINCENT
To: NEOSENSORY, INC.
Reel/Frame 046428/0257 →
Continuity (2)
Provisional Application 62487832 · Apr 20, 2017
Related Publication 20180303702A1 · Oct 25, 2018
Cited By (2)
US 12,424,084 US 12,437,632