Granted Patent B2

US 12,216,339 · App. 18/517,910 · Granted Feb 4, 2025

Inventors: Ernesto Carlos Martinez Villalpando (Shrewsbury, MA); Chiu Ming So (Hong Kong, HK); Kwok Wah Law (Hong Kong, HK); Wai Kuen Cheung (Hong Kong, HK)

G02C5/001G02C11/10G06F3/167H04W4/026H04W4/38G02C2200/08

Abstract

Claims (37)

1. A method to provide assistance to a user through an eyewear device, comprising;

receiving first data from a first sensor, the first sensor is incorporated into the eyewear device, the first sensor measures a parameter related to the user;

receiving second data from a second sensor, wherein the second sensor is an external sensor;

analyzing a state of the user, wherein the analyzing uses the first data and the second data;

determining a context of the user, wherein determining uses the first data and the second data; and

providing assistance to the user, wherein the assistance is in a form of feedback, and wherein the feedback is related to the state and the context.

2. The method of claim 1 , wherein a first element of the context is a physical orientation of the user.

3. The method of claim 2 , wherein a second element of the context is an activity that the user is doing.

4. The method of claim 2 , wherein a third element of the context is the user's environment.

5. The method of claim 1 , wherein the assistance is in a form of audio communication for the user.

6. A computer readable storage medium storing program code for causing a data processing system to perform steps comprising:

receiving first data from a first sensor, the first sensor is incorporated into an eyewear device, the first sensor measures a parameter related to a user;

receiving second data from a second sensor, wherein the second sensor is an external sensor;

determining a context of the user, wherein the determining uses the first data and the second data; and

providing assistance to the user, wherein the assistance is related to the context, and wherein the assistance is in a form of audio communication to the user.

7. The computer readable storage medium of claim 6 , wherein a first element of the context is a physical orientation of the user.

8. The computer readable storage medium of claim 6 , wherein a second element of the context is an activity that the user is doing.

9. The computer readable storage medium of claim 6 , wherein a third element of the context is the user's environment.

10. The computer readable storage medium of claim 6 , further comprising:

analyzing a state of the user, wherein the analyzing uses the first data and the assistance is related to both the state and the context.

11. A system for execution by a data processing system to provide assistance to a user through an eyewear device, comprising:

a voice interface, the voice interface has a microphone and a speaker, the voice interface to receive user commands and to provide assistance to the user;

a sensor data input, the sensor data input to receive sensor data;

a processor, the processor is in electrical communication with the voice interface and the sensor data; and

a computer program for processing the sensor data, the computer program and the processor to cause the data processing system to perform steps comprising:

receiving first data from a first sensor, the first sensor is incorporated into the eyewear device, the first sensor measures a parameter related to the user;

receiving second data from a second sensor, wherein the second sensor is an external sensor;

determining a context for the user, wherein the determining uses the first data and the second data;

analyzing a state of the user, wherein the analyzing uses the first data and the second data; and

providing assistance to the user, the assistance is related to the context and the state.

12. The system of claim 11 , wherein the analyzing considers a category selected from the group consisting of health, wellbeing, safety, cognitive, physical, and emotional.

13. The system of claim 11 , wherein the assistance is designed to help the user correct a negative condition.

14. The system of claim 11 , wherein the assistance is designed to help the user by encouraging a positive condition.

15. The system of claim 13 , the system further comprising:

a device, the device is external to the eyewear device, the device is in electrical communication with the eyewear device and the device is used to provide the assistance to the user.

16. The system of claim 11 , the steps further comprising:

receiving third data from a plurality of embedded sensors, the determining uses both the first data and the third data and the analyzing uses both the first data and the third data.

Assignments (2)

Continuity (6)

References Cited (81)