Granted Patent B2

US 12,401,772 · App. 18/458,895 · Granted Aug 26, 2025

Inventors: Erick Miller (Los Angeles, CA); Jonathan Rodriguez (Los Angeles, CA)

Assignee: Snap Inc.

H04N9/3173G02B27/0176G06F3/013G06T7/60G06T7/73G06T19/006G06V10/803G06V40/19G06V40/193H04N9/3185H04N23/51H04N23/55G02B2027/0178

Abstract

Claims (62)

1. An apparatus comprising:

a support structure for mounting on the head of a user;

a display matrix;

a sensor device for receiving biometric data;

a microcomputer;

a transceiver coupled with the microcomputer, wherein the microcomputer executes instructions that comprise:

generating an image stream that comprises a set of images;

accessing biometric data generated by the sensor device;

generating a request that includes the biometric data to a networked computer;

receiving, from the networked computer, a presentation of the image stream that includes an object rendered at a position within the image stream based on at least the biometric data; and

causing the display matrix to display the presentation of the image stream that includes the object rendered at the position within the image stream.

2. The apparatus of claim 1 , wherein the sensor device comprises an electrooculography (EOG) sensor, and the biometric data includes eye tracking data.

3. The apparatus of claim 1 , further comprising:

determining a gaze vector based on the biometric data; and

wherein the position of the object in the image stream is based on the gaze vector.

4. The apparatus of claim 1 , wherein the support structure comprises a glasses frame, and the display matrix and sensor device are integrated into the glasses frame.

5. The apparatus of claim 1 , further comprising:

merging the image stream and the biometric data to generate a data structure; and

wherein the request includes the data structure.

6. The apparatus of claim 1 , further comprising:

detecting biometric feedback based on the sensor device; and

presenting the object within the presentation of the image stream based on the biometric feedback.

7. The apparatus of claim 1 , further comprising:

extracting metadata from the set of images of the image stream; and

generating the request based on the biometric data and the metadata.

8. A method comprising:

generating an image stream that comprises a set of images;

accessing biometric data generated by a sensor device;

generating a request that includes the biometric data to a networked computer;

receiving, from the networked computer, a presentation of the image stream that includes an object rendered at a position within the image stream based on at least the biometric data; and

causing a display matrix to display the presentation of the image stream that includes the object rendered at the position within the image stream.

9. The method of claim 8 , wherein the sensor device comprises an electrooculography (EOG) sensor, and the biometric data includes eye tracking data.

10. The method of claim 8 , further comprising:

determining a gaze vector based on the biometric data; and

wherein the position of the object in the image stream is based on the gaze vector.

11. The method of claim 8 , further comprising an apparatus that comprises a glasses frame, and the display matrix and the sensor device are integrated into the glasses frame.

12. The method of claim 8 , further comprising:

merging the image stream and the biometric data to generate a data structure; and

wherein the request includes the data structure.

13. The method of claim 8 , further comprising:

detecting biometric feedback based on the sensor device; and

presenting the object within the presentation of the image stream based on the biometric feedback.

14. The method of claim 8 , further comprising:

extracting metadata from the set of images of the image stream; and

generating the request based on the biometric data and the metadata.

15. A non-transitory computer readable storage medium storing therein instructions that, when executed by a processor, cause an apparatus for mounting on the head of a user to perform operations comprising:

generating an image stream that comprises a set of images;

accessing biometric data generated by a sensor device;

generating a request that includes the biometric data to a networked computer;

receiving, from the networked computer, a presentation of the image stream that includes an object rendered at a position within the image stream based on at least the biometric data; and

causing a display matrix to display the presentation of the image stream that includes the object rendered at the position within the image stream.

16. The non-transitory computer readable storage medium of claim 15 , wherein the sensor device comprises an electrooculography (EOG) sensor, and the biometric data includes eye tracking data.

17. The non-transitory computer readable storage medium of claim 15 , further comprising:

determining a gaze vector based on the biometric data; and

wherein the position of the object in the image stream is based on the gaze vector.

18. The non-transitory computer readable storage medium of claim 15 , wherein the apparatus comprises a glasses frame, and the display matrix and the sensor device are integrated into the glasses frame.

19. The non-transitory computer readable storage medium of claim 15 , further comprising:

merging the image stream and the biometric data to generate a data structure; and

wherein the request includes the data structure.

20. The non-transitory computer readable storage medium of claim 15 , further comprising:

detecting biometric feedback based on the sensor device; and

presenting the object within the presentation of the image stream based on the biometric feedback.

Assignments (2)

Continuity (9)

References Cited (153)