Granted Patent B2

US 12,407,900 · App. 18/408,531 · Granted Sep 2, 2025

Inventors: Kenneth Luke Kocienda (Mill Valley, CA); Imran A. Chaudhri (San Francisco, CA)

Assignee: Hewlett-Packard Development Company, L.P.

H04N21/4667G06F1/163G06F3/015H04N21/4126H04N21/4415

Abstract

Claims (62)

1. A method comprising:

obtaining, by one or more processors, sensor data from one or more first sensors of an electronic device, wherein the sensor data represents an environment of a user of the electronic device;

generating, by the one or more processors, a first content item based on the sensor data, wherein the first content item comprises a depiction of the environment generated based on at least a portion of the sensor data;

obtaining, by the one or more processors, biometric data regarding the user, wherein the biometric data is obtained from one or more second sensors of the electronic device, and wherein at least a portion of the sensor data is obtained concurrently with the biometric data;

determining, by the one or more processors, a metric for the first content item based on the biometric data; and

storing, by the one or more processors, the first content item and the metric, wherein the metric is stored as metadata of the first content item, and wherein the metric represents a degree of importance of the first content item including the depiction of the environment to the user.

2. The method of claim 1 , wherein the one or more first sensors comprise at least one of:

a camera,

a microphone, or

a depth sensor.

3. The method of claim 1 , wherein the biometric data comprises a plurality of types of data, and wherein determining the metric for the first content item comprises:

determining, for each of the types of data, a corresponding score, and

determining the metric based on a weighted sum of the scores.

4. The method of claim 3 , wherein the types of data comprise at least one of:

a body temperature of the user,

a heart rate of the user,

a respiration rate of the user, or

a perspiration rate of the user.

5. The method of claim 1 , wherein at least a portion of the sensor data is obtained prior to the biometric data.

6. The method of claim 1 , wherein at least a portion of the sensor data is obtained subsequent to the biometric data.

7. The method of claim 1 , further comprising:

obtaining first location data representing a current location of the user, wherein at least some of the sensor data is obtained while the user is at the current location;

obtaining second location data representing a travel history of the user; and

determining, based on the first location data and the second location data, a frequency metric representing a frequency at which the user has traveled to the current location,

wherein the metric for the first content item is determined further based on the frequency metric.

8. The method of claim 7 , wherein the metric increases with a decrease in the frequency metric.

9. The method of claim 1 , wherein the metric is determined based on a machine learning process having at least the biometric data as an input.

10. The method of claim 1 , wherein the metric is determined using a neural network having at least the biometric data as an input.

11. The method of claim 1 , further comprising:

obtaining a plurality of content items including the first content item, wherein each of the content items comprises a respective metric stored as metadata;

filtering the plurality of content items based on the metrics; and

presenting at least some of the plurality of content items to the user based on the filtering.

12. The method of claim 11 , further comprising:

receiving, from the user, a request for presentation of one or more of the plurality of content items, wherein the request comprises one or more search criteria, and

wherein the plurality of content items are filtered further based on the one or more search criteria.

13. The method of claim 11 , wherein filtering the plurality of content items comprises:

determining a first subset of the content items having metrics that exceed a threshold value, and

determining a second subset of the content items having metrics that do not exceed the threshold value.

14. The method of claim 13 , wherein presenting at least some of the plurality of content items to the user comprises:

presenting the first subset of the content items to the user, and

refraining from presenting the second subset of the content items to the user.

15. The method of claim 11 , wherein filtering the plurality of content items comprises:

ranking the plurality of content items based on the metrics.

16. The method of claim 15 , wherein presenting at least some of the plurality of content items to the user comprises:

presenting at least some of the plurality of content items in a sequence, wherein the sequence is determined based on the ranking of the plurality of content items.

17. The method of claim 1 , wherein at least some of the one or more processors are included in the electronic device.

18. The method of claim 1 , wherein at least some of the one or more processors are remote from the electronic device.

19. A system comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

obtaining sensor data from one or more first sensors of an electronic device, wherein the sensor data represents an environment of a user of the electronic device;

generating a first content item based on the sensor data, wherein the first content item comprises a depiction of the environment generated based on at least a portion of the sensor data;

obtaining biometric data regarding the user, wherein the biometric data is obtained from one or more second sensors of the electronic device, and wherein at least a portion of the sensor data is obtained concurrently with the biometric data;

determining a metric for the first content item based on the biometric data; and

storing the first content item and the metric, wherein the metric is stored as metadata of the first content item, and wherein the metric represents a degree of importance of the first content item including the depiction of the environment to the user.

20. One or more non-transitory computer-readable media storing instructions that, when

executed by at least one processor, cause the at least one processor to perform operations comprising:

obtaining sensor data from one or more first sensors of an electronic device, wherein the sensor data represents an environment of a user of the electronic device;

generating a first content item based on the sensor data, wherein the first content item comprises a depiction of the environment generated based on at least a portion of the sensor data;

obtaining biometric data regarding the user, wherein the biometric data is obtained from one or more second sensors of the electronic device, and wherein at least a portion of the sensor data is obtained concurrently with the biometric data;

determining a metric for the first content item based on the biometric data; and

storing the first content item and the metric, wherein the metric is stored as metadata of the first content item, and wherein the metric represents a degree of importance of the first content item including the depiction of the environment to the user.

Assignments (2)

Continuity (2)

References Cited (62)