Granted Patent B2

US 12,422,917 · App. 18/371,138 · Granted Sep 23, 2025

Inventors: Grant H. Mulliken (Los Gatos, CA); Anura A. Patil (San Francisco, CA); Brian Pasley (Berkeley, CA); Christine Godwin (Santa Clara, CA); Eve Ekman (San Francisco, CA); Jonathan Hadida (Redwood City, CA); Lauren Cheung (Los Altos, CA); Mary A. Pyc (Campbell, CA); Patrick O. Eronini (Sunnyvale, CA); Raphael A. Bernier (Seattle, WA); Steven A. Marchette (San Jose, CA); Fletcher R. Rothkopf (Los Altos, CA)

Assignee: Apple Inc.

G06F3/011G06F3/013G06F3/017G06T19/006G06T2200/24

Abstract

Claims (97)

1. A wearable system, comprising:

a head-mounted display;

a set of sensors; and

a processor configured to:

determine a current activity of the user;

determine a focus level associated with the current activity;

in response to the focus level exceeding a first threshold, determine that a first activation criteria has been met;

in response to determining that the first activation criteria has been met, enter a first focus mode that reduces distraction in an extended reality environment; and

while in the first focus mode:

receive imaging data of a physical environment around a user using the set of sensors; and

cause the head-mounted display to display the extended reality environment that includes a reproduction of a first portion of the physical environment in which a distracting object in the first portion of the physical environment is replaced with additional content;

in response to the focus level exceeding a second threshold, determine that a second activation criteria has been met;

in response to determining that the second activation criteria has been met, entering a second focus mode that reduces distraction in the extended reality environment; and

while in the second focus mode:

receive imaging data of the physical environment around the user using the set of sensors; and

cause the head-mounted display to display the extended reality environment that includes a modified representation of a second portion of the physical environment.

2. The wearable system of claim 1 , wherein:

the first threshold is less than the second threshold.

3. The wearable system of claim 1 , wherein the processor is configured to:

determine that a candidate object in the first portion of the physical environment meets a distraction criteria; and

select the candidate object as the distracting object.

4. The wearable system of claim 3 , wherein the processor is configured to select the distraction criteria based on the determined current activity.

5. The wearable system of claim 1 , wherein the processor is configured to:

determine that the second portion of the physical environment is not associated with the current activity; and

determine that a third portion of the physical environment is associated with the current activity, wherein:

causing the head-mounted display to display the extended reality environment that includes a modified representation of the second portion of the physical environment comprises causing the head-mounted display to display the extended reality environment that includes a reproduction of the third portion of the physical environment.

6. The wearable system of claim 1 , wherein the processor is configured to:

select a modification based on the determined current activity; and

apply the modification to imaging data associated with the second portion of the physical environment to generate the modified representation of the second portion of the physical environment.

7. The wearable system of claim 6 , wherein the processor is configured to:

determine a focus level associated with the determined current activity, wherein selecting the modification based on the current activity comprises selecting the modification based on the determined focus level.

8. The wearable system of claim 1 , wherein the processor is configured to:

receive an activation input from the user; and

determine that the first activation criteria has been met in response to the received activation input being associated with the first focus mode.

9. The wearable system of claim 8 , wherein the processor is configured:

prompt the user to select a target focus mode from a set of candidate focus modes.

10. A wearable system, comprising:

a head-mounted display;

a set of sensors; and

a processor configured to:

determine a current activity of the user using the set of sensors;

in response to determining that a first activation criteria has been met, enter a first focus mode that reduces distraction in an extended reality environment; and

while in the first focus mode:

receive imaging data of a physical environment around a user using the set of sensors; and

cause the head-mounted display to display the extended reality environment that includes a reproduction of a first portion of the physical environment and a modified representation of an object in the reproduction of the first portion;

in response to determining that a second activation criteria has been met, entering a second focus mode that reduces distraction in the extended reality environment; and

while in the second focus mode:

receive imaging data of the physical environment around the user using the set of sensors; and

cause the head-mounted display to display the extended reality environment that includes a modified representation of a second portion of the physical environment;

generate the modified representation of the second portion of the physical environment based on the determined activity;

determine a focus level associated with the determined current activity; and

select the modification based on the determined focus level.

11. The wearable system of claim 10 , wherein the modified representation of the object comprises replacing the object in the first portion of the physical environment with additional content.

12. The wearable system of claim 10 , wherein the processor is configured to determine whether the first activation criteria has been met or the second activation criteria has been met based on the determined current activity of the user.

13. The wearable system of claim 12 , wherein the processor is configured to:

determine a focus level associated with the current activity;

in response to determining that the focus level exceeds a first threshold, determine that the first activation criteria has been met; and

in response to determining that the focus level exceeds a second threshold, determine that the second activation criteria has been met.

14. The wearable system of claim 10 , wherein the processor is configured to:

determine that a candidate object in the first portion of the physical environment meets a distraction criteria; and

select the candidate object as the object.

15. The wearable system of claim 14 , wherein the processor is configured to determine that the candidate objects meets the distraction criteria based on the determined current activity.

16. The wearable system of claim 10 , wherein the processor is configured to:

receive an activation input from the user; and

determine that the first activation criteria has been met in response to determining that the received activation input is associated with the first focus mode.

17. The wearable system of claim 10 , wherein the processor is configured prompt the user to select a focus mode from a set of candidate focus modes.

18. A wearable system, comprising:

a head-mounted display;

a set of sensors; and

a processor configured to:

determine a current activity of the user;

in response to determining that a first activation criteria has been met, enter a first focus mode that reduces distraction in an extended reality environment; and

while in the first focus mode:

receive imaging data of a physical environment around a user using the set of sensors; and

cause the head-mounted display to display the extended reality environment that includes a reproduction of a first portion of the physical environment in which a distracting object in the first portion of the physical environment is replaced with additional content;

in response to determining that a second activation criteria has been met, entering a second focus mode that reduces distraction in the extended reality environment; and

while in the second focus mode:

receive imaging data of the physical environment around the user using the set of sensors;

determine that a second portion of the physical environment is not associated with the current activity; and

determine that a third portion of the physical environment is associated with the current activity; and

cause the head-mounted display to display the extended reality environment that includes a modified representation of a second portion of the physical environment and a reproduction of the third portion of the physical environment.

19. A wearable system, comprising:

a head-mounted display;

a set of sensors; and

a processor configured to:

receive an activation input from the user;

determine that a first activation criteria has been met in response to the received activation input being associated with the first focus mode;

in response to determining that the first activation criteria has been met:

prompt the user to select a target focus mode from a set of candidate focus modes; and

enter a first focus mode that reduces distraction in an extended reality environment; and

while in the first focus mode:

receive imaging data of a physical environment around a user using the set of sensors; and

cause the head-mounted display to display the extended reality environment that includes a reproduction of a first portion of the physical environment in which a distracting object in the first portion of the physical environment is replaced with additional content;

in response to determining that a second activation criteria has been met, entering a second focus mode that reduces distraction in the extended reality environment; and

while in the second focus mode:

receive imaging data of the physical environment around the user using the set of sensors; and

cause the head-mounted display to display the extended reality environment that includes a modified representation of a second portion of the physical environment.

Assignments (1)

Continuity (2)

References Cited (29)