Granted Patent B2

US 12,675,839 · App. 18/612,495 · Granted Jul 7, 2026

Inventors: Jose Antonio Checa Oloriz (San Francisco, CA); Miquel Estany Rodriguez (San Francisco, CA); Arjun Kaul (Cupertino, CA); Pedro Mari (Santa Cruz, CA); Christopher C. Niederauer (Los Altos Hills, CA); James J. Owen (San Francisco, CA); William A. Sorrentino, III (Mill Valley, CA)

Assignee: Apple Inc.

G06T3/18G06T19/006

Abstract

Claims (56)

1 . An electronic device, comprising:

one or more sensor(s);

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

while displaying a portion of an extended reality (XR) environment representing a current field of view of a user of the electronic device:

detecting, with the one or more sensors, a user input to invoke a digital assistant;

in response to detecting a user input to invoke the digital assistant, displaying a user interface element associated with the digital assistant;

distorting the display of a first portion of the current field of view behind the user interface element, wherein the first portion of the current field of view behind the user interface element is displayed having an optical distortion effect;

detecting a change in a position of the user interface element relative to the current field of view; and

distorting the display of a second portion of the current field of view behind the user interface element, wherein the second portion of the current field of view behind the user interface element is displayed having an optical distortion effect.

2 . The electronic device of claim 1 , wherein the optical distortion effect includes a pincushion distortion effect.

3 . The electronic device of claim 1 , wherein the optical distortion effect includes a barrel distortion effect.

4 . The electronic device of claim 1 , wherein distorting the display varies as the portion of the current field of view changes.

5 . The electronic device of claim 1 , the one or more programs further including instructions for:

displaying a document in the current field of view, wherein the user interface element distorts content of the document viewable through the user interface element.

6 . The electronic device of claim 1 , wherein the user interface element is animated and the distortion of the first portion of the current field of view and the distortion of the second portion of the current field of view changes based on the animation.

7 . The electronic device of claim 1 , wherein distorting the display of the first portion of the current field of view behind the user interface element further comprises:

distorting the display of the first portion of the current field of view behind the user interface element radially from a center of the user interface element.

8 . The electronic device of claim 1 , wherein distorting the display includes changing a color of an object behind the user interface element.

9 . The electronic device of claim 1 , wherein the distortion of the display is created by a plurality of sections included in a layer of the user interface element.

10 . A method, comprising:

at an electronic device with one or more processors, memory, and one or more sensors:

while displaying a portion of an extended reality (XR) environment representing a current field of view of a user of the electronic device:

detecting, with the one or more sensors, a user input to invoke a digital assistant;

in response to detecting a user input to invoke the digital assistant, displaying a user interface element associated with the digital assistant;

distorting the display of a first portion of the current field of view behind the user interface element, wherein the first portion of the current field of view behind the user interface element is displayed having an optical distortion effect;

detecting a change in a position of the user interface element relative to the current field of view; and

distorting the display of a second portion of the current field of view behind the user interface element, wherein the second portion of the current field of view behind the user interface element is displayed having an optical distortion effect.

11 . The method of claim 10 , wherein the optical distortion effect includes a pincushion distortion effect.

12 . The method of claim 10 The electronic device of claim 1 , wherein the optical distortion effect includes a barrel distortion effect.

13 . The method of claim 10 , wherein distorting the display varies as the portion of the current field of view changes.

14 . The method of claim 10 , further comprising:

displaying a document in the current field of view, wherein the user interface element distorts content of the document viewable through the user interface element.

15 . The method of claim 10 , wherein the user interface element is animated and the distortion of the first portion of the current field of view and the distortion of the second portion of the current field of view changes based on the animation.

16 . The method of claim 10 , wherein distorting the display of the first portion of the current field of view behind the user interface element further comprises:

distorting the display of the first portion of the current field of view behind the user interface element radially from a center of the user interface element.

17 . The method of claim 10 , wherein distorting the display includes changing a color of an object behind the user interface element.

18 . The method of claim 10 , wherein the distortion of the display is created by a plurality of sections included in a layer of the user interface element.

19 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:

while displaying a portion of an extended reality (XR) environment representing a current field of view of a user of the electronic device:

detecting, with the one or more sensors, a user input to invoke a digital assistant;

in response to detecting a user input to invoke the digital assistant, displaying a user interface element associated with the digital assistant;

distorting the display of a first portion of the current field of view behind the user interface element, wherein the first portion of the current field of view behind the user interface element is displayed having an optical distortion effect;

detecting a change in a position of the user interface element relative to the current field of view; and

distorting the display of a second portion of the current field of view behind the user interface element, wherein the second portion of the current field of view behind the user interface element is displayed having an optical distortion effect.

20 . The non-transitory computer-readable storage medium of claim 19 , wherein the optical distortion effect includes a pincushion distortion effect.

21 . The non-transitory computer-readable storage medium of claim 19 , wherein the optical distortion effect includes a barrel distortion effect.

22 . The non-transitory computer-readable storage medium of claim 19 , wherein distorting the display varies as the portion of the current field of view changes.

23 . The non-transitory computer-readable storage medium of claim 19 , the one or more programs further including instructions for:

displaying a document in the current field of view, wherein the user interface element distorts content of the document viewable through the user interface element.

24 . The non-transitory computer-readable storage medium of claim 19 , wherein the user interface element is animated and the distortion of the first portion of the current field of view and the distortion of the second portion of the current field of view changes based on the animation.

25 . The non-transitory computer-readable storage medium of claim 19 , wherein distorting the display of the first portion of the current field of view behind the user interface element further comprises:

distorting the display of the first portion of the current field of view behind the user interface element radially from a center of the user interface element.

26 . The non-transitory computer-readable storage medium of claim 19 , wherein distorting the display includes changing a color of an object behind the user interface element.

27 . The non-transitory computer-readable storage medium of claim 19 , wherein the distortion of the display is created by a plurality of sections included in a layer of the user interface element.

Assignments (1)

Continuity (3)

References Cited (59)