IP Library Granted Patent US 12,602,108
Granted Patent B2
US 12,602,108 · App. 18/527,007 · Granted Apr 14, 2026

Systems and methods of updating a manner of display of three-dimensional objects

Inventors: Gregory Lutter (Boulder Creek, CA); Peter Burgner (Venice, CA); Manuel C. Clement (Felton, CA); In Young Yang (Kirkland, WA); Thomas G. Salter (San Francisco, CA); Alesha Unpingco (Milpitas, CA); Lee Sparks (Lake Forest, CA)
Assignee: Apple Inc.
G06F3/013G06F3/011G06F3/017G06F3/04815G06F3/0484G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,602,108
App. No.
18/527,007
Granted
Apr 14, 2026
Kind
B2
Abstract

Some examples of the disclosure are directed to systems and methods for minimizing display of an object from a maximized state to a minimized state in a three-dimensional environment. In some examples, an electronic device presents a computer-generated environment that includes a virtual object displayed in a maximized state in the three-dimensional environment. While displaying the three-dimensional environment, the electronic device detects that a first event has occurred. In response to detecting that the first event has occurred, in accordance with a determination that the first event satisfies one or more criteria, the electronic device displays the virtual object in a minimized state in the three-dimensional environment from a viewpoint of a user of the electronic device. In accordance with a determination that the first event does not satisfy the one or more criteria, the electronic device maintains display of the virtual object in the maximized state from the viewpoint.

Claims (97)

1 . A method comprising:

at an electronic device in communication with a display and one or more input devices:

presenting, via the display, a three-dimensional environment including a first object, wherein the first object is displayed in a first manner in the three-dimensional environment relative to a viewpoint of a user of the electronic device, including displaying the first object at a first location in the three-dimensional environment that is at a center of a field of view of the user;

while presenting the three-dimensional environment including the first object that is displayed in the first manner, detecting that a first event has occurred, including rotation of the viewpoint of the user relative to the three-dimensional environment; and

in response to detecting that the first event has occurred:

in accordance with a determination that the first event satisfies one or more criteria, including a criterion that is satisfied when a vertical component of the rotation of the viewpoint of the user exceeds a threshold angle relative to a reference, displaying, via the display, the first object in a second manner, different from the first manner, in the three-dimensional environment relative to the viewpoint of the user, including displaying the first object at a second location, different from the first location, in the three-dimensional environment that is outside the center of the field of view of the user; and

in accordance with a determination that the first event does not satisfy the one or more criteria, maintaining display of the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user.

2 . The method of claim 1 , wherein:

displaying the first object in the first manner in the three-dimensional environment includes displaying the first object at a first location in the three-dimensional environment relative to a first predefined portion of the user according to a first coordinate system; and

displaying the first object in the second manner in the three-dimensional environment includes displaying the first object at a second location in the three-dimensional environment relative to a second predefined portion, different from the first predefined portion, of the user according to a second coordinate system, different from the first coordinate system.

3 . The method of claim 1 , wherein:

detecting that the first event has occurred includes detecting movement of the viewpoint of the user relative to the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when the movement of the viewpoint of the user exceeds a threshold movement.

4 . The method of claim 1 , wherein:

detecting that the first event has occurred includes initiating countdown of a timer associated with the display of the first object in the first manner in the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when the countdown reaches an end of the timer.

5 . The method of claim 1 , wherein:

detecting that the first event has occurred includes detecting movement of a gaze of the user in the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when, after the movement of the gaze of the user, the gaze of the user is directed to a target other than the first object in the three-dimensional environment.

6 . The method of claim 1 , further comprising:

while displaying the first object in the second manner in the three-dimensional environment in accordance with the determination that the first event satisfies the one or more criteria in response to detecting that the first event has occurred, detecting that a second event has occurred; and

in response to detecting that the second event has occurred and in accordance with a determination that the second event satisfies one or more second criteria, redisplaying, via the display, the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user.

7 . The method of claim 6 , wherein:

detecting that the first event has occurred includes detecting movement of the viewpoint of the user from a first viewpoint to a second viewpoint that exceeds a threshold movement; and

the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes detecting movement of the viewpoint of the user back to the first viewpoint.

8 . The method of claim 6 , wherein:

the first object is displayed with a plurality of selectable options in the three-dimensional environment;

detecting that the first event has occurred includes receiving, via the one or more input devices, a selection of a first option of the plurality of selectable options; and

the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes receiving a selection of a second option of the plurality of selectable options.

9 . The method of claim 1 , wherein:

displaying the first object in the first manner in the three-dimensional environment includes displaying the first object with a first locked orientation in the three-dimensional environment; and

displaying the first object in the second manner in the three-dimensional environment includes displaying the first object with a second locked orientation, different from the first locked orientation, in the three-dimensional environment.

10 . An electronic device comprising:

one or more processors;

memory; and

one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method comprising:

presenting, via a display, a three-dimensional environment including a first object, wherein the first object is displayed in a first manner in the three-dimensional environment relative to a viewpoint of a user of the electronic device, including displaying the first object at a first location in the three-dimensional environment that is at a center of a field of view of the user;

while presenting the three-dimensional environment including the first object that is displayed in the first manner, detecting that a first event has occurred, including rotation of the viewpoint of the user relative to the three-dimensional environment; and

in response to detecting that the first event has occurred:

in accordance with a determination that the first event satisfies one or more criteria, including a criterion that is satisfied when a vertical component of the rotation of the viewpoint of the user exceeds a threshold angle relative to a reference, displaying, via the display, the first object in a second manner, different from the first manner, in the three-dimensional environment relative to the viewpoint of the user, including displaying the first object at a second location, different from the first location, in the three-dimensional environment that is outside the center of the field of view of the user; and

in accordance with a determination that the first event does not satisfy the one or more criteria, maintaining display of the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user.

11 . The electronic device of claim 10 , wherein:

displaying the first object in the first manner in the three-dimensional environment includes displaying the first object at a first location in the three-dimensional environment relative to a first predefined portion of the user according to a first coordinate system; and

displaying the first object in the second manner in the three-dimensional environment includes displaying the first object at a second location in the three-dimensional environment relative to a second predefined portion, different from the first predefined portion, of the user according to a second coordinate system, different from the first coordinate system.

12 . The electronic device of claim 10 , wherein:

detecting that the first event has occurred includes detecting movement of the viewpoint of the user relative to the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when the movement of the viewpoint of the user exceeds a threshold movement.

13 . The electronic device of claim 10 , wherein:

detecting that the first event has occurred includes initiating countdown of a timer associated with the display of the first object in the first manner in the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when the countdown reaches an end of the timer.

14 . The electronic device of claim 10 , wherein:

detecting that the first event has occurred includes detecting movement of a gaze of the user in the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when, after the movement of the gaze of the user, the gaze of the user is directed to a target other than the first object in the three-dimensional environment.

15 . The electronic device of claim 10 , wherein the method further comprises:

while displaying the first object in the second manner in the three-dimensional environment in accordance with the determination that the first event satisfies the one or more criteria in response to detecting that the first event has occurred, detecting that a second event has occurred; and

in response to detecting that the second event has occurred and in accordance with a determination that the second event satisfies one or more second criteria, redisplaying, via the display, the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user.

16 . The electronic device of claim 15 , wherein:

detecting that the first event has occurred includes detecting movement of the viewpoint of the user from a first viewpoint to a second viewpoint that exceeds a threshold movement; and

the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes detecting movement of the viewpoint of the user back to the first viewpoint.

17 . The electronic device of claim 15 , wherein:

the first object is displayed with a plurality of selectable options in the three-dimensional environment;

detecting that the first event has occurred includes receiving, via one or more input devices, a selection of a first option of the plurality of selectable options; and

the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes receiving a selection of a second option of the plurality of selectable options.

18 . The electronic device of claim 10 , wherein:

displaying the first object in the first manner in the three-dimensional environment includes displaying the first object with a first locked orientation in the three-dimensional environment; and

displaying the first object in the second manner in the three-dimensional environment includes displaying the first object with a second locked orientation, different from the first locked orientation, in the three-dimensional environment.

19 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising:

presenting, via a display, a three-dimensional environment including a first object, wherein the first object is displayed in a first manner in the three-dimensional environment relative to a viewpoint of a user of the electronic device, including displaying the first object at a first location in the three-dimensional environment that is at a center of a field of view of the user;

while presenting the three-dimensional environment including the first object that is displayed in the first manner, detecting that a first event has occurred, including rotation of the viewpoint of the user relative to the three-dimensional environment; and

in response to detecting that the first event has occurred:

in accordance with a determination that the first event satisfies one or more criteria, including a criterion that is satisfied when a vertical component of the rotation of the viewpoint of the user exceeds a threshold angle relative to a reference, displaying, via the display, the first object in a second manner, different from the first manner, in the three-dimensional environment relative to the viewpoint of the user, including displaying the first object at a second location, different from the first location, in the three-dimensional environment that is outside the center of the field of view of the user; and

in accordance with a determination that the first event does not satisfy the one or more criteria, maintaining display of the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user.

20 . The non-transitory computer readable storage medium of claim 19 , wherein:

displaying the first object in the first manner in the three-dimensional environment includes displaying the first object at a first location in the three-dimensional environment relative to a first predefined portion of the user according to a first coordinate system; and

displaying the first object in the second manner in the three-dimensional environment includes displaying the first object at a second location in the three-dimensional environment relative to a second predefined portion, different from the first predefined portion, of the user according to a second coordinate system, different from the first coordinate system.

21 . The non-transitory computer readable storage medium of claim 19 , wherein:

detecting that the first event has occurred includes detecting movement of the viewpoint of the user relative to the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when the movement of the viewpoint of the user exceeds a threshold movement.

22 . The non-transitory computer readable storage medium of claim 19 , wherein:

detecting that the first event has occurred includes initiating countdown of a timer associated with the display of the first object in the first manner in the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when the countdown reaches an end of the timer.

23 . The non-transitory computer readable storage medium of claim 19 , wherein:

detecting that the first event has occurred includes detecting movement of a gaze of the user in the three-dimensional environment; and

the one or more criteria include a criterion that is satisfied when, after the movement of the gaze of the user, the gaze of the user is directed to a target other than the first object in the three-dimensional environment.

24 . The non-transitory computer readable storage medium of claim 19 , wherein the method further comprises:

while displaying the first object in the second manner in the three-dimensional environment in accordance with the determination that the first event satisfies the one or more criteria in response to detecting that the first event has occurred, detecting that a second event has occurred; and

in response to detecting that the second event has occurred and in accordance with a determination that the second event satisfies one or more second criteria, redisplaying, via the display, the first object in the first manner in the three-dimensional environment relative to the viewpoint of the user.

25 . The non-transitory computer readable storage medium of claim 24 , wherein:

detecting that the first event has occurred includes detecting movement of the viewpoint of the user from a first viewpoint to a second viewpoint that exceeds a threshold movement; and

the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes detecting movement of the viewpoint of the user back to the first viewpoint.

26 . The non-transitory computer readable storage medium of claim 24 , wherein:

the first object is displayed with a plurality of selectable options in the three-dimensional environment;

detecting that the first event has occurred includes receiving, via one or more input devices, a selection of a first option of the plurality of selectable options; and

the one or more second criteria include a criterion that is satisfied when detecting that the second event has occurred includes receiving a selection of a second option of the plurality of selectable options.

27 . The non-transitory computer readable storage medium of claim 19 , wherein:

displaying the first object in the first manner in the three-dimensional environment includes displaying the first object with a first locked orientation in the three-dimensional environment; and

displaying the first object in the second manner in the three-dimensional environment includes displaying the first object with a second locked orientation, different from the first locked orientation, in the three-dimensional environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2024
From: BURGNER, PETER; LUTTER, GREGORY; CLEMENT, MANUEL C.; YANG, IN YOUNG; SALTER, THOMAS G.; SPARKS, LEE; UNPINGCO, ALESHA
To: APPLE INC.
Reel/Frame 067314/0374 →
Continuity (2)
Provisional Application 63386871 · Dec 9, 2022
Related Publication 20240192773A1 · Jun 13, 2024
References Cited (36)
US 10289207B1 · Sainty · 2019 [cited by applicant]
US 10901505B1 · Haine et al. · 2021 [cited by applicant]
US 10993612B1 · Abou Shousha et al. · 2021 [cited by applicant]
US 11094106B2 · Tamaoki et al. · 2021 [cited by applicant]
US 11651563B1 · Arsan et al. · 2023 [cited by applicant]
US 20130241925A1 · Kawana et al. · 2013 [cited by applicant]
US 20130336629A1 · Mulholland · 2013 [cited by examiner]
US 20140267419A1 · Ballard · 2014 [cited by examiner]
US 20140347390A1 · Poulos · 2014 [cited by examiner]
US 20160026242A1 · Burns · 2016 [cited by examiner]
US 20170046881A1 · Kuribara · 2017 [cited by applicant]
US 20170052595A1 · Poulos · 2017 [cited by examiner]
US 20170329480A1 · Ishikawa et al. · 2017 [cited by applicant]
US 20180143693A1 · Calabrese · 2018 [cited by examiner]
US 20190088020A1 · Fukazawa et al. · 2019 [cited by applicant]
US 20190158818A1 · Ho et al. · 2019 [cited by applicant]
US 20190244416A1 · Tamaoki · 2019 [cited by examiner]
US 20200051304A1 · Choi et al. · 2020 [cited by applicant]
US 20200218072A1 · Inatani et al. · 2020 [cited by applicant]
US 20200233487A1 · Grzesiak · 2020 [cited by examiner]
US 20200286299A1 · Wang et al. · 2020 [cited by applicant]
US 20200365117A1 · Dumas et al. · 2020 [cited by applicant]
US 20210239988A1 · Kobayashi · 2021 [cited by applicant]
US 20220139041A1 · Li et al. · 2022 [cited by applicant]
US 20220291744A1 · Sugihara et al. · 2022 [cited by applicant]
US 20230005098A1 · Aoki et al. · 2023 [cited by applicant]
US 20230236674A1 · Morikawa et al. · 2023 [cited by applicant]
US 20230343028A1 · Nair et al. · 2023 [cited by applicant]
US 20240192772A1 · Lutter et al. · 2024 [cited by applicant]
US 20240193892A1 · Lutter et al. · 2024 [cited by applicant]
US 20240212268A1 · Meno · 2024 [cited by applicant]
“How can I get a 3d object to always face player/camera?”, Unreal Engine Forums, Epic Games, Inc., May 2014 [online]. Retrieved from <https://forums.unrealengine.com/t/how-can-i-get-a-3d-object-to-always-face-player-cam… [cited by applicant]
“Rotate object to look at camera using Realitykit Look(at) is broken”, Apple Developer Forums, Apple Inc., Aug. 2020 [online]. Retrieved from <https://developer.apple.com/forums/thread/656611>, [retrieved on Mar. 10, 20… [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/523,024, mailed on Jul. 2, 2025, 14 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/522,953, mailed on Apr. 2, 2025, 33 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 18/522,953, mailed on Jul. 16, 2025, 37 pages. [cited by applicant]