IP Library Granted Patent US 12,579,742
Granted Patent B2
US 12,579,742 · App. 18/472,018 · Granted Mar 17, 2026

Devices and methods for generating virtual objects

Inventors: Guillaume Couche (London, GB); Jonny Yeo (London, GB)
Assignee: Apple Inc.
G06T17/00G06F3/04815G06F3/0482G06F3/04842G06T19/00G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,579,742
App. No.
18/472,018
Granted
Mar 17, 2026
Kind
B2
Abstract

Some examples described in this disclosure are directed to devices, methods, and graphical user interfaces for generating, updating, and/or presenting virtual objects in a computer-generated environment. In some examples, an electronic device presents a user interface for generating a virtual object corresponding to the real-world object detected by the electronic device, where the user interface includes selectable options corresponding to respective portions of the real-world object. In some examples, in response to receiving a selection of a first portion of the real-world object, the electronic device updates the user interface and corresponding selectable options according to the first portion of the real-world object.

Claims (41)

1 . A method comprising:

at an electronic device in communication with a display and one or more input devices:

detecting a real-world object;

receiving, via the one or more input devices, a first input including a selection of the real-world object; and

presenting, via the display, a user interface with a plurality of user interface elements for generating a virtual object corresponding to the real-world object detected by the electronic device, wherein the plurality of user interface elements includes a first user interface element contextualized to a first portion of the real-world object and a second user interface element contextualized to a second portion of the real-world object.

2 . The method of claim 1 , wherein the first user interface element corresponds to creating content using a structure of the first portion of the real-world object, and wherein the second user interface element corresponds to creating content using a structure of the second portion of the real-world object.

3 . The method of claim 1 , wherein the first user interface element corresponds to creating content using a material of the first portion of the real-world object, and wherein the second user interface element corresponds to creating content using a material of the second portion of the real-world object.

4 . The method of claim 1 , further comprising:

receiving, via the one or more input devices, a second input including a selection of the first user interface element or the second user interface element and including movement; and

generating the virtual object having a characteristic corresponding to the real-world object in accordance with the first user interface element or the second user interface element and the movement.

5 . The method of claim 1 , wherein the plurality of user interface elements comprises a third user interface element that corresponds to creating the virtual object based on the real-world object such that the virtual object comprises at least one characteristic different than the real-world object and at least one characteristic similar to the real-world object.

6 . The method of claim 5 , wherein the third user interface element is contextualized to the real-world object, including the first portion of the real-world object and the second portion of the real-world object.

7 . The method of claim 5 , wherein the third user interface element is not contextualized to the real-world object.

8 . The method of claim 1 , further comprising:

detecting a second real-world object;

receiving, via the one or more input devices, a second input including a selection of the second real-world object; and

presenting, via the display, the user interface with the plurality of user interface elements for generating the virtual object corresponding to the second real-world object detected by the electronic device, wherein the plurality of user interface elements includes the first user interface element contextualized to a first portion of the second real-world object and the second user interface element contextualized to a second portion of the second real-world object.

9 . An electronic device, comprising:

a display;

wherein the electronic device is in communication with one or more input devices, and wherein the electronic device further comprises one or more processors configured to perform a method comprising:

detecting a real-world object;

receiving, via the one or more input devices, a first input including a selection of the real-world object; and

presenting, via the display, a user interface with a plurality of user interface elements for generating a virtual object corresponding to the real-world object detected by the electronic device, wherein the plurality of user interface elements includes a first user interface element contextualized to a first portion of the real-world object and a second user interface element contextualized to a second portion of the real-world object.

10 . The electronic device of claim 9 , wherein the first user interface element corresponds to creating content using a structure of the first portion of the real-world object, and wherein the second user interface element corresponds to creating content using a structure of the second portion of the real-world object.

11 . The electronic device of claim 9 , wherein the first user interface element corresponds to creating content using a material of the first portion of the real-world object, and wherein the second user interface element corresponds to creating content using a material of the second portion of the real-world object.

12 . The electronic device of claim 9 , wherein the method further comprises:

receiving, via the one or more input devices, a second input including a selection of the first user interface element or the second user interface element and including movement; and

generating the virtual object having a characteristic corresponding to the real-world object in accordance with the first user interface element or the second user interface element and the movement.

13 . The electronic device of claim 9 , wherein the plurality of user interface elements comprises a third user interface element that corresponds to creating the virtual object based on the real-world object such that the virtual object comprises at least one characteristic different than the real-world object and at least one characteristic similar to the real-world object.

14 . The electronic device of claim 13 , wherein the third user interface element is contextualized to the real-world object, including the first portion of the real-world object and the second portion of the real-world object.

15 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device that is in communication with a display and one or more input devices, cause the electronic device to perform a method comprising:

detecting a real-world object;

receiving, via the one or more input devices, a first input including a selection of the real-world object; and

presenting, via the display, a user interface with a plurality of user interface elements for generating a virtual object corresponding to the real-world object detected by the electronic device, wherein the plurality of user interface elements includes a first user interface element contextualized to a first portion of the real-world object and a second user interface element contextualized to a second portion of the real-world object.

16 . The non-transitory computer readable storage medium of claim 15 , wherein the first user interface element corresponds to creating content using a structure of the first portion of the real-world object, and wherein the second user interface element corresponds to creating content using a structure of the second portion of the real-world object.

17 . The non-transitory computer readable storage medium of claim 15 , wherein the first user interface element corresponds to creating content using a material of the first portion of the real-world object, and wherein the second user interface element corresponds to creating content using a material of the second portion of the real-world object.

18 . The non-transitory computer readable storage medium of claim 15 , wherein the method further comprises:

receiving, via the one or more input devices, a second input including a selection of the first user interface element or the second user interface element and including movement; and

generating the virtual object having a characteristic corresponding to the real-world object in accordance with the first user interface element or the second user interface element and the movement.

19 . The non-transitory computer readable storage medium of claim 15 , wherein the plurality of user interface elements comprises a third user interface element that corresponds to creating the virtual object based on the real-world object such that the virtual object comprises at least one characteristic different than the real-world object and at least one characteristic similar to the real-world object.

20 . The non-transitory computer readable storage medium of claim 19 , wherein the third user interface element is contextualized to the real-world object, including the first portion of the real-world object and the second portion of the real-world object.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ATTORNEY DOCKET NUMBER THAT WAS INADVERTENTLY OMITTED PREVIOUSLY RECORDED ON REEL 064989 FRAME 0729. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 19, 2023
From: COUCHE, GUILLAUME; YEO, JONNY
To: APPLE INC.
Reel/Frame 065288/0176 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2023
From: COUCHE, GUILLAUME; YEO, JONNY
To: APPLE INC.
Reel/Frame 064989/0729 →
Continuity (2)
Provisional Application 63377032 · Sep 24, 2022
Related Publication 20240103683A1 · Mar 28, 2024
References Cited (26)
US 10453259B2 · Abe · 2019 [cited by examiner]
US 11120639B1 · Smith et al. · 2021 [cited by applicant]
US 11615579B1 · Thivierge · 2023 [cited by applicant]
US 12151162B2 · Mahlmeister · 2024 [cited by examiner]
US 12153737B2 · Ramani · 2024 [cited by examiner]
US 12288279B2 · Brandt · 2025 [cited by examiner]
US 12301930B2 · Liu · 2025 [cited by examiner]
US 12315090B1 · Suresh · 2025 [cited by examiner]
US 12353632B2 · Hwang · 2025 [cited by examiner]
US 20100185529A1 · Chesnut · 2010 [cited by examiner]
US 20130044128A1 · Liu · 2013 [cited by examiner]
US 20130335405A1 · Scavezze · 2013 [cited by examiner]
US 20150009130A1 · Motta et al. · 2015 [cited by applicant]
US 20160225164A1 · Tomlin · 2016 [cited by examiner]
US 20170270224A1 · Singh et al. · 2017 [cited by applicant]
US 20180173300A1 · Schwarz · 2018 [cited by examiner]
US 20210134066A1 · Koidahl · 2021 [cited by examiner]
US 20220084279A1 · Lindmeier et al. · 2022 [cited by applicant]
US 20230230333A1 · Kawamae · 2023 [cited by examiner]
US 20230386145A1 · Faulkner · 2023 [cited by applicant]
US 20240104841A1 · Couche et al. · 2024 [cited by applicant]
US 20240211092A1 · Loggins · 2024 [cited by examiner]
US 20240378801A1 · Rivas Vetencourt · 2024 [cited by examiner]
“Scanning and Detecting 3D Objects”, Apple Developer [online]. Apple Inc. 2024 [retrieved on Apr. 18, 2024]. Retrieved from the Internet: <URL: https://developer.apple.com/documentation/arkit/arkit_in_ios/content_anchor… [cited by applicant]
Bobeshko, Anastasiia “Object Recognition in Augmented Reality”, Medium [online]. Medium [retrieved on Apr. 18, 2024]. Retrieved from the Internet: <https://virtualrealitypop.com/object-recognition-in-augmented-reality-8… [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 18/472,008, mailed on May 21, 2025, 15 pages. [cited by applicant]