IP Library › Granted Patent US 12,608,450
Granted Patent B2
US 12,608,450 · App. 18/088,297 · Granted Apr 21, 2026

Controlling generation of objects

Inventors: Scott R. Jones (San Rafael, CA); Ronald V. Siy (San Francisco, CA)
Assignee: Apple Inc.
G06F21/16G06F21/10G06T19/006G06F2221/2141
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,608,450
App. No.
18/088,297
Filed
Dec 23, 2022
Granted
Apr 21, 2026
Kind
B2
Art Unit
2453
USPC
726/26
Abstract

Various implementations disclosed herein include devices, systems, and methods for using markers to inform the creation of graphical objects that represent objects. In some implementations, a method includes obtaining an image comprising a two-dimensional (2D) representation of an object. A request is obtained to utilize the image to generate a three-dimensional (3D) object that represents the object. The method includes determining whether the object is associated with a marker indicating reproducible aspect(s) of the object.

Claims (44)

1 . A method comprising:

at a device including a display, a non-transitory memory, and one or more processors coupled with the non-transitory memory:

obtaining an image comprising a two-dimensional (2D) representation of an object;

obtaining a request to utilize the image to generate a three-dimensional (3D) object that represents the object, the request identifying the 2D representation in the image as a target for the generation of the 3D object;

determining, based on the image, whether the 2D representation of the object is marked with a marker, the marker encoding a restriction on generating the 3D object that represents the object; and

in response to determining that the object is marked with the marker, generating the 3D object that represents the object, wherein the marker marking the 2D representation of the object is removed from the generated 3D object.

2 . The method of claim 1 , wherein the object is a physical object.

3 . The method of claim 1 , wherein the device comprises an image sensor and wherein obtaining the image comprises capturing the image via the image sensor of the device.

4 . The method of claim 1 , wherein obtaining the image comprises retrieving the image from a datastore.

5 . The method of claim 1 , wherein the object comprises a virtual object that is displayed in a graphical environment; and

wherein obtaining the image comprises capturing a screenshot of the virtual object.

6 . The method of claim 1 , wherein the marker comprises an optical machine-readable representation of data.

7 . The method of claim 1 , wherein the marker comprises 3D visual content.

8 . The method of claim 1 , wherein the marker comprises a quick response (QR) code.

9 . The method of claim 1 , wherein the marker comprises a watermark.

10 . The method of claim 1 , further comprising:

obtaining a user input corresponding to an unlock code; and

in response to obtaining the user input corresponding to the unlock code, generating the 3D object that represents the object.

11 . The method of claim 1 , wherein the image is associated with depth data of the object represented by the 2D representation.

12 . The method of claim 11 , wherein generating the 3D object comprises generating the 3D object using the depth data.

13 . The method of claim 1 , further comprising:

displaying the 3D object on the display.

14 . The method of claim 1 , wherein the marker comprises at least one of an icon, logo, token, glyph, or a fluorescent ink-printed machine-readable representation of data.

15 . A device comprising:

one or more processors;

a non-transitory memory; and

one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:

obtain an image comprising a two-dimensional (2D) representation of an object;

obtain a request to utilize the image to generate a three-dimensional (3D) object that represents the object, the request identifying the 2D representation in the image as a target for the generation of the 3D object;

determine, based on the image, whether the 2D representation of the object is marked with a marker, the marker encoding a restriction on generating the 3D object that represents the object; and

in response to determining that the object is marked with the marker, generate the 3D object that represents the object, wherein the marker marking the 2D representation of the object is removed from the generated 3D object.

16 . The device of claim 15 , wherein the marker comprises an optical machine-readable representation of data.

17 . The device of claim 15 , wherein the one or more programs further cause the device to:

obtaining a user input corresponding to an unlock code; and

in response to obtaining the user input corresponding to the unlock code, generating the 3D object that represents the object.

18 . A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device, cause the device to:

obtain an image comprising a two-dimensional (2D) representation of an object;

obtain a request to utilize the image to generate a three-dimensional (3D) object that represents the object, the request identifying the 2D representation in the image as a target for the generation of the 3D object;

determine, based on the image, whether the 2D representation of the object is marked with a marker, the marker encoding a restriction on generating the 3D object that represents the object; and

in response to determining that the object is marked with the marker, generate the 3D object that represents the object, wherein the marker marking the 2D representation of the object is removed from the generated 3D object.

19 . The non-transitory memory of claim 18 , wherein the one or more programs further cause the device to:

obtain a user input corresponding to an unlock code; and

in response to obtaining the user input corresponding to the unlock code, generate the 3D object that represents the object.

20 . The non-transitory memory of claim 18 , wherein the marker comprises an optical machine-readable representation of data.

Continuity (3)
Continuation PCTUS2021036173 · Jun 7, 2021
Provisional Application 63046083 · Jun 30, 2020
Related Publication 20230185887A1 · Jun 15, 2023
References Cited (33)
US 11182576B1 · Bhushan · 2021 [cited by examiner]
US 11531992B2 · Ritchie · 2022 [cited by examiner]
US 11776220B1 · Jones · 2023 [cited by examiner]
US 12265605B2 · Lerch · 2025 [cited by examiner]
US 12442915B1 · Cohen · 2025 [cited by examiner]
US 20130215148A1 · Antonyuk · 2013 [cited by examiner]
US 20140176609A1 · Gotoda · 2014 [cited by examiner]
US 20150163345A1 · Cornaby et al. · 2015 [cited by applicant]
US 20150220291A1 · Tapley · 2015 [cited by examiner]
US 20150262412A1 · Gruber · 2015 [cited by examiner]
US 20160078683A1 · Sudol et al. · 2016 [cited by applicant]
US 20160371804A1 · Yun · 2016 [cited by examiner]
US 20170164928A1 · Oh · 2017 [cited by examiner]
US 20170213320A1 · Yücer · 2017 [cited by examiner]
US 20170352172A1 · Lim · 2017 [cited by examiner]
US 20180012394A1 · Averianov · 2018 [cited by examiner]
US 20180051982A1 · Yin · 2018 [cited by examiner]
US 20180276882A1 · Harviainen · 2018 [cited by examiner]
US 20190130689A1 · Baumgarte · 2019 [cited by examiner]
US 20190311341A1 · Rice · 2019 [cited by applicant]
US 20200051280A1 · Urban · 2020 [cited by examiner]
US 20200094992A1 · Hoover · 2020 [cited by examiner]
US 20200242648A1 · Glazier · 2020 [cited by examiner]
US 20200250878A1 · Komissarov · 2020 [cited by examiner]
US 20200410763A1 · Hare · 2020 [cited by examiner]
US 20220138913A1 · Huang · 2022 [cited by examiner]
US 20250050421A1 · Buller · 2025 [cited by examiner]
US 20250336037A1 · Baucum · 2025 [cited by examiner]
CN 105378792A · 2016 [cited by applicant]
CN 106471542A · 2017 [cited by applicant]
CN 117897675A · 2024 [cited by examiner]
PCT International Search Report and Written Opinion dated Sep. 9, 2021, PCT International Application No. PCT/US2021/036173, pp. 1-11. [cited by applicant]
Office Action for corresponding Chinese Appl. No. 202180046738.X dated Jan. 28, 2026 (translation of search report only). [cited by applicant]