IP Library Granted Patent US 12,469,309
Granted Patent B2
US 12,469,309 · App. 16/608,591 · Granted Nov 11, 2025

Method of constructing toy models based on an image

Inventor: Keira Czarnota (Beaumaris, AU)
Assignee: EMAGINEER PTY LTD
G06V20/647A63H33/04G06F9/455G06F16/9035G06Q10/0875
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,469,309
App. No.
16/608,591
Granted
Nov 11, 2025
Kind
B2
Abstract

A method of constructing toy models based on an image of a subject present in a still or moving image, comprising: receiving said still or moving image; identifying said subject from the still or moving image; generating an instruction module and required building element list to construct a toy model of said subject; comparing the required building element list against an inventory of building elements held by a user; wherein if the inventory of building elements held by the user is insufficient to contain the required building element list, providing a list of missing building elements to the user; if the inventory of building elements held by the user is sufficient to contain the required building element list, producing the instruction module and the required building element list to the registered user to create the model of the subject.

Claims (27)

1 . A method of generating instructions for creating a toy model of a subject present in a digital image, the method comprising:

receiving the digital image of the subject in a computer system, the computer system comprising a microprocessor and a non-transitory computer-readable storage medium storing instructions thereon that, when executed by the microprocessor, cause the computer system to:

generate a digital model that mimics an appearance of the subject using the digital image;

receive a size scale of the toy model;

generate a list comprising a calculated number of toy building elements required to construct the toy model of the subject based on the digital model of the subject and the received size scale of the toy model;

generate instructions for building the toy model of the subject using the list of toy building elements required to create the toy model of the subject;

compare the list of toy building elements required to build the toy model of the subject with an inventory list of toy building elements possessed by a user;

determine that the toy building elements represented in the inventory list are insufficient to construct the toy model of the subject based on the comparison of the list of toy building elements required to build the toy model and the inventory list of toy building elements possessed by the user;

determine an alternate digital model that mimics the appearance of the subject, wherein the alternate digital model would allow the toy model to be constructed based on the inventory list of toy building elements possessed by the user and the received size scale of the toy model;

generate alternate instructions for building the toy model and an alternate list of toy building elements required to construct the toy model based on the alternate digital model; and

output the alternate instructions for building the toy model of the subject and the alternate list of required toy building elements required to construct the toy model of the subject to the user.

2 . The method of claim 1 , wherein receiving the digital image of the subject comprises downloading an electronic file containing the digital image of the subject to a remote host service.

3 . The method of claim 1 , wherein generating the digital model of the subject comprises applying image recognition analysis to the digital image to identify the subject present therein.

4 . The method of claim 3 , wherein applying image recognition analysis to the digital image to identify the subject present therein further comprises conducting an on line search of images on the internet.

5 . The method of claim 3 , wherein applying image recognition analysis to the digital image to identify the subject present therein further comprises confirming the identity of the subject with the user.

6 . The method of claim 5 , further comprising searching a database of one or more other model subjects and identifying a list of existing instructions for constructing the one or more other model subjects, wherein the one or more other model subjects are the same as the subject from the digital image or are identified as alternate models within a model database based, at least, on the subject from the digital image.

7 . The method of claim 6 , further comprising selecting instructions for constructing the other model subjects from the list of existing instructions for constructing the other model subjects, the selected instructions are further compared against the inventory list of building elements held by the user to determine if the inventory list of building elements held by the user includes all elements required to build the one or more other model subjects.

8 . The method of claim 1 , further comprising analyzing one or more shapes of the subject to determine the number of building elements required to make a basic predefined shape of the one or more shapes of the subject based on prior data generated through accessing a historical database of instruction lists comprising required building element lists for the one or more shapes.

9 . The method of claim 1 , wherein the inventory of building elements possessed by the user is stored and maintained in a remotely accessible database.

10 . The method of claim 9 , wherein the inventory of building elements possessed by the user is stored and maintained in the remotely accessible database through a method comprising:

creating a user entry in the remotely accessible database;

receiving the inventory list of building elements possessed by the user;

receiving a digital image of a built toy model;

identifying a list of building elements from the digital image of the built toy model;

generating a combined inventory list comprising the list of building elements from the digital image of the built toy model and the inventory of building elements possessed by the user;

storing the combined inventory list in the remotely accessible database; and

updating the combined inventory list each time a digital image of a new built toy model is received.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2022
From: EMMET.AI PTY LTD
To: EMAGINEER PTY LTD
Reel/Frame 059458/0830 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2022
From: EMMET.AI PTY LTD
To: EMMAGINEER PTY LTS
Reel/Frame 059441/0807 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2020
From: CZARNOTA, KEIRA
To: EMMET.AI PTY LTD.
Reel/Frame 052478/0853 →
Priority Claims (2)
AU 2017901510 · Apr 26, 2017 · national
AU 2018900678 · Mar 2, 2018 · national
Continuity (1)
Related Publication 20200184195A1 · Jun 11, 2020
References Cited (28)
US 6004021A · Rothbarth · 1999 [cited by examiner]
US 7092899B2 · Simas · 2006 [cited by examiner]
US 7596473B2 · Hansen et al. · 2009 [cited by applicant]
US 8374829B2 · Jakobsen et al. · 2013 [cited by applicant]
US 9619705B1 · Nordstrom · 2017 [cited by applicant]
US 10007964B1 · Calhoon · 2018 [cited by examiner]
US 20020106135A1 · Iwane · 2002 [cited by applicant]
US 20040236539A1 · Clark et al. · 2004 [cited by applicant]
US 20060136180A1 · Hansen · 2006 [cited by examiner]
US 20080228450A1 · Jakobsen · 2008 [cited by examiner]
US 20100066531A1 · Karr · 2010 [cited by examiner]
US 20140244018A1 · Bach · 2014 [cited by examiner]
US 20140244433A1 · Cruz · 2014 [cited by applicant]
US 20140378022A1 · Muthyala et al. · 2014 [cited by applicant]
US 20170097236A1 · Bender · 2017 [cited by examiner]
US 20170225073A1 · Laulund · 2017 [cited by examiner]
US 20170304732A1 · Velic · 2017 [cited by examiner]
GB 2532075A · 2016 [cited by applicant]
JP 2001283055A · 2001 [cited by examiner]
WO 2016075081A1 · 2016 [cited by applicant]
Schulz et al. “Design and fabrication by example”. ACM Transactions on Graphics vol. 33Issue 4 Jul. 2014 Article No. 62 pp. 1-11. (Year: 2014). [cited by examiner]
Kozaki, Takuya, Hiroshi Tedenuma, and Takashi Maekawa. “Automatic generation of LEGO building instructions from multiple photographic images of real objects.” Computer-aided design 70 (2016): 13-22. (Year: 2016). [cited by examiner]
European Search Report and Opinion for Application No. 18790776.1 dated Sep. 14, 2021, 9 pages. [cited by applicant]
International Written Opinion for International Application No. PCT/AU2018/000061, mailed Aug. 30, 2018, 10 pages. [cited by applicant]
International Search Report for International Application No. PCT/AU2018/000061 mailed Aug. 30, 2018 (6 pages). [cited by applicant]
Australian Examination Report No. 1 for Application No. 2018259150 dated Apr. 17, 2023, 9 pages. [cited by applicant]
Australian Examination Report No. 2 for Application No. 2018259150 dated Mar. 12, 2024, 6 pages. [cited by applicant]
Kozaki et al., Automatic Generation of Lego Building Instructions from Multiple Photographic Images of Real Objects, Computer-Aided Design, vol. 70, (2016), pp. 13-22. [cited by applicant]