IP Library › Granted Patent US 12,230,055
Granted Patent B2
US 12,230,055 · App. 17/669,541 · Granted Feb 18, 2025

Methods for creating personalized items using images associated with a subject and related systems and computers

Inventors: Mike Vaggalis (Raleigh, NC); Erin Burchik (Lilburn, GA); John Petitte (Raleigh, NC); Paulo Rieck (Timbo, BR); Christina Dill (Ocilla, GA); Paulo de Tarso Oliveira da Silva (Macapa, BR)
Assignee: Keepsake Tales Inc.
G06V40/165G06T11/60G06V10/255G06V40/103G06V40/171G06V40/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,230,055
App. No.
17/669,541
Granted
Feb 18, 2025
Kind
B2
Abstract

Methods for creating personalized items using images associated with a subject are provided. The method includes receiving and processing at least one image of a subject; translating the processed at least one image into a personalized illustration having features that substantially resemble features of the subject, wherein translating the processed at least one image comprises extracting a plurality of core shapes from a face of the subject in the at least one image and assembling the extracted plurality of core shapes into a face of the personalized illustration; and manipulating the personalized illustration of the subject for placement in a personalized item such that the manipulated personalized illustration appears as an integral part of an existing template of the personalized item.

Claims (62)

1. A method for creating personalized items using images associated with a subject, the method comprising:

receiving and processing at least one image of the subject;

translating the processed at least one image into a personalized illustration having features that substantially resemble features of the subject, wherein translating the processed at least one image comprises extracting a plurality of core shapes from a face of the subject in the at least one image and assembling the extracted plurality of core shapes into a face of the personalized illustration that is completely different from the received at least one image; and

manipulating the personalized illustration of the subject for placement in a personalized item such that the manipulated personalized illustration appears as an integral part of an existing template of the personalized item,

wherein at least one of receiving, translating and manipulating are performed by at least one processor;

wherein translating comprises translating from the received at least one image to the personalized illustration using one of a vectorized approach and/or a machine learning approach; and

wherein the machine learning approach comprises recognizing different facial features in the received at least one image and matching the recognized different facial features to a correct permutation of pre-created facial assets to provide the personalized illustration.

2. The method of claim 1 , wherein manipulating comprises one or more of:

adjusting emotion of the personalized illustration to reflect a mood of the personalized item;

adjusting a location of the personalized illustration on the personalized item to integrate with the existing template of the personalized item;

aligning the personalized illustration on the personalized item so the personalized illustration is facing in an appropriate direction to integrate with the personalized item; and

adjusting a size of the personalized illustration to match relative sizes of elements depicted on the personalized item.

3. The method of claim 1 , wherein the plurality of core shapes comprise a face shape, a nose shape, eye shapes and/or ear shapes, the method further comprising assembling the extracted plurality of core shapes into the face of the personalized illustration.

4. The method of claim 3 , further comprising customizing at least one of a skin tone of the face, an eye color of the subject and a hair style of the subject.

5. The method of claim 4 , further comprising:

selecting a body type representative of the subject; and

completing the personalized illustration of the subject by associating the face with the selected body type.

6. The method of claim 5 , wherein each aspect of the face and the body type of the personalized illustration is customizable.

7. The method of claim 6 :

wherein the body type comprises one or more of tall, thin, short, wide, in a wheel-chair, having a prosthetic limb, having an orthopedic cast, having crutches and having mobility aids; and

wherein customizing the face comprises one or more of adding cochlear implants, hearing aids, glasses, freckles, cleft palate beauty marks and braces.

8. The method of claim 6 , further comprising customization of the personalized illustration by a user.

9. The method of claim 1 , wherein translating the processed at least one image further comprises:

recognizing the extracted plurality of core shapes from the face of the subject;

matching the recognized extracted plurality of core shapes of the face of the subject to corresponding core shapes in an asset library of existing facial assets; and

assembling the matched core shapes into the face of the personalized illustration.

10. The method of claim 9 , wherein the asset library of existing facial assets is continually updated with more facial assets.

11. The method of claim 1 , wherein the manipulated personalized illustration is highly representative of the subject and is cohesive with a background illustration of the personalized item.

12. The method of claim 1 , wherein the at least one image of the subject is one of a digital photograph or a digital representation of a physical photograph.

13. The method of claim 1 , wherein the personalized item comprises a children's book, a non-children's book, magazine, keychain, phone case, phone grip, mouse, mousepad, laptop case, pillow, bean bag, tableware, drinkware, bottle opener, lunch box/bag, back pack, calendar, greeting card, stationary, invitation, journal, notebook, folder, notepad, stickers, pencil, print, poster, wall art, wall decal, yearbook, woodcut, ornament, keepsake box, jewelry, luggage, tote bag, hat, clothing, blanket, towel, mask, toy, party favor, marketing material and/or electronic image.

14. The method of claim 13 :

wherein the personalized item is a book; and

wherein the personalized illustration is integrated on pages of the book such that the personalized illustration appears as an integral part of the pages of the book.

15. The method of claim 1 , wherein the vectorized approach comprises processing the received at least one image of the subject to extract the core shapes from the face and reassembling associated vectors into the personalized illustration, wherein skin-tone is also extracted from the face in the received at least one image and applied to the personalized illustration automatically.

16. A personalization system for creating personalized items using images associated with a subject, the personalization system comprising:

a non-transitory computer-readable medium;

a processor in communication with the non-transitory computer-readable medium, the processor configured to:

receive and process at least one image of the subject;

translate the processed at least one image into a personalized illustration having features that substantially resemble features of the subject by extracting a plurality of core shapes from a face of the subject in the at least one image and assembling the extracted plurality of core shapes into a face of the personalized illustration that is completely different from the received at least one image; and

manipulate the personalized illustration of the subject for placement in a personalized item such that the manipulated personalized illustration appears as an integral part of an existing template of the personalized item,

wherein the processor is configured to translate from the received at least one image to the personalized illustration using one of a vectorized approach and/or a machine learning approach; and

wherein the machine learning approach comprises recognizing different facial features in the received at least one image and matching the recognized different facial features to a correct permutation of pre-created facial assets to provide the personalized illustration.

17. The personalization system of claim 16 , the processor is further configured to:

adjust emotion of the personalized illustration to reflect a mood of the personalized item;

adjust a location of the personalized illustration on the personalized item to integrate with the existing template of the personalized item;

align the personalized illustration on the personalized item so the personalized illustration is facing in an appropriate direction to integrate with the personalized item; and

adjust a size of the personalized illustration to match relative sizes of elements depicted on the personalized item.

18. The personalization system of claim 16 , wherein the plurality of core shapes comprise at least one of a face shape, a nose shape, eye shapes and ear shapes, the method further comprising assembling the extracted plurality of core shapes into the face of the personalized illustration.

19. The personalization system of claim 16 , further comprising selecting a body type representative of the subject; and

completing the personalized illustration of the subject by associating the face with the selected body type.

20. The personalization system of claim 16 , wherein the processor is further configured to:

recognize the extracted plurality of core shapes from the face of the subject;

match the recognized extracted plurality of core shapes of the face of the subject to corresponding core shapes in an asset library of existing facial assets; and

assemble the matched core shapes into the face of the personalized illustration.

21. A computer for creating and testing voice and/or messaging applications, the computer comprising:

one or more memories;

one or more processors, communicatively coupled to the one or more memories, the one or more processors configured to:

receive and process at least one image of a subject;

translate the processed at least one image into a personalized illustration having features that substantially resemble features of the subject by extracting a plurality of core shapes from a face of the subject in the at least one image and assembling the extracted plurality of core shapes into a face of the personalized illustration that is completely different from the received at least one image; and

manipulate the personalized illustration of the subject for placement in a personalized item such that the manipulated personalized illustration appears as an integral part of an existing template of the personalized item,

wherein the one or more processors are configured to translate from the received at least one image to the personalized illustration using one of a vectorized approach and/or a machine learning approach; and

wherein the machine learning approach comprises recognizing different facial features in the received at least one image and matching the recognized different facial features to a correct permutation of pre-created facial assets to provide the personalized illustration.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2025
From: KEEPSAKE TALES INC.
To: VAGGALIS, MIKE; BURCHIK, ERIN
Reel/Frame 073372/0187 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2022
From: VAGGALIS, MIKE; BURCHIK, ERIN; PETITTE, JOHN; RIECK, PAULO; DILL, CHRISTINA; DE TARSO OLIVEIRA DA SILVA, PAULO
To: KEEPSAKE TALES INC.
Reel/Frame 059530/0615 →
Continuity (2)
Provisional Application 63148345 · Feb 11, 2021
Related Publication 20220254188A1 · Aug 11, 2022
References Cited (15)
US 20080215964A1 · Abrams et al. · 2008 [cited by applicant]
US 20080215985A1 · Batchelder et al. · 2008 [cited by applicant]
US 20120066573A1 · Berger et al. · 2012 [cited by applicant]
US 20130145240A1 · Anderson et al. · 2013 [cited by applicant]
US 20150143209A1 · Sudai · 2015 [cited by examiner]
US 20160070952A1 · Kim · 2016 [cited by examiner]
US 20180018819A1 · Hwang · 2018 [cited by examiner]
US 20180047200A1 · O'Hara · 2018 [cited by examiner]
WO WO2020150686A1 · 2020 [cited by examiner]
WO WO2020150691A1 · 2020 [cited by examiner]
WO WO2020150692A1 · 2020 [cited by examiner]
Recurrent Neural Networks for Emotion Recognition in Video, Samira Ebrahimi Kahou et al., ACM, 2015, pp. 467-474 (Year: 2015). [cited by examiner]
EmotionCues: Emotion-Oriented Visual Summarization of Classroom Videos, Haipeng Zeng et al., IEEE, 2019, pp. 3168-3181 (Year: 2019). [cited by examiner]
Avatar Digitization From a Single Image For Real-Time Rendering, Liwen Hu et al., ACM, 2017, pp. 195:1-195:14, (Year: 2017). [cited by examiner]
International Search Report and Written Opinion, PCT/US2022/016063, May 19, 2022, 8 pages. [cited by applicant]