IP Library Granted Patent US 12,374,067
Granted Patent B2
US 12,374,067 · App. 18/189,682 · Granted Jul 29, 2025

Layered clothing that conforms to an underlying body and/or clothing layer

Inventors: Sergei Makeev (Foster City, CA); Satheesh Ganapathi Subramanian (San Ramon, CA); David B. Baszucki (Portola Valley, CA)
Assignee: Roblox Corporation
G06T19/20A63F13/52A63F2300/66G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,374,067
App. No.
18/189,682
Granted
Jul 29, 2025
Kind
B2
Abstract

An automated cage-to-cage fitting technique is used to fit arbitrary three-dimensional (3D) geometry to arbitrary target 3D geometry for 3D avatars in a 3D environment, such as an online game. Each graphical representation of items of clothing is provided with an inner cage and with an outer cage. The inner cage of a clothing item (a current layer) is mapped to the outer cage of another clothing item (a previous/underlying layer) that has already been fitted on the 3D avatar. This mapping enables the current layer to conform to the shape of the previous layer. The technique allows any body geometry to be fitted with any clothing geometry, including enabling layers of clothing to be fitted over underlying layer(s) of clothing, thereby providing customization.

Claims (53)

1. A computer-implemented method to provide layered clothing on a three-dimensional (3D) avatar, the method comprising:

identifying a body cage of an avatar body, wherein the body cage includes a plurality of points that envelope the avatar body;

mapping first inner feature points of a first inner cage of a first piece of clothing to the plurality of points of the body cage to deform the first piece of clothing to fit over the avatar body;

identifying a first outer cage of the first piece of clothing that is fitted over the avatar body, the first outer cage comprising first outer feature points that envelope the first piece of clothing and that are separated from the first inner cage of the first piece of clothing by at least a first distance;

mapping second inner feature points of a second inner cage of a second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing to deform the second piece of clothing to fit over the first piece of clothing;

after mapping the second inner feature points, identifying a second outer cage of the second piece of clothing, wherein the second outer cage of the second piece of clothing includes second outer feature points that envelope the second piece of clothing and that are separated from the second inner cage of the second piece of clothing by at least a second distance; and

mapping third inner feature points of a third inner cage of a third piece of clothing to the second outer feature points of the second outer cage of the second piece of clothing to deform the third piece of clothing to fit over the second piece of clothing.

2. The method of claim 1 , wherein:

mapping the second inner feature points of the second inner cage of the second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing maps the second inner cage of the second piece of clothing to the first outer cage of the first piece of clothing.

3. The method of claim 2 , wherein:

the second distance spans between a point in the second outer feature points of the second outer cage of the second piece of clothing and a corresponding point in the second inner feature points of the second inner cage of the second piece of clothing.

4. The method of claim 2 , wherein:

mapping the second inner feature points of the second inner cage of the second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing comprises a n:1 or 1:n mapping of the second inner feature points to the first outer feature points, and

n is an integer greater than or equal to 1.

5. The method of claim 1 , further comprising:

maintaining the first distance between at least one of the first inner feature points of the first inner cage and a corresponding first outer feature point of the first outer feature points of the first outer cage such that a visual appearance of a protrusion surface feature of an outer surface of the first piece of clothing is at least partially preserved when the first piece of clothing is deformed.

6. The method of claim 1 , wherein the second distance is one of a plurality of distinct distances that separate the second outer feature points of the second outer cage of the second piece of clothing from the second inner cage of the second piece of clothing.

7. The method of claim 1 , wherein the first outer cage of the first piece of clothing envelopes a mesh of the first piece of clothing, and wherein the second outer cage of the second piece of clothing envelopes a mesh of the second piece of clothing.

8. A non-transitory computer-readable medium having instructions stored thereon that, responsive to execution by a processor, cause the processor to perform or control performance of operations that comprise:

identifying a body cage of an avatar body, wherein the body cage includes a plurality of points that envelope the avatar body;

mapping first inner feature points of a first inner cage of a first piece of clothing to the plurality of points of the body cage to deform the first piece of clothing to fit over the avatar body;

identifying a first outer cage of the first piece of clothing that is fitted over the avatar body, the first outer cage comprising first outer feature points that envelope the first piece of clothing and that are separated from the first inner cage of the first piece of clothing by at least a first distance;

mapping second inner feature points of a second inner cage of a second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing to deform the second piece of clothing to fit over the first piece of clothing;

after mapping the second inner feature points, identifying a second outer cage of the second piece of clothing, wherein the second outer cage of the second piece of clothing includes second outer feature points that envelope the second piece of clothing and that are separated from the second inner cage of the second piece of clothing by at least a second distance; and

mapping third inner feature points of a third inner cage of a third piece of clothing to the second outer feature points of the second outer cage of the second piece of clothing to deform the third piece of clothing to fit over the second piece of clothing.

9. The non-transitory computer-readable medium of claim 8 , wherein:

mapping the second inner feature points of the second inner cage of the second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing maps the second inner cage of the second piece of clothing to the first outer cage of the first piece of clothing.

10. The non-transitory computer-readable medium of claim 9 , wherein:

the second distance spans between a point in the second outer feature points of the second outer cage of the second piece of clothing and a corresponding point in the second inner feature points of the second inner cage of the second piece of clothing.

11. The non-transitory computer-readable medium of claim 9 , wherein:

mapping the second inner feature points of the second inner cage of the second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing includes a n:1 or 1:n mapping of the second inner feature points to the first outer feature points, and

n is an integer greater than or equal to 1.

12. The non-transitory computer-readable medium of claim 8 , wherein the operations further comprise:

maintaining the first distance between at least one of the first inner feature points of the first inner cage and a corresponding first outer feature point of the first outer feature points of the first outer cage such that a visual appearance of a protrusion surface feature of an outer surface of the first piece of clothing is at least partially preserved when the first piece of clothing is deformed.

13. The non-transitory computer-readable medium of claim 8 , wherein the second distance is one of a plurality of distinct distances that separate the second outer feature points of the second outer cage of the second piece of clothing from the second inner cage of the second piece of clothing.

14. The non-transitory computer-readable medium of claim 8 , wherein the first outer cage of the first piece of clothing envelopes a mesh of the first piece of clothing, and wherein the second outer cage of the second piece of clothing envelopes a mesh of the second piece of clothing.

15. An apparatus, comprising:

a memory having instructions stored therein; and

a processor coupled to the memory, and operable to execute the instructions to cause the processor to perform or control performance of operations that include:

identify a body cage of an avatar body, wherein the body cage includes a plurality of points that envelope the avatar body;

map first inner feature points of a first inner cage of a first piece of clothing to the plurality of points of the body cage to deform the first piece of clothing to fit over the avatar body;

identify a first outer cage of the first piece of clothing that is fitted over the avatar body, the first outer cage comprising first outer feature points that envelope the first piece of clothing and that are separated from the first inner cage of the first piece of clothing by at least a first distance;

map second inner feature points of a second inner cage of a second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing to deform the second piece of clothing to fit over the first piece of clothing;

after mapping the second inner feature points, identifying a second outer cage of the second piece of clothing, wherein the second outer cage of the second piece of clothing includes a second outer feature points that envelope the second piece of clothing and that are separated from the second inner cage of the second piece of clothing by at least a second distance; and

map third inner feature points of a third inner cage of a third piece of clothing to the second outer feature points of the second outer cage of the second piece of clothing to deform the third piece of clothing to fit over the second piece of clothing.

16. The apparatus of claim 15 , wherein:

the operation to map the second inner feature points of the second inner cage of the second piece of clothing to the first outer feature points of the first outer cage of the first piece of clothing maps the second inner cage of the second piece of clothing to the first outer cage of the first piece of clothing.

17. The apparatus of claim 16 , wherein:

the second distance spans between a point in the second outer feature points of the second outer cage of the second piece of clothing and a corresponding point in the second inner feature points of the second inner cage of the second piece of clothing.

18. The apparatus of claim 15 , wherein the operations further comprise:

maintain the first distance between at least one of the first inner feature points of the first inner cage and a corresponding first outer feature point of the first outer feature points of the first outer cage such that a visual appearance of a protrusion surface feature of an outer surface of the first piece of clothing is at least partially preserved when the first piece of clothing is deformed.

19. The apparatus of claim 15 , wherein the second distance is one of a plurality of distinct distances that separate the second outer feature points of the second outer cage of the second piece of clothing from the second inner cage of the second piece of clothing.

20. The apparatus of claim 15 , wherein the first outer cage of the first piece of clothing envelopes a mesh of the first piece of clothing, and wherein the second outer cage of the second piece of clothing envelopes a mesh of the second piece of clothing.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2025
From: MAKEEV, SERGEI; SUBRAMANIAN, SATHEESH GANAPATHI; BASZUCKI, DAVID B.
To: ROBLOX CORPORATION
Reel/Frame 071011/0068 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2023
From: MAKEEV, SERGEI; SUBRAMANIAN, SATHEESH GANAPATHI; BASZUCKI, DAVID B.
To: ROBLOX CORPORATION
Reel/Frame 063095/0838 →
Continuity (3)
Continuation 17375066 · Jul 14, 2021
Provisional Application 63161376 · Mar 15, 2021
Related Publication 20230298297A1 · Sep 21, 2023
References Cited (80)
US 11321916B1 · Zhang et al. · 2022 [cited by applicant]
US 20070273711A1 · Maffei · 2007 [cited by applicant]
US 20100321386A1 · Lin et al. · 2010 [cited by applicant]
US 20120075340A1 · DeRose · 2012 [cited by examiner]
US 20130034276A1 · Hibbard · 2013 [cited by applicant]
US 20130057544A1 · Oh · 2013 [cited by applicant]
US 20140267268A1 · Tipton · 2014 [cited by applicant]
US 20150029198A1 · Sumner et al. · 2015 [cited by applicant]
US 20160163103A1 · DeTemmerman · 2016 [cited by examiner]
US 20160171296A1 · Ikenoue · 2016 [cited by applicant]
US 20160284018A1 · Adeyoola et al. · 2016 [cited by applicant]
US 20160379419A1 · Khalili et al. · 2016 [cited by applicant]
US 20170032579A1 · Eisemann et al. · 2017 [cited by applicant]
US 20170161948A1 · Hua et al. · 2017 [cited by applicant]
US 20180315254A1 · Grant et al. · 2018 [cited by applicant]
US 20190035149A1 · Chen et al. · 2019 [cited by applicant]
US 20190088033A1 · Kuchibotla et al. · 2019 [cited by applicant]
US 20190362529A1 · Wedig et al. · 2019 [cited by applicant]
US 20190371080A1 · Sminchisescu et al. · 2019 [cited by applicant]
US 20200035010A1 · Kim et al. · 2020 [cited by applicant]
US 20210082179A1 · Fedyukov et al. · 2021 [cited by applicant]
US 20210150806A1 · Guler et al. · 2021 [cited by applicant]
US 20210224765A1 · Siddique et al. · 2021 [cited by applicant]
US 20220035443A1 · Winold et al. · 2022 [cited by applicant]
US 20220292791A1 · Makeev et al. · 2022 [cited by applicant]
EP 3029635 · 2016 [cited by applicant]
JP 2003103047 · 2003 [cited by applicant]
JP 2016110652 · 2016 [cited by applicant]
KR 1020190070884 · 2019 [cited by applicant]
KR 1020190118213 · 2019 [cited by applicant]
“APB: Creating a Powerful Customisation System for a Persistent Online Action Game”, Retrieved from Internet: https://macropolygon.files.wordpress.com/2010/08/apb_customisation_gdc2010.pptx, 2010, 49 pages. [cited by applicant]
“RBF Character Conversion”, Retrieved from Internet: http://www.polygon.me/2018/08/rbf-character-conversion.html, Aug. 9, 2018, 3 pages. [cited by applicant]
Agafonkin, “Edgebreaker, the heart of Google Draco”, Retrieved from Internet: https://observablehq.com/@mourner/edgebreaker-the-heart-of-google-draco, Oct. 16, 2019, 9 pages. [cited by applicant]
Anjyo, et al., “Scattered Data Interpolation for Computer Games”, Siggraph 2014 Course Notes, 2014, 69 pages. [cited by applicant]
Appleby, et al., “Punching Above Your Weight: Small Art Teams, Big Games”, Video; retrieved from Internet: https://www.gdcvault.com/play/1014359/Punching-Above-Your-Weight-Small, 2011, 4 pages. [cited by applicant]
Bailey, et al., “Fast and deep deformation approximations”, ACM Transactions on Graphics, vol. 37, Issue 4, Aug. 2018, 12 pages. [cited by applicant]
Barak, “Adaptive Clothing System in Kingdom Come: Deliverance”, Retrieved from Internet: https://www.gdcvault.com/play/1022822/Adaptive-Clothing-System-in-Kingdom; see also video at: https://www.gdcvault.com/play/102277… [cited by applicant]
Botsch, et al., “Real-Time Shape Editing using Radial Basis Functions”, Eurographics 2005, vol. 24, No. 3, 2005, 11 pages. [cited by applicant]
De Goes, et al., “Mesh Wrap based on Affine-Invariant Coordinates”, ACM SIGGRAPH 2019 Talks, 2019, 2 pages. [cited by applicant]
Desbrun, et al., “Implicit Fairing of Irregular Meshes using Diffusion and Curvature Flow”, Siggraph '99: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, Jul. 1999, 8 pages. [cited by applicant]
Feng, et al., “Avatar Reshaping and Automatic Rigging Using a Deformable Model”, Proceedings of the 8th ACM Siggraph Conference on Motion in Games, 2015, 8 pages. [cited by applicant]
Fortier, “Universal Character System in Saints Row 2”, Video; retrieved from Internet: https://www.gdcvault.com/play/1289/Universal-Character-System-in-SAINTS, 2009, 3 pages. [cited by applicant]
Gagliardi, et al., “A Two-Step Mesh Adaption Tool Based on RBF with application to Turbomachinery Optimization Loops”, Evolutionary and Deterministic Methods for Design Optimization and Control With Applications to Indu… [cited by applicant]
Godard, “Plugin and Nodal Demo Reel 2016”, Video; retrieved from Internet: https://vimeo.com/166291982#t=3m33s, 2016, 3 pages. [cited by applicant]
Kim, et al., “GeoFilter: Geometric Selection of Mesh Filter Parameters”, Eurographics, Computer Graphics Forum, available at https://faculty.cc.gatech.edu/˜jarek/papers/GeoFilter.pdf, Jan. 31, 2005, 8 pages. [cited by applicant]
Lalleve, et al., “Character Pipeline and Customization System for ‘Far Cry Primal’”, Retrieved from Internet: https://www.gdcvault.com/play/1024578/Character-Pipeline-and-Customization-System, 2017, 104 pages. [cited by applicant]
Li, et al., “Fitting 3D garment models onto individual human models”, Computers and Graphics 34, 2010, pp. 742-755. [cited by applicant]
Nair, “Innovations in The Sims 4 Character Creator”, Retrieved from Internet: https://www.gdcvault.com/play/1022086/Innovations-in-The-Sims-4, 2015, 89 pages. [cited by applicant]
Niu, et al., “Radial basis function mesh deformation based on dynamic control points”, Aerospace Science and Technology 64; retrieved from Internet: https://dacemirror.sci-hub.tw/journal-article/b485b3a622b0953d5a8c898a… [cited by applicant]
Rossignac, “Edgebreaker: Connectivity compression for triangle meshes”, GVU Technical Report GIT-GVU-98-35, IEEE Transactions on Visualization and Computer Graphics, Jan.-Mar. 1999, 15 pages. [cited by applicant]
Schiffmann, “RBF Interpolation for Mesh Deformation”, Retrieved from Internet: https://imsc.uni-graz.at/haasegu/Lectures/GPU_CUDA/WS16/2016-11-03-HPC1-Schiffmann-RBF.pdf, 2016, 12 pages. [cited by applicant]
Selim MM, et al., “Mesh Deformation Approaches—A Survey”, J. Phys. Math., vol. 7, Issue 2, 2016, 9 pages. [cited by applicant]
Shepherd, “Building Customizable Characters for Bungie's Destiny”, Video; retrieved from Internet: https://www.gdcvault.com/play/1020412/Building-Customizable-Characters-for-Bungie, 2014, 4 pages. [cited by applicant]
Stokan, “Ultimate Customization in Character Creation—Challenges and Innovations”, Video; retrieved from Internet: https://www.gdcvault.com/play/1014370/Ultimate-Customization-in-Character-Creation, 2011, 4 pages. [cited by applicant]
Taubin, “A Signal Processing Approach To Fair Surface Design”, Siggraph '95: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, Sep. 1995, 8 pages. [cited by applicant]
Torok, et al., “REDengine 3 Character Pipeline”, Retrieved from Internet: http://fileserv.polter.pl/1594-CDPRED_SIGGRAPH.pdf, 2013, 53 pages. [cited by applicant]
USPTO, Written Opinion for International Patent Application No. PCT/US2022/046523, Feb. 8, 2023, 11 pages. [cited by applicant]
USPTO, International Search Report for International Patent Application No. PCT/US2022/046523, Feb. 8, 2023, 2 pages. [cited by applicant]
USPTO, International Search Report for International Patent Application No. PCT/US2022/046528, Jan. 31, 2023, 2 pages. [cited by applicant]
USPTO, Written Opinion for International Patent Application No. PCT/US2022/046528, Jan. 31, 2023, 6 pages. [cited by applicant]
USPTO, Written Opinion for International Patent Application No. PCT/US2022/015246, May 11, 2022, 12 pages. [cited by applicant]
USPTO, International Search Report for International Patent Application No. PCT/US2022/015246, May 11, 2022, 2 pages. [cited by applicant]
USPTO, Non-final Office Action for U.S. Appl. No. 17/375,066, May 24, 2022, 15 pages. [cited by applicant]
USPTO, Notice of Allowance for U.S. Appl. No. 17/375,066, Nov. 8, 2022, 9 pages. [cited by applicant]
Vaisse, “Ubisoft Cloth Simulation: Performance Postmortem and Journey from C++ to Computer Shaders”, Retrieved from Internet: https://www.gdcvault.com/play/1022421/Ubisoft-Cloth-Simulation-Performance-Postmortem, 2015, … [cited by applicant]
Wang, et al., “Delaunay graph-based moving mesh method with damping functions”, Chinese Journal of Aeronautics, vol. 31, Issue 11, Nov. 2018, pp. 2093-2103. [cited by applicant]
Wang, et al., “Mesh deformation on 3D complex configurations using multistep radial basis functions interpolation”, Chinese Journal of Aeronautics, 31(4), 2018, pp. 660-671. [cited by applicant]
“EPO”, Extended European Search Report (EESR), Application No. 22771894.7, Jan. 27, 2025, 8 pages. [cited by applicant]
“Final Office Action cited in U.S. Appl. No. 17/965,247”, Sep. 26, 2024, 19 Pages. [cited by applicant]
“Japanese Notice of Allowance in Japanese Application No. 2024-521295”, Feb. 18, 2025, 5 Pages. [cited by applicant]
“Japanese Notice of Allowance in JP Application No. 2024-520607”, Feb. 18, 2025, 5 pages. [cited by applicant]
“Japanese Office Action in JP Application No. 2023-556822”, Sep. 9, 2024, 12 Pages. [cited by applicant]
“Non-Final Office Action in U.S. Appl. No. 17/965,247”, Jan. 16, 2025, 13 Pages. [cited by applicant]
“Notice of Allowance in U.S. Appl. No. 17/965,213”, Aug. 22, 2024, 8 Pages. [cited by applicant]
“Radial Basis Functions Mesh Morphing—A Comparison Between the Bi-harmonic Spline and the Wendland C2 Radial Function”, 20th International Conference on Computational Science—ICCS 2020, Springer, DOI:10.1007/978-3-030-5… [cited by applicant]
“SMPLicit: Topology-aware Generative Model for Clothed People”, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); arXiv.org (Cornell University); https://arxiv.org/pdf/2103.06871v… [cited by applicant]
USPTO, Non-final Office Action for U.S. Appl. No. 17/965,213, Mar. 11, 2024, 16 pages. [cited by applicant]
USPTO, Non-final Office Action for U.S. Appl. No. 17/965,247, Mar. 22, 2024, 13 pages. [cited by applicant]
Shiyi Huang, “Customized 3D Clothes Modeling for Virtual Try-On System Based on Multiple Kinects”, 2015, 133 pages. [cited by applicant]
“Korean Office Action In Application No. 10-2023-7035187”, Apr. 29, 2025. [cited by applicant]