IP Library Granted Patent US 12,423,922
Granted Patent B2
US 12,423,922 · App. 18/053,398 · Granted Sep 23, 2025

Iterative virtual reality modeling amelioration for three-dimensional to-be-printed objects and virtual reality filament sections

Inventors: Zachary A. Silverstein (Georgetown, TX); Jeremy R. Fox (Georgetown, TX); Todd Russell Whitman (Bethany, CT); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: International Business Machines Corporation
G06T19/006B29C64/386B33Y50/00G06T19/20G06V10/70G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,423,922
App. No.
18/053,398
Granted
Sep 23, 2025
Kind
B2
Abstract

According to one embodiment, a method, computer system, and computer program product for iteratively improving a virtual model of an object to be printed in a mixed reality environment is provided. The present invention may include rendering the virtual model within the mixed-reality environment; monitoring interactions between a user and the virtual model within the mixed-reality environment; predicting one or more deficiencies in the physical object based on the monitoring; suggesting one or more edits of the virtual model to the user to address the one or more predicted deficiencies; and integrating the one or more edits into the virtual model.

Claims (50)

1. A processor-implemented method for iteratively improving a virtual model of an object to be printed in a mixed reality environment, the method comprising:

rendering the virtual model within the mixed-reality environment;

monitoring interactions between a user and the virtual model within the mixed-reality environment;

predicting one or more deficiencies in the object based on the monitoring;

suggesting, by a machine learning model, one or more edits of the virtual model to the user to address the one or more predicted deficiencies, wherein the one or more edits represent one or more modifications to a structure or material of the object; and

integrating the one or more edits into the virtual model.

2. The method of claim 1 , wherein the predicting is performed by the machine learning model trained on a knowledge corpus.

3. The method of claim 2 , further comprising:

observing one or more interactions between the user and the edited virtual model in the mixed reality environment; and updating the knowledge corpus based on the observing.

4. The method of claim 1 , further comprising:

responsive to a user selection, modifying the virtual model to visually represent a deposition pattern associated with a type of 3D printing process or a model of 3D printer.

5. The method of claim 1 , the rendering comprising:

modifying the mixed-reality environment with one or more virtual elements comprising a usage context associated with the object.

6. The method of claim 1 , further comprising:

printing the object based on the edited virtual model.

7. The method of claim 1 , wherein the virtual model comprises one or more individually manipulable horizontal layers.

8. A computer system for iteratively improving a virtual model of an object to be printed in a mixed reality environment, the computer system comprising:

one or more processors, one or more computer-readable memories, one or more 3D printers, one or more mixed-reality devices, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:

rendering the virtual model within the mixed-reality environment;

monitoring interactions between a user and the virtual model within the mixed-reality environment;

predicting one or more deficiencies in the physical object based on the monitoring;

suggesting, by a machine learning model, one or more edits of the virtual model to the user to address the one or more predicted deficiencies, wherein the one or more edits represent one or more modifications to a structure or material of the object; and

integrating the one or more edits into the virtual model.

9. The computer system of claim 8 , wherein the predicting is performed by the machine learning model trained on a knowledge corpus.

10. The computer system of claim 9 , further comprising:

observing one or more interactions between the user and the edited virtual model in the mixed reality environment; and

updating the knowledge corpus based on the observing.

11. The computer system of claim 8 , further comprising:

responsive to a user selection, modifying the virtual model to visually represent a deposition pattern associated with a type of 3D printing process or a model of 3D printer.

12. The computer system of claim 8 , the rendering comprising:

populating the mixed-reality environment with one or more elements comprising a usage context associated with the object.

13. The computer system of claim 8 , further comprising:

printing the object based on the edited virtual model.

14. The computer system of claim 8 , wherein the virtual model comprises one or more individually manipulable horizontal layers.

15. A computer program product for iteratively improving a virtual model of an object to be printed in a mixed reality environment, the computer program product comprising:

one or more computer-readable tangible storage medium and program instructions stored on at least one of the one or more tangible storage medium, the program instructions executable by a processor to cause the processor to perform a method comprising:

rendering the virtual model within the mixed-reality environment;

monitoring interactions between a user and the virtual model within the mixed-reality environment;

predicting one or more deficiencies in the physical object based on the monitoring;

suggesting, by a machine learning model, one or more edits of the virtual model to the user to address the one or more predicted deficiencies, wherein the one or more edits represent one or more modifications to a structure or material of the object; and

integrating the one or more edits into the virtual model.

16. The computer program product of claim 15 , wherein the predicting is performed by the machine learning model trained on a knowledge corpus.

17. The computer program product of claim 16 , further comprising:

observing one or more interactions between the user and the edited virtual model in the mixed reality environment; and updating the knowledge corpus based on the observing.

18. The computer program product of claim 15 , further comprising:

responsive to a user selection, modifying the virtual model to visually represent a deposition pattern associated with a type of 3D printing process or a model of 3D printer.

19. The computer program product of claim 15 , the rendering comprising:

populating the mixed-reality environment with one or more elements comprising a usage context associated with the object.

20. The computer program product of claim 15 , further comprising:

printing the object based on the edited virtual model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2022
From: SILVERSTEIN, ZACHARY A.; FOX, JEREMY R.; WHITMAN, TODD RUSSELL; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061684/0996 →
Continuity (1)
Related Publication 20240153215A1 · May 9, 2024
References Cited (20)
US 10216738B1 · Cronin · 2019 [cited by applicant]
US 10279543B1 · Woychik · 2019 [cited by examiner]
US 20140336808A1 · Taylor et al. · 2014 [cited by applicant]
US 20180059644A1 · Lection · 2018 [cited by applicant]
US 20180144516A1 · Pri-Tal · 2018 [cited by applicant]
US 20180284692A1 · Kline · 2018 [cited by applicant]
US 20210166486A1 · Kim · 2021 [cited by examiner]
US 20210365108A1 · Burns · 2021 [cited by examiner]
US 20220032548A1 · Goyal · 2022 [cited by applicant]
CN 107443751A · 2017 [cited by applicant]
Ceruti et al., “Augmented vision and interactive monitoring in 3D printing process”, Received: Jul. 5, 2016 / Accepted: Aug. 22, 2016 / Published online: Sep. 3, 2016. (Year: 2016). [cited by examiner]
Wang et al. “Manufacture Assembly Fault Detection Method based on Deep Learning and Mixed Reality” Proceeding of the IEEE International Conference on Information and Automation Wuyi Mountain, China, Aug. 2018, (Year: 20… [cited by examiner]
Baron, “How Digital Twins Will Revolutionize 3D Manufacturing,” All3DP Pro [online], Feb. 26, 2021 [accessed on Jul. 29, 2022], 13 pages, Retrieved from the Internet: <URL: https://all3dp.com/1/digital-twins-in-3d-manuf… [cited by applicant]
Disclosed Anonymously, “A Method and System for Enabling 3D Printing with Feedback and Modification in VR,” IP.com, Apr. 17, 2018, 3 pages, IP.com No. IPCOM000253627D, Retrieved from the Internet: <URL: https://ip.com/I… [cited by applicant]
Kantaros, et al., “3D Printing and Implementation of Digital Twins: Current Trends and Limitations,” Applied System Innovation [journal], 2022, 13 pages, vol. 5, No. 1, Article 7, DOI: 10.3390/asi5010007, Retrieved from… [cited by applicant]
Market Watch, “Virtual and Augmented Reality Market Research (2022-2028): In-Depth Assessment of the Growth and Other Aspects,” Market Watch [press release], Mar. 1, 2022 [accessed on Jul. 19, 2022], 7 pages, Wayback Ma… [cited by applicant]
Markets and Markets, “3D Printing Market Size, Growth, Trend and Forecast to 2023—By MarketsandMarkets,” Markets and Markets [online], Sep. 28, 2018 [accessed on Jul. 19, 2022], 5 pages, Retrieved from the Internet: <UR… [cited by applicant]
Okutani, et al., “Stereoscopic Capture in Projection Mapping,” IEEE Access, 2018, pp. 65894-65900, vol. 6, Digital Object Identifier 10.1109/ACCESS.2018.2875905, Retrieved from the Internet: <URL: https://ieeexplore.iee… [cited by applicant]
Pappu, et al., “Haptic interaction with holographic video images”, Practical Holography XII [book], 1998, pp. 38-45, vol. 3293, SPIE Digital Library, DOI: 10.1117/12.303665, Retrieved from the Internet: <URL: https://do… [cited by applicant]
Screen captures from YouTube video clip entitled “3D Printing from Virtual Reality!,” 4 pages, uploaded on Nov. 1, 2016 by Make Anything, Retrieved from the Internet: <URL: https://www.youtube.com/watch?v=PViW68-hbTM>. [cited by applicant]