IP Library Granted Patent US 12,656,756
Granted Patent B2
US 12,656,756 · App. 18/057,782 · Granted Jun 16, 2026

Augmented reality 3D object mapping for printing alterations

Inventors: Alan Chung (Hopewell Junction, NY); Jeremy R. Fox (Georgetown, TX); Martin G. Keen (Cary, NC); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: International Business Machines Corporation
G05B19/4099B29C64/386B33Y50/00G06F3/011G06F3/017G06F3/04815G05B2219/32014G05B2219/35134G05B2219/49023
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,656,756
App. No.
18/057,782
Granted
Jun 16, 2026
Kind
B2
Abstract

According to one embodiment, a method, computer system, and computer program product for modifying an object being 3D printed using augmented reality is provided. The present invention may include analyzing shape, dimensions, and/or axis of the object being 3D printed; mapping at least one part of one or more of a user's appendages to at least one portion of the object being 3D printed; tracking movements of the at least one mapped part of the one or more of the user's appendages; and modifying the at least one portion of the object being 3D printed based on the tracked movements of the at least one part of the one or more of the user's appendages.

Claims (43)

1 . A computer-implemented method for modifying an object being 3D printed using augmented reality, the method comprising:

analyzing shape, dimensions, and/or axis of the object being 3D printed;

mapping at least one part of one or more of a user's appendages to at least one portion of a 3D object model corresponding to the object being 3D printed;

tracking movements of the at least one mapped part of the one or more of the user's appendages;

modifying the at least one portion of the 3D object model based on the tracked movements of the at least one part of the one or more of the user's appendages, and wherein the modifying includes bending the at least one portion to match a lifting or bending of an arm or leg of the user; and

printing the object based on the modified 3D object model.

2 . The method of claim 1 , further comprising:

displaying the object being 3D printed, with and/or without the modifying of the at least one portion of the object being 3D printed, to the user on a graphical user interface.

3 . The method of claim 1 , wherein tracking movements of the at least one mapped part of the one or more of the user's appendages is performed using at least one IoT device in addition to an AR device.

4 . The method of claim 1 , further comprising:

mapping at least one part of a physical object to the at least one portion of the object being 3D printed.

5 . The method of claim 1 , wherein modifying the at least one portion of the object being 3D printed based on the tracked movements of the at least one part of the one or more of the user's appendages occurs during printing of the 3D object.

6 . The method of claim 1 , wherein tracking the movements of the at least one mapped part of the one or more of the user's appendages is performed using a computer vision system in addition to an AR device.

7 . The method of claim 1 , wherein modifying the at least one portion of the object being 3D printed based on the tracked movements of the at least one part of the one or more of the user's appendages comprises pausing a 3D printing process.

8 . A computer system for modifying an object being 3D printed using augmented reality, the computer system comprising:

one or more processors, one or more computer readable memories, one or more computer readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:

analyzing shape, dimensions, and/or axis of the object being 3D printed;

mapping at least one part of one or more of a user's appendages to at least one portion of a 3D object model corresponding to the object being 3D printed;

tracking movements of the at least one mapped part of the one or more of the user's appendages;

modifying the at least one portion of the 3D object model based on the tracked movements of the at least one part of the one or more of the user's appendages, and wherein the modifying includes bending the at least one portion to match a lifting or bending of an arm or leg of the user; and

printing the object based on the modified 3D object model.

9 . The computer system of claim 8 , further comprising:

displaying the object being 3D printed, with and/or without the modifying of the at least one portion of the object being 3D printed, to the user with a graphical user interface.

10 . The computer system of claim 8 , wherein tracking movements of the at least one mapped part of the one or more of the user's appendages is performed using at least one IoT device in addition to an AR device.

11 . The computer system of claim 8 , further comprising:

mapping at least one part of a physical object to the at least one portion of the object being 3D printed.

12 . The computer system of claim 8 , wherein modifying the at least one portion of the object being 3D printed based on the tracked movements of the at least one part of the one or more of the user's appendages occurs during printing of the 3D object.

13 . The computer system of claim 8 , wherein tracking the movements of the at least one mapped part of the one or more of the user's appendages is performed using a computer vision system in addition to an AR device.

14 . The computer system of claim 8 , wherein modifying the at least one portion of the object being 3D printed based on the tracked movements of the at least one part of the one or more of the user's appendages comprises pausing a 3D printing process.

15 . A computer program product for modifying an object being 3D printed using augmented reality, the computer program product comprising:

one or more computer readable tangible storage medium and program instructions stored on at least one of the one or more tangible storage medium, the program instructions executable by a processor to cause the processor to perform a method comprising:

analyzing shape, dimensions, and/or axis of the object being 3D printed;

mapping at least one part of one or more of a user's appendages to at least one portion of a 3D object model corresponding to the object being 3D printed;

tracking movements of the at least one mapped part of the one or more of the user's appendages;

modifying the at least one portion of the 3D object model based on the tracked movements of the at least one part of the one or more of the user's appendages, and wherein the modifying includes bending the at least one portion to match a lifting or bending of an arm or leg of the user; and

printing the object based on the modified 3D object model.

16 . The computer program product of claim 15 , further comprising:

displaying the object being 3D printed, with and/or without the modifying of the at least one portion of the object being 3D printed, to the user with a graphical user interface.

17 . The computer program product of claim 15 , wherein tracking movements of the at least one mapped part of the one or more of the user's appendages is performed using at least one IoT device in addition to an AR device.

18 . The computer program product of claim 15 , further comprising:

mapping at least one part of a physical object to the at least one portion of the object being 3D printed.

19 . The computer program product of claim 15 , wherein modifying the at least one portion of the object being 3D printed based on the tracked movements of the at least one part of the one or more of the user's appendages occurs during printing of the 3D object.

20 . The computer program product of claim 15 , wherein tracking the movements of the at least one mapped part of the one or more of the user's appendages is performed using a computer vision system in addition to an AR device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2022
From: CHUNG, ALAN; FOX, JEREMY R.; KEEN, MARTIN G.; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061848/0277 →
Continuity (1)
Related Publication 20240168455A1 · May 23, 2024
References Cited (23)
US 10713851B2 · Holzer · 2020 [cited by applicant]
US 11232643B1 · Stevens · 2022 [cited by examiner]
US 20110164029A1 · King · 2011 [cited by examiner]
US 20150057784A1 · Butler · 2015 [cited by examiner]
US 20160016363A1 · Smith · 2016 [cited by applicant]
US 20160027199A1 · Cao · 2016 [cited by examiner]
US 20170057170A1 · Gupta · 2017 [cited by applicant]
US 20180059644A1 · Lection · 2018 [cited by examiner]
US 20180284692A1 · Kline · 2018 [cited by examiner]
US 20180290397A1 · Yu · 2018 [cited by examiner]
US 20190206134A1 · Devam · 2019 [cited by applicant]
US 20220032548A1 · Goyal · 2022 [cited by applicant]
US 20220164097A1 · Tadros · 2022 [cited by examiner]
US 20230019543A1 · Nikou · 2023 [cited by examiner]
US 20230419513A1 · Dutta Choudhury · 2023 [cited by examiner]
US 20240177427A1 · Cagan · 2024 [cited by examiner]
Disclosed Anonymously, “A Method and System for Enabling 3D Printing with Feedback and Modification in VR,” IP.com, Apr. 17, 2018, 3 pages, IP.com No. IPCOM000253627D, Retrieved from the Internet: <URL: https://priorart… [cited by applicant]
Electricslim, “Controlling a 3D Printer With Hand Gestures,” Workshop3D Printing [online], [accessed Aug. 4, 2022], 9 pages, Retrieved from the Internet: <URL: https://www.instructables.com/Controlling-a-3D-printer-with… [cited by applicant]
IBM Institute for Business Value, “Shifting transport paradigms,” IBM.com [online], [accessed on Sep. 13, 2022], 5 pages, Retrieved from the Internet: <URL: https://www.ibm.com/thought-leadership/institute-business-valu… [cited by applicant]
IBM, “IBM iConnect Access,” IBM.com, [online], [accessed on Sep. 13, 2022], 7 pages, Retrieved from the Internet: <URL: https://www.ibm.com/products/iconnect-access>. [cited by applicant]
IBM, “Latest Release of IBM iConnect Access® Provides Foundation for Planned Future 3D Printing Solution,” IBM.com [announcements], May 24, 2021 [accessed on Sep. 13, 2022], 4 pages, Retrieved from the Internet: <URL: h… [cited by applicant]
Jang, et al., “AiRSculpt: A Wearable Augmented Reality 3D Sculpting System.” International Conference on Distributed, Ambient, and Pervasive Interactions [conference paper], 2014, pp. 130-141, Springer International Pub… [cited by applicant]
Stoneflower3D, “Gesture control,” wikifactory.com [online], [accessed Aug. 4, 2022], 4 pages, Retrieved from the Internet: <URL: https://wikifactory.com/@stoneflower3d/gesture-control>. [cited by applicant]