IP Library Granted Patent US 12,345,057
Granted Patent B2
US 12,345,057 · App. 17/968,372 · Granted Jul 1, 2025

Automated drywall painting system and method

Inventors: Maria J. Telleria (Redwood City, CA); Gabriel F. Hein (Albany, CA); Kevin B. Albert (San Francisco, CA); Thomas F. Allen (Oakland, CA); Henrik Bennetsen (San Francisco, CA); Josephine Marie Pedersen (Martinez, CA); Jonathan B. Pompa (Long Beach, CA); Charlie Yan (San Francisco, CA); Alana G. R. Yoel (San Francisco, CA); Miles J. Flannery (San Francisco, CA); Henry Tonoyan (San Francisco, CA)
Assignee: Canvas Construction, Inc.
E04F21/026B05B1/28B05B7/0093B05B9/007B05B12/122B05B13/0431B05B15/625B05C5/004B05C5/02B05C11/1039B05D1/02B05D3/0413B05D3/067B24B7/182B24B49/12B24B55/06B24B55/10B25J9/1661B25J9/1697B25J11/0055B25J11/0075B25J15/0019B26D5/007E04B1/7654E04F21/0046E04F21/08E04F21/085E04F21/12E04F21/16E04F21/165E04F21/1652E04F21/1657E04F21/18B05B7/24B05B7/26B05B9/01B05B14/00B05C3/18B25J9/0084B26D3/085G05B2219/40114G05B2219/40298Y10S901/01Y10S901/41Y10S901/43Y10S901/47
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,345,057
App. No.
17/968,372
Granted
Jul 1, 2025
Kind
B2
Abstract

An automated painting system that includes a robotic arm and a painting end effector coupled at a distal end of the robotic arm, with the painting end effector configured to apply paint to a target surface. The painting system can also include a computing device executing a computational planner that: generates instructions for driving the painting end effector and robotic arm to perform at least one painting task that includes applying paint, via the painting the end effector, to a plurality of drywall pieces, the generating based at least in part on obtained target surface data; and drives the end effector and robotic arm to perform the at least one painting task.

Claims (58)

1. A method, the method comprising:

transmitting a first signal to a perception system of a painting system to scan one or more surfaces of a wall assembly;

receiving sensor data from the perception system;

determining a relative position of the painting system and the one or more surfaces of the wall assembly based on the scanning; and

transmitting a second signal to a robotic arm of the painting system to move the robotic arm to apply a spray of paint from a painting end effector of the painting system to the one or more surfaces of the wall assembly based at least in part on the relative position, wherein the painting system creates a feathered paint edge by reducing an amount of the paint applied by the painting end effector at an edge of a first region of the one or more surfaces;

receiving further sensor data comprising paint flow rate data; and

transmitting a third signal to cause a flow of the paint through the painting end effector to reverse to clear a clog based on detecting a change in the further sensor data.

2. The method of claim 1 , further comprising:

transmitting a fourth signal to move the robotic arm to apply the spray of the paint from the painting end effector to the feathered paint edge and a second region of the one or more surfaces, wherein the second region is adjacent to the first region and the painting system blends the paint across the first region and the second region by reducing the amount of the paint applied by the painting end effector at the feathered paint edge.

3. The method of claim 1 , further comprising:

obtaining, from the perception system, paint application data identifying at least one of: one or more painted regions of the one or more surfaces, and one or more unpainted regions of the one or more surfaces.

4. The method of claim 1 , further comprising:

transmitting a fourth signal to a movement system to move the painting system to a location adjacent to the one or more surfaces of the wall assembly, wherein the movement compensates for error in the location relative to a target location.

5. The method of claim 1 , further comprising:

generating a map of the one or more surfaces of the wall assembly based at least in part on the scanning, wherein the determining the relative position of the painting system and the one or more surfaces of the wall assembly comprises determining a location of the painting system within the map.

6. The method of claim 1 , further comprising:

detecting a location of an object relative to the painting system; and

maintaining safety of the object by triggering a safety operation of the painting system based on the location of the object.

7. The method of claim 1 , further comprising:

initiating an application of the paint to the one or more surfaces of the wall assembly based on data obtained while the painting system was applying joint compound to one or more joints on the one or more surfaces of the wall assembly.

8. The method of claim 1 , further comprising:

transmitting a fourth signal to the robotic arm to move the robotic arm to blend the paint across adjacent painted regions by rolling the adjacent painted regions with a paint roller while the paint is wet.

9. A method, the method comprising:

transmitting a first signal to a perception system of a painting system to scan one or more surfaces of a wall assembly;

receiving sensor data from the perception system;

determining a relative position of the painting system and the one or more surfaces of the wall assembly based on the scanning;

transmitting a second signal to a robotic arm of the painting system to move the robotic arm to apply a spray of paint from a painting end effector of the painting system to the one or more surfaces of the wall assembly based at least in part on the relative position, wherein the painting system creates a feathered paint edge by reducing an amount of the paint applied by the painting end effector at an edge of a first region of the one or more surfaces;

receiving further sensor data comprising pressure data; and

transmitting a third signal to cause a flow of the paint through the painting end effector to reverse to clear a clog based on detecting a change in the further sensor data.

10. The method of claim 9 , further comprising:

transmitting a fourth signal to move the robotic arm to apply the spray of the paint from the painting end effector to the feathered paint edge and a second region of the one or more surfaces, wherein the second region is adjacent to the first region and the painting system blends the paint across the first region and the second region by reducing the amount of the paint applied by the painting end effector at the feathered paint edge.

11. The method of claim 9 , further comprising:

obtaining, from the perception system, paint application data identifying at least one of: one or more painted regions of the one or more surfaces, and one or more unpainted regions of the one or more surfaces.

12. The method of claim 9 , further comprising:

transmitting a fourth signal to a movement system to move the painting system to a location adjacent to the one or more surfaces of the wall assembly, wherein the movement compensates for error in the location relative to a target location.

13. The method of claim 9 , further comprising:

generating a map of the one or more surfaces of the wall assembly based at least in part on the scanning, wherein the determining the relative position of the painting system and the one or more surfaces of the wall assembly comprises determining a location of the painting system within the map.

14. The method of claim 9 , further comprising:

detecting a location of an object relative to the painting system; and

maintaining safety of the object by triggering a safety operation of the painting system based on the location of the object.

15. The method of claim 9 , further comprising:

initiating an application of the paint to the one or more surfaces of the wall assembly based on data obtained while the painting system was applying joint compound to one or more joints on the one or more surfaces of the wall assembly.

16. A method, the method comprising:

transmitting a first signal to a perception system of a painting system to scan one or more surfaces of a wall assembly;

receiving sensor data from the perception system;

determining a relative position of the painting system and the one or more surfaces of the wall assembly based on the scanning;

transmitting a second signal to a robotic arm of the painting system to move the robotic arm to apply a spray of paint from a painting end effector of the painting system to the one or more surfaces of the wall assembly based at least in part on the relative position, wherein the painting system creates a feathered paint edge by reducing an amount of the paint applied by the painting end effector at an edge of a first region of the one or more surfaces;

receiving further sensor data comprising image data; and

transmitting a third signal to cause a flow of the paint through the painting end effector to reverse to clear a clog based on detecting a change in the further sensor data.

17. The method of claim 16 , further comprising:

transmitting a fourth signal to move the robotic arm to apply the spray of the paint from the painting end effector to the feathered paint edge and a second region of the one or more surfaces, wherein the second region is adjacent to the first region and the painting system blends the paint across the first region and the second region by reducing the amount of the paint applied by the painting end effector at the feathered paint edge.

18. The method of claim 16 , further comprising:

generating a map of the one or more surfaces of the wall assembly based at least in part on the scanning, wherein the determining the relative position of the painting system and the one or more surfaces of the wall assembly comprises determining a location of the painting system within the map.

19. The method of claim 16 , further comprising:

detecting a location of an object relative to the painting system; and

maintaining safety of the object by triggering a safety operation of the painting system based on the location of the object.

20. The method of claim 16 , further comprising:

initiating an application of the paint to the one or more surfaces of the wall assembly based on data obtained while the painting system was applying joint compound to one or more joints on the one or more surfaces of the wall assembly.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2026
From: CANVAS CONSTRUCTION, INC.
To: CNVS (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 073428/0725 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2026
From: CNVS (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
To: JLG INDUSTRIES, INC.
Reel/Frame 073428/0744 →
RELEASE OF SECURITY INTEREST Recorded Jan 8, 2026
From: TRIPLEPOINT PRIVATE VENTURE CREDIT INC.
To: CANVAS CONSTRUCTION, INC.
Reel/Frame 073408/0911 →
RELEASE OF SECURITY INTEREST Recorded Dec 30, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: CANVAS CONSTRUCTION, INC.
Reel/Frame 073336/0475 →
SECURITY INTEREST Recorded Oct 26, 2023
From: CANVAS CONSTRUCTION, INC.; CANVAS CONSTRUCTION SERVICES, LLC
To: TRIPLEPOINT PRIVATE VENTURE CREDIT INC.
Reel/Frame 065365/0023 →
SECURITY INTEREST Recorded Oct 9, 2023
From: CANVAS CONSTRUCTION, INC.
To: FIRST CITIZENS BANK & TRUST COMPANY
Reel/Frame 065157/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: ALBERT, KEVIN B.; ALLEN, THOMAS F.; BENNETSEN, HENRIK; HEIN, GABRIEL F.; PEDERSEN, JOSEPHINE MARIE; POMPA, JONATHAN B.; TELLERIA, MARIA J.; YAN, CHARLIE; YOEL, ALANA G. R.; FLANNERY, MILES J.; TONOYAN, HENRY
To: CANVAS CONSTRUCTION, INC.
Reel/Frame 062755/0527 →
Continuity (3)
Continuation 15942087 · Mar 30, 2018
Provisional Application 62480172 · Mar 31, 2017
Related Publication 20230043189A1 · Feb 9, 2023
References Cited (141)
US 2088542A · Westin · 1937 [cited by applicant]
US 2514748A · Di Stefano · 1950 [cited by applicant]
US 3116882A · Vork · 1964 [cited by applicant]
US 4392336A · Ganssle · 1983 [cited by applicant]
US 4941182A · Patel · 1990 [cited by applicant]
US 5175018A · Lee et al. · 1992 [cited by applicant]
US 5279700A · Retti · 1994 [cited by applicant]
US 5429682A · Harlow, Jr. · 1995 [cited by examiner]
US 5670202A · Guzowski et al. · 1997 [cited by applicant]
US 5979520A · Behrendt · 1999 [cited by applicant]
US 5987591A · Jyumonji · 1999 [cited by applicant]
US 6112490A · Meyer · 2000 [cited by applicant]
US 6149506A · Duescher · 2000 [cited by applicant]
US 6712238B1 · Mills · 2004 [cited by applicant]
US 7551058B1 · Johnson et al. · 2009 [cited by applicant]
US 9243412B1 · Gallette et al. · 2016 [cited by applicant]
US 9427874B1 · Rublee · 2016 [cited by applicant]
US 9518870B2 · Verdino · 2016 [cited by applicant]
US 9527211B2 · Posselius et al. · 2016 [cited by applicant]
US 9637936B1 · Gallette et al. · 2017 [cited by applicant]
US 9694381B2 · Mohr · 2017 [cited by applicant]
US 9702830B1 · Akselrod et al. · 2017 [cited by applicant]
US 9849594B2 · Keese · 2017 [cited by applicant]
US 9995047B2 · Raman et al. · 2018 [cited by applicant]
US 10478972B2 · Lipinski et al. · 2019 [cited by applicant]
US 10513856B2 · Telleria et al. · 2019 [cited by applicant]
US 10526799B2 · Telleria et al. · 2020 [cited by applicant]
US 10697188B2 · Telleria et al. · 2020 [cited by applicant]
US 10718119B2 · Telleria et al. · 2020 [cited by applicant]
US 10822814B2 · Telleria et al. · 2020 [cited by applicant]
US 10870996B2 · Telleria et al. · 2020 [cited by applicant]
US 11059065B2 · Holloway et al. · 2021 [cited by applicant]
US 11077457B2 · Lipinski et al. · 2021 [cited by applicant]
US 11230008B2 · Schweigler · 2022 [cited by applicant]
US 20040159724A1 · van der Steur · 2004 [cited by applicant]
US 20050064804A1 · Cecil et al. · 2005 [cited by applicant]
US 20050120840A1 · Koskovich · 2005 [cited by applicant]
US 20060108450A1 · Klinkenberg et al. · 2006 [cited by applicant]
US 20070000947A1 · Lewis et al. · 2007 [cited by applicant]
US 20070107632A1 · Ball · 2007 [cited by applicant]
US 20070151201A1 · Fellinger · 2007 [cited by applicant]
US 20080168741A1 · Gilgan et al. · 2008 [cited by applicant]
US 20090199690A1 · Sun et al. · 2009 [cited by applicant]
US 20100010660A1 · Salour et al. · 2010 [cited by applicant]
US 20100098871A1 · Gale et al. · 2010 [cited by applicant]
US 20100307279A1 · Campagna et al. · 2010 [cited by applicant]
US 20110011222A1 · Bales · 2011 [cited by applicant]
US 20110211938A1 · Eakins et al. · 2011 [cited by applicant]
US 20110253291A1 · Allen · 2011 [cited by examiner]
US 20110302877A1 · Gilgan et al. · 2011 [cited by applicant]
US 20120219699A1 · Pettersson et al. · 2012 [cited by applicant]
US 20120316930A1 · Clemenson · 2012 [cited by applicant]
US 20130042480A1 · Turulin · 2013 [cited by applicant]
US 20130167471A1 · Denaro · 2013 [cited by applicant]
US 20130239498A1 · Owens · 2013 [cited by applicant]
US 20130260016A1 · Georgeson et al. · 2013 [cited by applicant]
US 20140022281A1 · Georgeson et al. · 2014 [cited by applicant]
US 20140230726A1 · Gale et al. · 2014 [cited by applicant]
US 20140336818A1 · Posselius et al. · 2014 [cited by applicant]
US 20150112482A1 · Kuwahara · 2015 [cited by applicant]
US 20150147460A1 · Manzi et al. · 2015 [cited by applicant]
US 20150336267A1 · Sun et al. · 2015 [cited by applicant]
US 20150350618A1 · Meier et al. · 2015 [cited by applicant]
US 20150375390A1 · Becroft et al. · 2015 [cited by applicant]
US 20160052012A1 · Mohr · 2016 [cited by applicant]
US 20160121486A1 · Lipinski · 2016 [cited by examiner]
US 20160207220A1 · Hack et al. · 2016 [cited by applicant]
US 20160313294A1 · Dattilo et al. · 2016 [cited by applicant]
US 20170052507A1 · Poulos et al. · 2017 [cited by applicant]
US 20180009000A1 · Shang et al. · 2018 [cited by applicant]
US 20180021799A1 · Raman et al. · 2018 [cited by applicant]
US 20180223546A1 · Wasserfaller, Sr. · 2018 [cited by applicant]
US 20180281012A1 · Telleria et al. · 2018 [cited by applicant]
US 20180283018A1 · Telleria et al. · 2018 [cited by applicant]
US 20190118209A1 · Rennuit · 2019 [cited by applicant]
US 20190255551A1 · Hargadon · 2019 [cited by applicant]
US 20200061866A1 · Giles · 2020 [cited by applicant]
CN 1611331A · 2005 [cited by applicant]
CN 2883554Y · 2007 [cited by applicant]
CN 202023345U · 2011 [cited by applicant]
CN 105971253A · 2016 [cited by applicant]
CN 106088544A · 2016 [cited by applicant]
DE 102006056179A1 · 2008 [cited by applicant]
GB 2171222A · 1986 [cited by applicant]
IT MO20100102A1 · 2011 [cited by applicant]
JP H03100265A · 1991 [cited by applicant]
JP H04169659A · 1992 [cited by applicant]
JP H04258468A · 1992 [cited by applicant]
JP H06269709A · 1994 [cited by applicant]
JP H0766585A · 1995 [cited by applicant]
JP 2645312B2 · 1997 [cited by applicant]
JP H10180178A · 1998 [cited by applicant]
JP 2010203055A · 2010 [cited by applicant]
JP 5107123B2 · 2012 [cited by applicant]
JP 2017109294A · 2017 [cited by applicant]
JP 2019167678A · 2019 [cited by applicant]
JP 6713762B2 · 2020 [cited by applicant]
KR 20090085809A · 2009 [cited by applicant]
KR 101131918B1 · 2012 [cited by applicant]
RU 1789711C · 1993 [cited by applicant]
RU 2100686C1 · 1997 [cited by applicant]
RU 2686421C1 · 2019 [cited by applicant]
SU 00160667 · 1963 [cited by applicant]
WO 2007141320A1 · 2007 [cited by applicant]
WO 2013000524A1 · 2013 [cited by applicant]
WO 2016200439A1 · 2016 [cited by applicant]
WO 2017187105A1 · 2017 [cited by applicant]
WO 2018183961A1 · 2018 [cited by applicant]
WO 2018226533A1 · 2018 [cited by applicant]
Alex et al., “Automated Surface Profiling of Drywall Surface for Sanding,” 28th International Symposium on Automation and Robotics in Construction, Jun. 2011, 7 pages. [cited by applicant]
Bao et al., “Flexible Pneumatic End-effector for Agricultural Robot: Design & Experiment,” Proceedings of the 2015 IEEE Conference on Robotics and Biomimetics, Dec. 6, 2015, 6 pages. [cited by applicant]
FANUC America Corporation, “Robotic Sanding, Washing & Drying An Aircraft Fuselage with FANUC's New P-350iA/45 Robot,” Oct. 27, 2016, retrieved from https://www.youtube.com/watch?v=abA9v8EOokl, 4 pages. [cited by applicant]
Forsberg et al., “A Construction Robot for Autonomous Plastering of Walls and Ceilings,” Jun. 11, 1997, retrieved Aug. 8, 2019, from http://www.iaarc.org/publications/fulltext/A_construction_robot_for_autonomous_plaster… [cited by applicant]
International Search Report and Written Opinion mailed Aug. 2, 2018, International Patent Application No. PCT/US2018/025570, filed Mar. 30, 2018, 7 pages. [cited by applicant]
International Search Report and Written Opinion mailed Feb. 28, 2019, International Patent Application No. PCT/US2018/052751, filed Sep. 25, 2018, 7 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jul. 5, 2018, International Patent Application No. PCT/US2018/025529, filed Mar. 30, 2018, 7 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jul. 5, 2018, International Patent Application No. PCT/US2018/025536, filed Mar. 30, 2018, 7 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jul. 5, 2018, International Patent Application No. PCT/US2018/025553, filed Mar. 30, 2018, 7 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jul. 5, 2018, International Patent Application No. PCT/US2018/025556, filed Mar. 30, 2018, 7 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jul. 5, 2018, International Patent Application No. PCT/US2018/025566, filed Mar. 30, 2018, 7 pages. [cited by applicant]
International Search Report and Written Opinion mailed May 28, 2020, in International Patent Application No. PCT/US2020/019347, filed Feb. 21, 2020, 9 pages. [cited by applicant]
Jahangiri, “Generating Optimized Cutting Layours of Drywall Panels Using Building Information,” Master of Science Thesis Texas A&M University, May 2016, 68 pages. [cited by applicant]
Jeremy56 et al., “Cannot get my drywall into the basement,” DIYChatroom.com, https://www.diychatroom.com/threads/ cannot-get-my-drywall-into-the-basement.7454/, Mar. 30, 2007, 9 pages. [cited by applicant]
Krieg, “HygroSkin—Meteorosensitive Pavilion,” Fabricate 2014: Negotiating Design and Making, Feb. 2014, https://www.researchgate.net/publication/273060832_HygroSkin_-_Meteorosensitive_Pavilion, 9 pages. [cited by applicant]
Nagata et al., “Robotic sanding system for new designed furniture with free-formed surface,” Robotics and Computer-Integrated Manufacturing 23(4):371-379, Aug. 2007. [cited by applicant]
Pelletier, “Carpet Seam Peaking”, PelletierRug.com, https://www.pelletierrug.com/carpet-seam-peaking.php, 2012, 2 pages. [cited by applicant]
Supplementary European Search Report issued in EP Patent Application No. 18774804.1, mailed Dec. 4, 2020, 6 pages. [cited by applicant]
Supplementary European Search Report issued in EP Patent Application No. 18776196.0, mailed Dec. 9, 2020, 8 pages. [cited by applicant]
Supplementary European Search Report issued in EP Patent Application No. 18777789.1, mailed Dec. 8, 2020, 9 pages. [cited by applicant]
Supplementary European Search Report issued in EP Patent Application No. 20760348.1, mailed Sep. 19, 2022, 10 pages. [cited by applicant]
Tuberville Enterprizes, “Walls & Ceilings Joint Compund Additive,” Jun. 5, 2012, retrieved Aug. 8, 2019, from https://www.wconline.com/articles/88003-joint-compound-additive, 1 page. [cited by applicant]
Ueno et al., “Construction Robots for Site Automation,” CAD & Robotocs in Architecture & Construction, 1986, 13 pages. [cited by applicant]
Unknown, “Method of Tuning Parameters for Compliant Motion Tasks in Robot Programming”, IBM Technical Disclosure Bulletin, Mar. 1, 1992, 3 pages. [cited by applicant]
Yoshida et al., “Development of Spray Robot for Fireproof Cover Work,” 1984, 27 pages. [cited by applicant]
Krieg, “HygroSkin—Meteorosensitive Pavilion,” Fabricate 2014: Negotiating Design and Making, Feb. 2014, https://researchgate.net/publication/273060832_HygroSkin_-_Meteorosensitive_Pavilion, 9 pages. [cited by applicant]
U.S. Appl. No. 15/942,158, filed Mar. 30, 2018, now issued U.S. Pat. No. 10,513,856. [cited by applicant]
U.S. Appl. No. 15/942,193, filed Mar. 30, 2018, now issued U.S. Pat. No. 10,526,799. [cited by applicant]
U.S. Appl. No. 15/941,886, filed Mar. 30, 2018, now issued U.S. Pat. No. 10,822,814. [cited by applicant]
U.S. Appl. No. 15/942,318, filed Mar. 30, 2018, now issued U.S. Pat. No. 10,718,119. [cited by applicant]
U.S. Appl. No. 15/942,286, filed Mar. 30, 2018, now issued U.S. Pat. No. 10,697,188. [cited by applicant]
U.S. Appl. No. 15/941,974, filed Mar. 30, 2018, now issued U.S. Pat. No. 10,870,996. [cited by applicant]