IP Library › Granted Patent US 12,728,441
Granted Patent B2
US 12,728,441 · App. 18/042,080 · Granted Sep 8, 2026

Robotic repair control systems and methods

Inventors: Jonathan B. Arthur (Hudson, WI); Aaron K. Nienaber (Maplewood, MN); Nicholas G. Amell (Minneapolis, MN); Thomas J. Strey (River Falls, WI); Erich A. Mielke (St. Paul, MN); Talha Ahsan (St. Paul, MN); Vincent J.L. Chevrier (St. Paul, MN); Thaine W. Fuller (Lakeland, MN); Brett R. Hemes (Woodbury, MN)
Assignee: 3M INNOVATIVE PROPERTIES COMPANY
B05D5/005B25J11/0075B25J19/023G06T7/0004G06T2207/30156
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,728,441
App. No.
18/042,080
Granted
Sep 8, 2026
Kind
B2
Abstract

An imaging and repair system ( 100 ) is presented that includes a first imaging system ( 110 ) configured to image and detect a defect on a worksurface. The first imaging system comprises a first camera configured to capture a plurality of first images of the worksurface. The plurality of first images are stored in a data source. The system also includes a second imaging system ( 110 ) configured to image and characterize an orange peel of the worksurface in an area proximate the defect. Characterizing the worksurface comprises identifying a delta value of orange peel. The system also includes a defect repair processor configured to select a repair strategy based on a defect type. The system also includes a defect modifier configured to modify the selected repair strategy based on the orange peel characterization of the worksurface. The system also includes a defect repair tool ( 120 ) configured to automatically effect the modified repair strategy.

Claims (18)

1 . An imaging and repair system, comprising:

a first imaging system configured to image and detect a defect on a worksurface wherein the first imaging system comprises a first camera configured to capture a plurality of first images of the worksurface, wherein the plurality of first images are stored in a data source;

a motive robotic arm;

a second imaging system, mounted to the motive robotic arm, configured to image and characterize an orange peel of the worksurface in an area proximate the defect, wherein characterizing the worksurface comprises identifying a delta value of orange peel;

a defect repair processor configured to select a repair strategy template based on a defect type;

a strategy modifier configured to modify the selected repair strategy template based on the orange peel characterization of the worksurface; and

a defect repair tool, mounted to the motive robotic arm, configured to contact the worksurface and execute the modified repair strategy.

2 . The system of claim 1 , wherein the second imaging system comprises a second camera configured to capture a plurality of second images of the worksurface, wherein the plurality of second images are stored in the database, wherein the second camera is separate from the first camera.

3 . The system of claim 2 , wherein the second plurality of images comprise images of the worksurface proximate the defect.

4 . The system of claim 1 , and further comprising a structured light source.

5 . The system of claim 1 , wherein the second imaging system is directed to image the worksurface based on a location of the detected defect received from the first imaging system.

6 . The system of claim 1 , and further comprising an orange peel processor configured to:

sample pixels from an image in the plurality of second images; and

calculate a delta value based on the sampled pixels.

7 . The system of claim 1 , and further comprising an orange peel processor configured to:

smear an image in the plurality of second images; and

calculate a delta value based on the sampled images.

8 . The system of claim 1 , wherein the worksurface is a vehicle, and wherein the characterization of the worksurface comprises a flat surface and wherein, based on the characterized flat surface, the modified repair strategy comprises a shorter process time than the selected repair strategy.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2023
From: ARTHUR, JONATHAN B.; NIENABER, AARON K.; AMELL, NICHOLAS G.; STREY, THOMAS J.; MIELKE, ERICH A.; AHSAN, TALHA; CHEVRIER, VINCENT J.L.; FULLER, THAINE W.; HEMES, BRETT R.
To: 3M INNOVATIVE PROPERTIES COMPANY
Reel/Frame 062739/0537 →
Continuity (3)
Provisional Application 63198963 · Nov 25, 2020
Provisional Application 62706475 · Aug 19, 2020
Related Publication 20230321687A1 · Oct 12, 2023
References Cited (53)
US 5078496A · Parker et al. · 1992 [cited by applicant]
US 5153445A · Stapleton · 1992 [cited by applicant]
US 9546963B2 · Hwang · 2017 [cited by applicant]
US 10657419B2 · Kurtz · 2020 [cited by applicant]
US 11850695B2 · Nienaber et al. · 2023 [cited by applicant]
US 11958200B2 · Chen · 2024 [cited by applicant]
US 20030139836A1 · Matthews · 2003 [cited by examiner]
US 20070243798A1 · Annen · 2007 [cited by applicant]
US 20150290764A1 · Whipple · 2015 [cited by applicant]
US 20160028936A1 · Saphier · 2016 [cited by examiner]
US 20180361589A1 · Paquin · 2018 [cited by examiner]
US 20190096057A1 · Allen · 2019 [cited by examiner]
US 20190287237A1 · de Bonfim Gripp · 2019 [cited by examiner]
US 20210323167A1 · Hemes · 2021 [cited by applicant]
US 20210394328A1 · Hemes · 2021 [cited by applicant]
US 20220126319A1 · Richardson · 2022 [cited by applicant]
US 20230278225A1 · Lepage · 2023 [cited by applicant]
CN 106770319B · 2019 [cited by applicant]
CN 112326669A · 2021 [cited by applicant]
CN 212622274U · 2021 [cited by applicant]
CN 113043143A · 2021 [cited by applicant]
CN 113640317B · 2021 [cited by applicant]
CN 114720475A · 2022 [cited by applicant]
CN 114720476A · 2022 [cited by applicant]
CN 115446698A · 2022 [cited by applicant]
CN 115647997A · 2023 [cited by applicant]
CN 115890408A · 2023 [cited by applicant]
CN 219519248U · 2023 [cited by applicant]
CN 116852226A · 2023 [cited by applicant]
CN 116930187A · 2023 [cited by applicant]
CN 116945005A · 2023 [cited by applicant]
CN 219925528U · 2023 [cited by applicant]
CN 117007598A · 2023 [cited by applicant]
CN 220419181U · 2024 [cited by applicant]
CN 117571719A · 2024 [cited by applicant]
CN 117664980A · 2024 [cited by applicant]
CN 118229621A · 2024 [cited by applicant]
CN 118269117A · 2024 [cited by applicant]
CN 118533838A · 2024 [cited by applicant]
JP H05126758A · 1993 [cited by applicant]
JP H06294757A · 1994 [cited by applicant]
JP H08086633A · 1996 [cited by applicant]
JP 2024103415A · 2024 [cited by applicant]
WO 2004020543A1 · 2004 [cited by applicant]
WO WO2011144964A1 · 2011 [cited by examiner]
WO 2019112040A1 · 2019 [cited by applicant]
WO 2020161534 · 2020 [cited by examiner]
WO 2020161534A1 · 2020 [cited by applicant]
WO 2021105865A1 · 2021 [cited by applicant]
WO 2021105867A1 · 2021 [cited by applicant]
WO 2022241414A1 · 2022 [cited by applicant]
WO 2023205258A1 · 2023 [cited by applicant]
International Search Report for PCT International Application No. PCT/IB2021/057528, mailed on Jan. 11, 2022, 8 pages. [cited by applicant]