IP Library Granted Patent US 12,561,789
Granted Patent B2
US 12,561,789 · App. 18/748,913 · Granted Feb 24, 2026

Systems and methods for automatically grading pre-owned electronic devices

Inventors: Brandon P. Johnson (Brentwood, TN); Roscoe R. Herald (Murfreesboro, TN); Harrison A. Hanks (Nashville, TN); Carson Farley (Smyrna, TN)
Assignee: Assurant, Inc.
G06T7/0004G06V20/10G06T2207/10152G06T2207/30121G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,561,789
App. No.
18/748,913
Granted
Feb 24, 2026
Kind
B2
Abstract

Systems and methods for automatically grading a user device are provided. Such systems and methods can include (1) a lighting element positioned at an angle relative to a platform, (2) an imaging device positioned at the angle relative to the platform such that light emitted from the lighting element and a field of view of the imaging device form a right angle where the light emitted from the lighting element and the field of view meet at a user device when the user device is positioned at a predetermined location on the platform, and (3) control circuitry that can activate the lighting element, instruct the imaging device to capture an image of a screen of the user device while the user device is at the predetermined location and is being illuminated by the first lighting element, and parse the image to determine whether the screen is damaged.

Claims (35)

1 . A system comprising:

one or more grading stations associated with one or more imaging devices;

a conveyor associated with the one or more grading stations; and

control circuitry configured to:

cause the conveyor to move a user device to one or more locations associated with the one or more grading stations;

cause the one or more imaging devices to capture one or more images of the user device; and

determine, based on the one or more images and using one or more artificial intelligence algorithms, whether a screen of the user device, a back of the user device, a side of the user device, or a camera of the user device is damaged, wherein the one or more artificial intelligence algorithms are trained to generate device grading using captured images of a plurality of known devices associated with different degrees of defects; and

one or more end locations configured for receiving the user device based on a grade assigned to the user device based on a condition of the screen of the user device, the back of the user device, the side of the user device, or the camera of the user device, wherein the one or more end locations comprise a first end location for receiving user devices having damaged screens and a second end location for receiving user devices having undamaged or non-defective user devices.

2 . The system of claim 1 , wherein the one or more grading stations comprises at least one of: (i) a screen damage detecting system, a back defect detecting system, a side defect detecting system, or a screen defect detecting system.

3 . The system of claim 1 , further comprising one or more lighting elements associated with the one or more grading stations.

4 . The system of claim 3 , wherein the control circuitry is further configured to:

activate at least one lighting element of the one or more lighting elements simultaneously with at least one imaging device of the one or more imaging devices, and

instruct the at least one imaging device to capture at least one image while the user device is at a predetermined location and is being illuminated by the at least one lighting element.

5 . The system of claim 3 , wherein:

a first lighting element of the one or more lighting elements is positioned relative to the conveyor at a first angle measured between the conveyor and a light-emitting surface of the first lighting element, and

a first imaging device of the one or more imaging devices is positioned such that an axis of a field of view of the first imaging device is positioned at a second angle relative to the conveyor, the second angle being the same as the first angle.

6 . The system of claim 5 , wherein light emitted from the first lighting element and the axis of the field of view of the first imaging device form a right angle where the light emitted from the first lighting element and the axis of the field of view of the first imaging device meet at the user device when the user device is located at a predetermined location.

7 . The system of claim 3 , wherein at least one lighting element of the one or more lighting elements is positioned below the conveyor, wherein at least a portion of the conveyor is transparent to enable light emitted from the at least one lighting element to pass through the conveyor and illuminate the user device.

8 . The system of claim 3 , wherein at least one grading station of the one or more grading stations further comprises a positioning device, wherein the control circuitry is configured:

to activate the positioning device to position and/or rotate the user device through a field of view of at least one imaging device of the one or more imaging devices associated with the at least one grading station, and

instruct the at least one imaging device to capture at least one image of the user device.

9 . The system of claim 3 , wherein the one or more lighting elements comprises one or more ultraviolet light emitting elements or infra-red lights.

10 . The system of claim 3 , wherein causing the one or more imaging devices to capture the one or more images of the user device comprises:

identifying one or more optimal values for one or more optical parameters associated with at least one imaging device based on data associated with an identity of the user device; and

instructing the at least one imaging device to adjust the one or more optical parameters based on the one or more optimal values.

11 . The system of claim 3 , wherein causing the one or more imaging devices to capture the one or more images of the user device comprises:

identifying one or more optimal values for one or more optical parameters associated with at least one imaging device based on a color of the user device; and

instructing the at least one imaging device to adjust the one or more optical parameters based on the one or more optimal values.

12 . The system of claim 11 further comprising a device color sensor configured to identify the color of the user device and transmit data describing the color of the user device to the control circuitry.

13 . The system of claim 3 , wherein the control circuitry is configured to optimize one or more of polarization patterns or exposure rates associated with the one or more lighting elements.

14 . The system of claim 3 , wherein at least one lighting element comprises a planar lighting element.

15 . The system of claim 3 , wherein the one or more lighting elements have variable intensities.

16 . The system of claim 1 , further comprising comprises an inflow system associated with the one or more grading stations.

17 . The system of claim 1 , wherein the one or more grading stations define a multi-stage automated assembly line.

18 . The system of claim 1 , wherein at least one imaging device comprises a line scanning camera.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2024
From: JOHNSON, BRANDON P.; HERALD, ROSCOE R.; HANKS, HARRISON A.; FARLEY, CARSON
To: HYLA, INC.
Reel/Frame 067786/0706 →
MERGER AND CHANGE OF NAME Recorded Jun 20, 2024
From: HYLA, INC.; STAR MERGER SUB, INC.; HYLA MOBILE, INC.
To: HYLA MOBILE, INC.
Reel/Frame 067786/0905 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2024
From: HYLA MOBILE, INC.
To: ASSURANT, INC.
Reel/Frame 067787/0062 →
Continuity (4)
Continuation 18153804 · Jan 12, 2023
Continuation 17141919 · Jan 5, 2021
Provisional Application 62957795 · Jan 6, 2020
Related Publication 20240412345A1 · Dec 12, 2024
References Cited (205)
US 5650844A · Aoki et al. · 1997 [cited by applicant]
US 5717780A · Mitsumune et al. · 1998 [cited by applicant]
US 5835220A · Kazama et al. · 1998 [cited by applicant]
US 5914495A · Ishizuka et al. · 1999 [cited by applicant]
US 6201601B1 · Vaez-Iravani et al. · 2001 [cited by applicant]
US 6259827B1 · Nichani · 2001 [cited by applicant]
US 6386038B1 · Lewis et al. · 2002 [cited by applicant]
US 6597805B1 · Nagao · 2003 [cited by applicant]
US 6781688B2 · Kren et al. · 2004 [cited by applicant]
US 7206066B2 · Vurens et al. · 2007 [cited by applicant]
US 7848833B2 · Li et al. · 2010 [cited by applicant]
US 8200533B2 · Librizzi et al. · 2012 [cited by applicant]
US 8248237B2 · Fitzgerald et al. · 2012 [cited by applicant]
US 8463646B2 · Bowles et al. · 2013 [cited by applicant]
US 8719909B2 · Fitzgerald et al. · 2014 [cited by applicant]
US 8822922B1 · Scanlon et al. · 2014 [cited by applicant]
US 8867817B1 · Cooper et al. · 2014 [cited by applicant]
US 8932368B2 · Fitzgerald et al. · 2015 [cited by applicant]
US 8964062B1 · Neglur · 2015 [cited by applicant]
US 9007581B2 · Horai et al. · 2015 [cited by applicant]
US 9134892B2 · Hicks · 2015 [cited by applicant]
US 9253205B2 · Fitzgerald et al. · 2016 [cited by applicant]
US 9369865B2 · Hsu et al. · 2016 [cited by applicant]
US 9576157B2 · Fitzgerald et al. · 2017 [cited by applicant]
US 9703325B2 · Pope et al. · 2017 [cited by applicant]
US 9838877B2 · Fitzgerald et al. · 2017 [cited by applicant]
US 9881152B2 · Fitzgerald et al. · 2018 [cited by applicant]
US 9885672B2 · Forutanpour et al. · 2018 [cited by applicant]
US 9911102B2 · Bowles et al. · 2018 [cited by applicant]
US 9916481B2 · Fitzgerald et al. · 2018 [cited by applicant]
US 10001878B2 · Wood et al. · 2018 [cited by applicant]
US 10007934B2 · Nguyen · 2018 [cited by applicant]
US 10032140B2 · Bowles et al. · 2018 [cited by applicant]
US 10055798B2 · Bowles et al. · 2018 [cited by applicant]
US 10127647B2 · Forutanpour et al. · 2018 [cited by applicant]
US 10269110B2 · Forutanpour et al. · 2019 [cited by applicant]
US 10332249B2 · Dwivedi et al. · 2019 [cited by applicant]
US 10339509B2 · Bordeleau et al. · 2019 [cited by applicant]
US 10401411B2 · Snook et al. · 2019 [cited by applicant]
US 10402790B1 · Clark et al. · 2019 [cited by applicant]
US 10438174B2 · Bowles et al. · 2019 [cited by applicant]
US 10475002B2 · Silva et al. · 2019 [cited by applicant]
US 10572946B2 · Bowles et al. · 2020 [cited by applicant]
US 10681552B2 · Fitzgerald et al. · 2020 [cited by applicant]
US 10719261B2 · Törmäet al. · 2020 [cited by applicant]
US 10810732B2 · Dwivedi et al. · 2020 [cited by applicant]
US 10821611B1 · Defant et al. · 2020 [cited by applicant]
US 10825082B2 · Librizzi et al. · 2020 [cited by applicant]
US 10846881B2 · Hashimoto et al. · 2020 [cited by applicant]
US 10860990B2 · Bowles et al. · 2020 [cited by applicant]
US 10876914B2 · Fitzgerald et al. · 2020 [cited by applicant]
US 10909673B2 · Forutanpour et al. · 2021 [cited by applicant]
US 10977700B2 · Bordeleau et al. · 2021 [cited by applicant]
US 11080662B2 · Bowles et al. · 2021 [cited by applicant]
US 11080672B2 · Bowles · 2021 [cited by applicant]
US 11107046B2 · Bowles · 2021 [cited by applicant]
US 11126973B2 · Silva et al. · 2021 [cited by applicant]
US 11210777B2 · Fitzgerald et al. · 2021 [cited by applicant]
US 11232412B2 · Hunt et al. · 2022 [cited by applicant]
US 11341471B2 · Dion et al. · 2022 [cited by applicant]
US 11436570B2 · Bowles et al. · 2022 [cited by applicant]
US 11443289B2 · Bowles et al. · 2022 [cited by applicant]
US 11482067B2 · Forutanpour et al. · 2022 [cited by applicant]
US 11526932B2 · Bowles et al. · 2022 [cited by applicant]
US 11687900B2 · Dion et al. · 2023 [cited by applicant]
US 11688222B2 · Dion et al. · 2023 [cited by applicant]
US 11704887B2 · Saunders et al. · 2023 [cited by applicant]
US 20020009220A1 · Tanaka · 2002 [cited by applicant]
US 20020128790A1 · Woodmansee · 2002 [cited by applicant]
US 20040125208A1 · Malone et al. · 2004 [cited by applicant]
US 20040207836A1 · Chhibber et al. · 2004 [cited by applicant]
US 20040254677A1 · Brogardh et al. · 2004 [cited by applicant]
US 20050146719A1 · Chhibber et al. · 2005 [cited by applicant]
US 20050167620A1 · Cho et al. · 2005 [cited by applicant]
US 20050193027A1 · Hasegawa et al. · 2005 [cited by applicant]
US 20060007177A1 · Mclintock · 2006 [cited by applicant]
US 20060120588A1 · Kwon et al. · 2006 [cited by applicant]
US 20070205751A1 · Suzuki et al. · 2007 [cited by applicant]
US 20070289673A1 · Lacroix et al. · 2007 [cited by applicant]
US 20090249443A1 · Fitzgerald et al. · 2009 [cited by applicant]
US 20090253406A1 · Fitzgerald et al. · 2009 [cited by applicant]
US 20100053604A1 · Rice · 2010 [cited by applicant]
US 20100169231A1 · Bowles et al. · 2010 [cited by applicant]
US 20100228676A1 · Librizzi et al. · 2010 [cited by applicant]
US 20110043798A1 · Markwort et al. · 2011 [cited by applicant]
US 20120029947A1 · Wooldridge et al. · 2012 [cited by applicant]
US 20120237908A1 · Fitzgerald et al. · 2012 [cited by applicant]
US 20120280934A1 · Ha et al. · 2012 [cited by applicant]
US 20130046611A1 · Bowles et al. · 2013 [cited by applicant]
US 20130046699A1 · Bowles et al. · 2013 [cited by applicant]
US 20130121463A1 · Nesch et al. · 2013 [cited by applicant]
US 20130124426A1 · Bowles et al. · 2013 [cited by applicant]
US 20130144797A1 · Bowles et al. · 2013 [cited by applicant]
US 20130154842A1 · Chishima · 2013 [cited by applicant]
US 20130162548A1 · Chen et al. · 2013 [cited by applicant]
US 20130191236A1 · Bowles · 2013 [cited by applicant]
US 20130198089A1 · Bowles · 2013 [cited by applicant]
US 20130269013A1 · Parry et al. · 2013 [cited by applicant]
US 20130311318A1 · Librizzi et al. · 2013 [cited by applicant]
US 20140253494A1 · Jiang et al. · 2014 [cited by applicant]
US 20140267691A1 · Humphrey et al. · 2014 [cited by applicant]
US 20140313144A1 · Seto et al. · 2014 [cited by applicant]
US 20150046343A1 · Martini · 2015 [cited by applicant]
US 20150082410A1 · Fitzgerald et al. · 2015 [cited by applicant]
US 20150116481A1 · Troy et al. · 2015 [cited by applicant]
US 20150123987A1 · Hong et al. · 2015 [cited by applicant]
US 20150206200A1 · Edmondson et al. · 2015 [cited by applicant]
US 20150309912A1 · Nguyen et al. · 2015 [cited by applicant]
US 20150324926A1 · Nguyen et al. · 2015 [cited by applicant]
US 20150339736A1 · Bennett · 2015 [cited by applicant]
US 20160019685A1 · Nguyen · 2016 [cited by applicant]
US 20160055778A1 · Kim · 2016 [cited by applicant]
US 20160171456A1 · Bowles · 2016 [cited by applicant]
US 20160225036A1 · Nguyen · 2016 [cited by applicant]
US 20160275460A1 · Ploetner et al. · 2016 [cited by applicant]
US 20160307309A1 · Nguyen et al. · 2016 [cited by applicant]
US 20160335616A1 · Bordeleau et al. · 2016 [cited by applicant]
US 20170023637A1 · Yang et al. · 2017 [cited by applicant]
US 20170024613A1 · Shivaram et al. · 2017 [cited by applicant]
US 20170056928A1 · Torrione · 2017 [cited by applicant]
US 20170091557A1 · Wong et al. · 2017 [cited by applicant]
US 20170167986A1 · Nguyen et al. · 2017 [cited by applicant]
US 20170195069A1 · Slavin · 2017 [cited by applicant]
US 20170256051A1 · Dwivedi et al. · 2017 [cited by applicant]
US 20170315007A1 · Fitzgerald et al. · 2017 [cited by applicant]
US 20170344884A1 · Lin et al. · 2017 [cited by applicant]
US 20170372465A1 · Forutanpour et al. · 2017 [cited by applicant]
US 20180165541A1 · Amico et al. · 2018 [cited by applicant]
US 20180218271A1 · Rao et al. · 2018 [cited by applicant]
US 20180232875A1 · Kanodia et al. · 2018 [cited by applicant]
US 20180342050A1 · Fitzgerald et al. · 2018 [cited by applicant]
US 20180370027A1 · Oota et al. · 2018 [cited by applicant]
US 20190073641A1 · Utke · 2019 [cited by applicant]
US 20190184582A1 · Namiki · 2019 [cited by applicant]
US 20190266720A1 · Dwivedi et al. · 2019 [cited by applicant]
US 20190277769A1 · Nguyen et al. · 2019 [cited by applicant]
US 20190318465A1 · Nguyen · 2019 [cited by examiner]
US 20190354298A1 · Öberg et al. · 2019 [cited by applicant]
US 20190385275A1 · Kikuchi · 2019 [cited by applicant]
US 20200130963A1 · Diankov et al. · 2020 [cited by applicant]
US 20200167907A1 · Yan et al. · 2020 [cited by applicant]
US 20200202369A1 · Datta · 2020 [cited by applicant]
US 20200265487A1 · Silva et al. · 2020 [cited by applicant]
US 20210001488A1 · Birkmeyer et al. · 2021 [cited by applicant]
US 20210081351A1 · Villareal et al. · 2021 [cited by applicant]
US 20210110440A1 · Dion et al. · 2021 [cited by applicant]
US 20210192484A1 · Forutanpour et al. · 2021 [cited by applicant]
US 20220051507A1 · Forutanpour et al. · 2022 [cited by applicant]
US 20220067798A1 · Forutanpour et al. · 2022 [cited by applicant]
US 20220114854A1 · Forutanpour et al. · 2022 [cited by applicant]
US 20220164833A1 · Dion et al. · 2022 [cited by applicant]
US 20220198407A1 · Beane et al. · 2022 [cited by applicant]
US 20220262189A1 · Dion et al. · 2022 [cited by applicant]
US 20220366558A1 · Bufi et al. · 2022 [cited by applicant]
US 20230007937A1 · Forutanpour et al. · 2023 [cited by applicant]
US 20230173676A1 · Lonsberry et al. · 2023 [cited by applicant]
US 20230360353A1 · Saunders et al. · 2023 [cited by applicant]
US 20240013246A1 · Dion et al. · 2024 [cited by applicant]
US 20250086341A1 · Abe et al. · 2025 [cited by applicant]
CA 3016367A1 · 2017 [cited by applicant]
EP 3540690A1 · 2019 [cited by applicant]
EP 3427198B1 · 2020 [cited by applicant]
EP 3731157A1 · 2020 [cited by applicant]
EP 4238328A1 · 2023 [cited by applicant]
ES 2819699T3 · 2021 [cited by applicant]
ES 2820230T3 · 2021 [cited by applicant]
JP H01112382A · 1989 [cited by applicant]
JP 2001264268A · 2001 [cited by applicant]
JP 2004251781A · 2004 [cited by applicant]
JP 2008127029A · 2008 [cited by applicant]
JP 2009032112A · 2009 [cited by applicant]
JP 2010066186A · 2010 [cited by applicant]
JP 2012090231A · 2012 [cited by applicant]
JP 2013114049A · 2013 [cited by applicant]
JP 2013531823A · 2013 [cited by applicant]
JP 2015513135A · 2015 [cited by applicant]
JP 2020126661A · 2020 [cited by applicant]
JP 6754843B2 · 2020 [cited by applicant]
KR 1020190107593A · 2019 [cited by applicant]
KR 20190107593A · 2019 [cited by examiner]
KR 1020190116876 · 2019 [cited by applicant]
KR 1020200115308A · 2020 [cited by applicant]
WO 2013116256A1 · 2013 [cited by applicant]
WO 2017081527A1 · 2017 [cited by applicant]
WO 2017156046A1 · 2017 [cited by applicant]
WO 2019012505A1 · 2019 [cited by applicant]
U.S. Appl. No. 18/153,804, filed Jan. 12, 2023, U.S. Pat. No. 12,045,973, Issued. [cited by applicant]
U.S. Appl. No. 17/141,919, filed Jan. 5, 2021, U.S. Pat. No. 11,580,627, Issued. [cited by applicant]
English Translation of JP Office Action dated Nov. 19, 2024 for JP Application No. 2022541874, 6 page(s). [cited by applicant]
JP Office Action Mailed on Nov. 19, 2024 for JP Application No. 2022541874, 6 page(s). [cited by applicant]
Bian, Xiao et al., Multiscale Fully Convolutional Network with Application to Industrial Inspection, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE, Mar. 7, 2016, pp. 1-8. [cited by applicant]
Du-Ming Tsai et al., Low-contrast surface inspection of mura defects in liquid crystal displays using optical flow-based motion analysis, Machine Vision and Applications, Springer, Berlin, DE vol. 22, No. 4, Mar. 31, 20… [cited by applicant]
English language translation of KR patent publication 10-2019-0107593, dated Oct. 7, 2020. [cited by applicant]
English language translation of KR patent publication 10-2019-0107593, dated Sep. 20, 2019. [cited by applicant]
English Translation of CA Office Action dated Nov. 28, 2023 for CA Application No. 3163948, 3 page(s). [cited by applicant]
Extended European Search Report Mailed on Dec. 15, 2023 for EP Application No. 21738603, 12 page(s). [cited by applicant]
International Search Report and Written Opinion from corresponding WO application PCT/US2021/012338, dated Mar. 24, 2021. [cited by applicant]
Kumkang Systems Co., Ltd. (hereinafter Kumkang), KR patent publication English language translation of KR patent publication (10-2019-0107593). [cited by applicant]
Yuan Lunxi et al., The Development and Prospect of Surface Defect Detection Based on Vision Measurement Method, 2016 12th World Congress on Intelligent Control and Automation (WCICA), IEEE, Jun. 12, 2016, pp. 1382-1387. [cited by applicant]
Zhang Lei et al., Road Crack Detection Using Deep Convolutional Neural Network, 2016 IEEE International Conference on Image Processing (ICIP), IEEE, Sep. 25, 2016, pp. 3708-3712. [cited by applicant]
ISA/220—Notification of Transmittal or Search Report and Written Opinion of the ISA, or the Declaration Mailed on Apr. 2, 2025 for WO Application No. PCT/US24/059857, 17 page(s). [cited by applicant]
Schrimpf, Johannes et al., “Real-Time System Integration in a Multi-Robot Sewing Cell,”, Oct. 7, 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2724-2729. [cited by applicant]
Schrimpf, Johannes et al., “Work Flow, Material Handling and Initial Part Positioning in a Multi-Robot Sewing Cell,”, Jan. 1, 2015, IFAC-PAPERSONLINE, 45-50, 48, No. 19. [cited by applicant]
Schrimph, Johannes et al., “Model-Based Feed-Forward and Setpoint Generation in a Multi-Robot Sewing Cell,”, May 26, 2015, IEEE International Conference on Robotics and Automation, 2027-2033. [cited by applicant]
Non-Final Rejection Mailed on Dec. 10, 2025 for U.S. Appl. No. 18/794,667, 49 page(s). [cited by applicant]