IP Library Granted Patent US 12,586,178
Granted Patent B2
US 12,586,178 · App. 18/497,251 · Granted Mar 24, 2026

Grading cosmetic appearance of a test object

Inventors: Yan Zhou (Mountain View, CA); Jisheng Li (Los Altos, CA); George Huang (Los Altos Hills, CA); Chen Chen (San Ramon, CA)
Assignee: Future Dial, Inc.
G06T7/001G01N21/8851G06T7/194G06T7/30G06V10/10H04N23/90G01N2021/8874G01N2021/8887
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,586,178
App. No.
18/497,251
Granted
Mar 24, 2026
Kind
B2
Abstract

A method includes receiving, by a processing device, a plurality of images of a test object, the plurality of images including a plurality of surfaces of the test object. The processing device selects a region of interest in each of the plurality of images, the region of interest comprising the test object having a background removed. For the plurality of regions of interest as selected, the method includes comparing, by the processing device, each region of interest with a corresponding profile image and identifying defects in each region of interest. The method includes grading, by the processing device, a cosmetic appearance of each region of interest based on the identified defects. The grades of the cosmetic appearance for each region of interest are stored.

Claims (44)

1 . An apparatus, comprising:

a dome-shaped component having a top portion and a bottom portion opposite to the top portion, wherein:

a first opening is configured on the top portion; and

a second opening having alignment with the first opening and is configured to on the bottom portion to allow an item to be inspected to enter the dome-shaped component, and wherein the dome-shaped component is configured to enclose at least a portion of the item to be inspected;

a movable platform configured to receive the item, position the item within the dome-shaped component, and rotate the item in a plurality of orientations;

at least one sensor configured to determine when the item is placed on the movable platform;

a plurality of lights positioned outside of the dome-shaped component and operable to provide illumination to an interior of the dome-shaped component through the dome-shaped component; and

at least one camera positioned in accordance with the determination by the at least one sensor and outside of the dome-shaped component to capture images of the item positioned within the dome-shaped component and in the plurality of orientations.

2 . The apparatus of claim 1 , wherein the at least one camera includes a first camera configured to have a field of view in a direction from the first opening towards the second opening and configured to capture a first image of the item when the item is positioned within the dome-shaped component.

3 . The apparatus of claim 2 , wherein the plurality of lights include a first subset of lights configured to provide lighting in a direction from the first camera towards the first opening.

4 . The apparatus of claim 3 , wherein the plurality of lights include a second subset of lights configured in a plane having alignment with the first opening to provide lighting in directions relative to the dome-shaped component.

5 . The apparatus of claim 4 , wherein the first camera is further configured to capture a second image of the item when the item is positioned within the dome-shaped component, and when the second subset of lights are turned on and the first subset of lights are turned off.

6 . The apparatus of claim 5 , wherein the first camera is configured to capture the first image of the item when the first subset of lights are turned on and the second subset of lights are turned off.

7 . The apparatus of claim 6 , wherein the plurality of lights include a third subset of lights configured in a plane having alignment with the second opening to provide lighting up towards relative to the dome-shaped component.

8 . The apparatus of claim 7 , wherein the at least one camera is configured to capture a third image of the item when the second subset of lights and the third subset of lights are turned on.

9 . The apparatus of claim 8 , wherein the at least one camera is configured to capture the third image of the item when the first subset of lights are turned off.

10 . The apparatus of claim 9 , wherein the at least one camera is configured to capture the third image of the item when the item is positioned mid-way between the first opening and the second opening.

11 . An apparatus, comprising:

a dome-shaped component configured to enclose at least a portion of an item to be imaged, the dome-shaped component having a top side and a bottom side, wherein a first opening is configured on the top side, a second opening having alignment with the first opening and is configured on the bottom side, and a size of the first opening and a size of the second opening have a same size;

a movable platform configured to receive the item, position the item within the dome-shaped component, and rotate the item in a plurality of orientations;

at least one sensor configured to determine when the item is placed on the movable platform;

a plurality of lights positioned outside of the dome-shaped component and operable to provide illumination to an interior of the dome-shaped component through the dome-shaped component; and

at least one camera positioned in accordance with the determination by the at least one sensor and outside of the dome-shaped component to capture images of the item positioned within the dome-shaped component and in the plurality of orientations.

12 . The apparatus of claim 11 , wherein the at least one camera includes:

a first camera configured to have a field of view in a first direction from the top side to the bottom side; and

a second camera configured to have a field of view in a second direction in a side way that is perpendicular to the first direction.

13 . The apparatus of claim 12 , wherein the dome-shaped component further includes a third opening located in a plane mid-way between the first opening and the second opening, the third opening provides a window for the second camera to capture an image of the item positioned in the plane.

14 . The apparatus of claim 13 , wherein the first camera is configured to capture at least one image of the item when the item is positioned next to the first opening.

15 . The apparatus of claim 14 , wherein the plurality of lights include:

first lights;

second lights positioned to provide lighting in directions down towards relative to the dome-shaped component; and

third lights positioned to provide lighting in directions up towards relative to the dome-shaped component.

16 . An apparatus, comprising:

a dome-shaped component configured to enclose at least a portion of an item to be imaged, the dome-shaped component having a top side and a bottom side, wherein a first opening is configured on the top side to provide a first window for imaging the item positioned within the dome-shaped component, a second opening having alignment with the first opening and is configured on the bottom side to allow the item to enter the dome-shaped component, and a third opening is configured on the dome-shaped component in a mid-plane between the first opening and the second opening to provide a second window for imaging the item positioned within the dome-shaped component;

a movable platform configured to receive the item, position the item within the dome-shaped component, and rotate the item in a plurality of orientations;

at least one sensor configured to determine when the item is placed on the movable platform and where the movable platform is disposed relative to at least one camera to facilitate orientation of the item for the at least one camera;

a plurality of lights positioned outside of the dome-shaped component and operable to provide illumination to an interior of the dome-shaped component through the dome-shaped component; and

the at least one camera positioned in accordance with the determination by the at least one sensor and outside of the dome-shaped component to capture images of the item positioned within the dome-shaped component and in the plurality of orientations.

17 . The apparatus of claim 16 , wherein the at least one camera is configured to capture at least one image of the item through the first window when the item is positioned away from the mid plane and positioned closer to the first opening than to the second opening.

18 . The apparatus of claim 17 , wherein the at least one camera is configured to capture an image of the item through the second window when the item is positioned on the mid plane.

19 . The apparatus of claim 18 , wherein the plurality of lights include:

lights positioned to provide lighting in directions down towards relative to the dome-shaped component; and

lights positioned to provide lighting in directions up towards relative to the dome-shaped component.

20 . The apparatus of claim 19 , wherein the plurality of lights further include lights positioned above the first opening to provide lighting in directions from the first opening to the second opening.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2023
From: ZHOU, YAN; LI, JISHENG; HUANG, GEORGE; CHEN, CHEN
To: FUTURE DIAL, INC.
Reel/Frame 065388/0325 →
Continuity (2)
Continuation 17028239 · Sep 22, 2020
Related Publication 20240062363A1 · Feb 22, 2024
References Cited (86)
US 4677473A · Okamoto et al. · 1987 [cited by applicant]
US 4847663A · Query · 1989 [cited by applicant]
US 5051872A · Anderson · 1991 [cited by applicant]
US 5619429A · Aloni et al. · 1997 [cited by applicant]
US 5684530A · White · 1997 [cited by examiner]
US 5845002A · Heck et al. · 1998 [cited by applicant]
US 6788886B2 · Saigo et al. · 2004 [cited by applicant]
US 7386227B1 · Henderson · 2008 [cited by applicant]
US 7826675B2 · Kisilev · 2010 [cited by applicant]
US 7881965B2 · Bowles et al. · 2011 [cited by applicant]
US 8358813B2 · Free · 2013 [cited by applicant]
US 9117137B2 · Uchiyama et al. · 2015 [cited by applicant]
US 10419054B1 · Vantassell et al. · 2019 [cited by applicant]
US 10713775B2 · Bae et al. · 2020 [cited by applicant]
US 10753882B1 · Mahajan et al. · 2020 [cited by applicant]
US 10921685B2 · Espinosa · 2021 [cited by applicant]
US 11481568B1 · Lozano et al. · 2022 [cited by applicant]
US 11836912B2 · Zhou et al. · 2023 [cited by applicant]
US 11900581B2 · Zhou et al. · 2024 [cited by applicant]
US 20020128790A1 · Woodmansee · 2002 [cited by applicant]
US 20030184740A1 · Paradis · 2003 [cited by examiner]
US 20050134853A1 · Ingleson · 2005 [cited by examiner]
US 20060018530A1 · Oaki et al. · 2006 [cited by applicant]
US 20060180775A1 · Paradis · 2006 [cited by applicant]
US 20070223231A1 · Maes · 2007 [cited by applicant]
US 20090213601A1 · Clugston, Jr. · 2009 [cited by applicant]
US 20120327207A1 · Oe et al. · 2012 [cited by applicant]
US 20130046699A1 · Bowles et al. · 2013 [cited by applicant]
US 20140267691A1 · Humphrey et al. · 2014 [cited by applicant]
US 20160210734A1 · Kass et al. · 2016 [cited by applicant]
US 20170053394A1 · Uemura · 2017 [cited by applicant]
US 20170256051A1 · Dwivedi et al. · 2017 [cited by applicant]
US 20170330158A1 · Librizzi et al. · 2017 [cited by applicant]
US 20180130197A1 · Weiss et al. · 2018 [cited by applicant]
US 20180232875A1 · Kanodia et al. · 2018 [cited by applicant]
US 20180246895A1 · Kass et al. · 2018 [cited by applicant]
US 20190035066A1 · Bae et al. · 2019 [cited by applicant]
US 20190096057A1 · Allen et al. · 2019 [cited by applicant]
US 20190182440A1 · Xin · 2019 [cited by examiner]
US 20190281781A1 · Borrowman et al. · 2019 [cited by applicant]
US 20190303717A1 · Bhaskar et al. · 2019 [cited by applicant]
US 20200005070A1 · Ambikapathi et al. · 2020 [cited by applicant]
US 20200045828A1 · Tesanovic et al. · 2020 [cited by applicant]
US 20200074615A1 · Nabavi et al. · 2020 [cited by applicant]
US 20200175352A1 · Cha et al. · 2020 [cited by applicant]
US 20200182801A1 · Fang · 2020 [cited by examiner]
US 20200265487A1 · Silva et al. · 2020 [cited by applicant]
US 20200313612A1 · He et al. · 2020 [cited by applicant]
US 20210110440A1 · Dion et al. · 2021 [cited by applicant]
US 20210116392A1 · Fitzgerald et al. · 2021 [cited by applicant]
US 20210192484A1 · Forutanpour et al. · 2021 [cited by applicant]
US 20210192695A1 · Kosaka et al. · 2021 [cited by applicant]
US 20210279858A1 · Stoppe et al. · 2021 [cited by applicant]
US 20210299879A1 · Pinter et al. · 2021 [cited by applicant]
US 20210304393A1 · Ota et al. · 2021 [cited by applicant]
US 20210312702A1 · Holzer et al. · 2021 [cited by applicant]
US 20210317712A1 · Zhao et al. · 2021 [cited by applicant]
US 20210342979A1 · Lee · 2021 [cited by examiner]
US 20220051507A1 · Forutanpour et al. · 2022 [cited by applicant]
US 20220092757A1 · Zhou et al. · 2022 [cited by applicant]
US 20220092763A1 · Zhou et al. · 2022 [cited by applicant]
US 20220172346A1 · Chen et al. · 2022 [cited by applicant]
US 20240185407A1 · Zhou et al. · 2024 [cited by applicant]
CA 2861423 · 2013 [cited by applicant]
CN 110290257 · 2019 [cited by applicant]
CN 110646432 · 2020 [cited by applicant]
CN 111157532 · 2020 [cited by applicant]
CN 111257329 · 2020 [cited by applicant]
EP 3418725 · 2018 [cited by applicant]
JP 2004301776 · 2004 [cited by applicant]
JP 2015076504 · 2015 [cited by applicant]
KR 101907349 · 2018 [cited by applicant]
KR 20210025482 · 2021 [cited by applicant]
WO 2021082918 · 2021 [cited by applicant]
WO 2021156756 · 2021 [cited by applicant]
CTIATM Wireless Device Grading Scales Criteria and Definitions, Version 1, CTIA—The Wireless Association, Dec. 2018. [cited by applicant]
D. Marr, et al. “Theory of edge detection.” Royal Society Publishing, 1980. [cited by applicant]
Fangfang Han, et al. “Study of Defect Segmentation from a Mode Background Image.” Proceedings of 2019 IEEE International Conference on Mechatronics and Automation (ICMA), IEEE, Aug. 4-7, 2019. [cited by applicant]
Kong, Hui, et al., “Accurate and Efficient Inspection of Speckle and Scratch Defects on Surfaces of Planar Products.” IEEE Transactions on Industrial Informatics, Aug. 2017. [cited by applicant]
Markus Stutz, et al. “Linking Bar Codes to Recycling Information for Mobile Phones.” IEEE International Symposium on Electronics and the Environment, IEEE, 2004. [cited by applicant]
Oge marques, “Image Segmentation.” Practical Image and Video Processing Using MATLAB, IEEE, 2011. [cited by applicant]
Tamas Czimmerman, et al. “Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A Survey.” MDPI, Mar. 6, 2020. [cited by applicant]
Voishvillo, N. A., et al., “Transmission of Milk Glass Under Diffuse and Directional Illumination.” Plenum Publishing Corporation, 1984. [cited by applicant]
Weixuan Sun, et al. “Structural Edge Detection: A Dataset and Benchmark.” 2018 Digital image Computing: Techniques and Applications (DICTA), IEEE, 2018. [cited by applicant]
Xifeng Liu, et al. “Inspection of IC wafer Defects Based on Image Registration.” 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAD), IEEE, 2018. [cited by applicant]
Zixuan Wang, et al. “Review of used Mobile Phone Recognition Method for Recycling Equipment.” Proceedings of the 39th Chiense Control Conference, Jul. 27-29, 2020. [cited by applicant]