IP Library Granted Patent US 12,380,673
Granted Patent B2
US 12,380,673 · App. 18/163,090 · Granted Aug 5, 2025

Image-based matching of color and appearance of coatings containing effect pigments, using binary patterns derived from color model properties

Inventors: Sebastian Hurtado Parra (Philadelphia, PA); Neil R. Murphy (Audubon, NJ); Francisco Miguel Martínez Verdú (Upper Darby, PA); Anthony Calabria (Thornton, PA); Larry Steenhoek (Ellicott City, MD); Benjamin Gamoke (Collingswood, NJ)
Assignee: AXALTA COATING SYSTEMS IP CO., LLC
G06V10/758G06T7/0004G06T7/90G06T2207/10024G06T2207/30156
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,380,673
App. No.
18/163,090
Granted
Aug 5, 2025
Kind
B2
Abstract

Disclosed here is a method of matching color and appearance of coatings containing at least one effect pigment. The method involves: obtaining, for a coating sample to be matched, sample color image data having pixel-specific color model properties; creating local binary patterns based on the pixel-specific color model properties; generating a binary pattern histogram for the local binary patterns, wherein the binary pattern histogram arranges the local binary patterns into N distinct bins to obtain N bin counts, and wherein the binary pattern histogram represents an appearance feature descriptor of the coating sample to be matched; and utilizing the binary pattern histogram for comparison against a previously generated binary pattern histogram that serves as an appearance feature descriptor of a candidate coating specimen.

Claims (64)

1. A method of matching color and appearance of coatings containing at least one effect pigment, the method comprising:

obtaining, for a coating sample to be matched, sample color image data comprising pixel-specific color model properties, wherein the sample color image data is based on a digital image of the coating sample to be matched, as captured by a digital image capture system;

creating local binary patterns based on the pixel-specific color model properties;

generating a binary pattern histogram for the local binary patterns, wherein the binary pattern histogram arranges the local binary patterns into N distinct bins to obtain N bin counts, and wherein the binary pattern histogram represents an appearance feature descriptor of the coating sample to be matched; and

utilizing the binary pattern histogram for comparison against a previously generated binary pattern histogram that serves as an appearance feature descriptor of a candidate coating specimen,

wherein the local binary patterns are placed into a bin depending on the positions of 0s and 1s in the local binary pattern relative to each other without regard to the numerical value of the local binary pattern.

2. The method of claim 1 , wherein the utilizing step comprises:

creating a sample histogram vector from the binary pattern histogram, wherein the sample histogram vector is an N-dimensional vector comprising the N bin counts.

3. The method of claim 2 , wherein the utilizing step further comprises:

comparing the sample histogram vector against a specimen histogram vector, wherein the specimen histogram vector is an N-dimensional vector derived from pixel-specific color model properties and corresponding binary patterns obtained for the candidate coating specimen in response to a captured digital image of the candidate coating specimen.

4. The method of claim 3 , wherein the comparing step comprises:

calculating a cosine similarity value from the sample histogram vector and the specimen histogram vector as a measure of an angle between the sample histogram vector and the specimen histogram vector, wherein the cosine similarity value indicates how well the candidate coating specimen matches the coating sample to be matched.

5. The method of claim 3 , wherein the comparing step comprises:

calculating a distance metric from the sample histogram vector and the specimen histogram vector, wherein the calculated distance metric indicates how well the candidate coating specimen matches the coating sample to be matched.

6. The method of claim 1 , further comprising:

calculating a match score for the candidate coating specimen relative to the coating sample to be matched.

7. The method of claim 6 , further comprising:

retrieving a production formulation associated with the candidate coating specimen, when the calculated match score satisfies predetermined matching criteria.

8. The method of claim 1 , further comprising:

receiving the digital image captured by the digital image capture system, the digital image represented by captured color image data that is formatted in accordance with a first color model; and

converting the captured color image data into the sample color image data, wherein the sample color image data is formatted in accordance with a second color model that includes the color model properties.

9. The method of claim 8 , wherein:

the first color model is an RGB color model;

the second color model includes pixel-specific hue values as one of the color model properties; and

the pixel-specific hue values are hue angles within the range of 0 degrees to 360 degrees, inclusive.

10. The method of claim 1 , further comprising:

segmenting the sample color image data to identify sparkle pixels that exhibit visually distinguishable sparkle effects, wherein the creating step only creates local binary patterns for the identified sparkle pixels.

11. The method of claim 1 , wherein at least one of the N distinct bins is established and maintained to group local binary patterns that are associated with similar color and appearance characteristics.

12. At least one non-transitory machine-readable storage medium that stores instructions executable by at least one processor, the instructions configurable to cause the at least one processor to perform a method of matching color and appearance of coatings containing at least one effect pigment, the method comprising:

obtaining, for a coating sample to be matched, sample color image data comprising pixel-specific color model properties, wherein the sample color image data is based on a digital image of the coating sample to be matched, as captured by a digital image capture system;

creating local binary patterns based on the pixel-specific color model properties;

generating a binary pattern histogram for the local binary patterns, wherein the binary pattern histogram arranges the local binary patterns into N distinct bins to obtain N bin counts, and wherein the binary pattern histogram represents an appearance feature descriptor of the coating sample to be matched; and

utilizing the binary pattern histogram for comparison against a previously generated binary pattern histogram that serves as an appearance feature descriptor of a candidate coating specimen, wherein the local binary patterns are placed into a bin depending on the positions of 0s and 1s relative to each other in the local binary pattern without regard to the numerical value of the local binary pattern.

13. The at least one non-transitory machine-readable storage medium of claim 12 , wherein the utilizing step comprises:

creating a sample histogram vector from the binary pattern histogram, wherein the sample histogram vector is an N-dimensional vector comprising the N bin counts.

14. The at least one non-transitory machine-readable storage medium of claim 13 , wherein the utilizing step further comprises:

comparing the sample histogram vector against a specimen histogram vector, wherein the specimen histogram vector is an N-dimensional vector derived from pixel-specific color model properties and corresponding binary patterns obtained for the candidate coating specimen in response to a captured digital image of the candidate coating specimen.

15. The at least one non-transitory machine-readable storage medium of claim 12 , wherein the method performed by the at least one processor further comprises:

calculating a match score for the candidate coating specimen relative to the coating sample to be matched; and

retrieving a production formulation associated with the candidate coating specimen, when the calculated match score satisfies predetermined matching criteria.

16. The at least one non-transitory machine-readable storage medium of claim 12 , wherein the method performed by the at least one processor further comprises the steps of:

receiving the digital image captured by the digital image capture system, the digital image represented by captured image data that is formatted in accordance with an RGB color model; and

converting the captured image data into the sample color image data, wherein the sample color image data is formatted in accordance with a second color model that includes the color model properties.

17. The at least one non-transitory machine-readable storage medium of claim 12 , wherein the method performed by the at least one processor further comprises the step of:

segmenting the sample color image data to identify sparkle pixels that exhibit visually distinguishable sparkle effects, wherein the creating step only creates local binary patterns for the identified sparkle pixels.

18. The at least one non-transitory machine-readable storage medium of claim 12 , wherein at least one of the N distinct bins is established and maintained to group local binary patterns that are associated with similar color and appearance characteristics.

19. A computing system operable to match color and appearance of coatings containing at least one effect pigment, the computing system comprising:

at least one processor; and

at least one non-transitory machine-readable storage medium that stores instructions executable by the at least one processor, the instructions configurable to cause the at least one processor to perform a method comprising the steps of:

obtaining, for a coating that contains at least one effect pigment, color image data comprising pixel-specific color model properties, wherein the color image data is based on a digital image of the coating, as captured by a digital image capture system;

creating local binary patterns based on the pixel-specific color model properties;

generating a binary pattern histogram for the local binary patterns, wherein the binary pattern histogram arranges the local binary patterns into N distinct bins to obtain N bin counts, and wherein the binary pattern histogram represents an appearance feature descriptor of the coating; and

creating a coating histogram vector based on the binary pattern histogram, wherein the coating histogram vector is an N-dimensional vector comprising the N bin counts, wherein the coating histogram vector is usable for comparing color and appearance of the coating against color and appearance of at least one other coating, wherein the local binary patterns are placed into a bin depending on the positions of 0s and 1s relative to each other in the local binary pattern without regard to the numerical value of the local binary pattern.

20. The computing system of claim 19 , wherein the method performed by the at least one processor further comprises the step of:

storing the coating histogram vector in a database associated with the system.

21. The computing system of claim 19 , wherein the method performed by the at least one processor further comprises the steps of:

retrieving a specimen histogram vector for comparison against the coating histogram vector, wherein the specimen histogram vector is an N-dimensional vector derived from pixel-specific color model properties obtained for a candidate coating specimen in response to a captured digital image of the candidate coating specimen; and

comparing the coating histogram vector against the specimen histogram vector.

22. The computing system of claim 19 , wherein the method performed by the at least one processor further comprises the steps of:

calculating a match score for a candidate coating specimen relative to the coating; and

retrieving a production formulation associated with the candidate coating specimen, when the calculated match score satisfies predetermined matching criteria.

23. The computing system of claim 19 , wherein the method performed by the at least one processor further comprises the step of:

segmenting the sample color image data to identify sparkle pixels that exhibit visually distinguishable sparkle effects, wherein the creating step only creates local binary patterns for the identified sparkle pixels.

24. The computing system of claim 19 , wherein at least one of the N distinct bins is established and maintained to group local binary patterns that are associated with similar color and appearance characteristics.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2023
From: PARRA, SEBASTIAN HURTADO; MURPHY, NEIL R; VERDÚ, FRANCISCO MIGUEL MARTÍNEZ; CALABRIA, ANTHONY; STEENHOEK, LARRY; GAMOKE, BENJAMIN
To: AXALTA COATING SYSTEMS IP CO., LLC
Reel/Frame 062575/0834 →
Continuity (1)
Related Publication 20240257493A1 · Aug 1, 2024
References Cited (77)
US 6564202B1 · Schuetze · 2003 [cited by examiner]
US 6567797B1 · Schuetze · 2003 [cited by examiner]
US 6598054B2 · Schuetze · 2003 [cited by examiner]
US 6708167B2 · Lee · 2004 [cited by examiner]
US 6728752B1 · Chen · 2004 [cited by examiner]
US 6941321B2 · Schuetze · 2005 [cited by examiner]
US 7679756B2 · Sperling et al. · 2010 [cited by applicant]
US 8065314B2 · Prakash et al. · 2011 [cited by applicant]
US 8909574B2 · Mohammadi et al. · 2014 [cited by applicant]
US 9064149B1 · Dhua · 2015 [cited by examiner]
US 9607403B2 · Beymore et al. · 2017 [cited by applicant]
US 9880098B2 · Prakash et al. · 2018 [cited by applicant]
US 10613727B2 · Beymore et al. · 2020 [cited by applicant]
US 10950008B2 · Beymore et al. · 2021 [cited by applicant]
US 11062479B2 · Steenhoek et al. · 2021 [cited by applicant]
US 11361418B2 · Yuan · 2022 [cited by examiner]
US 20020106122A1 · Messing · 2002 [cited by examiner]
US 20040091135A1 · Bourg, Jr. · 2004 [cited by examiner]
US 20040197012A1 · Bourg, Jr. · 2004 [cited by examiner]
US 20050033523A1 · Abe · 2005 [cited by examiner]
US 20050084154A1 · Li · 2005 [cited by examiner]
US 20060033922A1 · Sperling et al. · 2006 [cited by applicant]
US 20070091184A1 · Wang · 2007 [cited by examiner]
US 20080069427A1 · Liu · 2008 [cited by examiner]
US 20090019086A1 · Prakash et al. · 2009 [cited by applicant]
US 20090324077A1 · Wu · 2009 [cited by examiner]
US 20110150344A1 · Lee · 2011 [cited by examiner]
US 20130163870A1 · Cao · 2013 [cited by examiner]
US 20130251252A1 · Wang · 2013 [cited by examiner]
US 20140023280A1 · Lin · 2014 [cited by examiner]
US 20140193071A1 · Cho · 2014 [cited by examiner]
US 20140204238A1 · Cao · 2014 [cited by examiner]
US 20140294300A1 · Swaminathan · 2014 [cited by examiner]
US 20150286892A1 · Ohno · 2015 [cited by examiner]
US 20160005187A1 · Prakash · 2016 [cited by examiner]
US 20160132720A1 · Klare · 2016 [cited by examiner]
US 20160142700A1 · Grover · 2016 [cited by examiner]
US 20160189003A1 · Liu · 2016 [cited by examiner]
US 20170200288A1 · Beymore · 2017 [cited by examiner]
US 20170372128A1 · Owen · 2017 [cited by examiner]
US 20180122065A1 · Abedini · 2018 [cited by examiner]
US 20190096073A1 · Nishimura · 2019 [cited by examiner]
US 20210073891A1 · Al Jadda · 2021 [cited by examiner]
US 20210201513A1 · Steenhoek · 2021 [cited by examiner]
US 20210239531A1 · Steenhoek et al. · 2021 [cited by applicant]
US 20210248418A1 · Guo · 2021 [cited by examiner]
US 20220107222A1 · Bischoff · 2022 [cited by examiner]
US 20220304617A1 · Kim · 2022 [cited by examiner]
US 20220381615A1 · Bischoff · 2022 [cited by examiner]
US 20230145070A1 · Baughman · 2023 [cited by examiner]
US 20230191823A1 · Hsu · 2023 [cited by examiner]
US 20230221182A1 · Baughman · 2023 [cited by examiner]
US 20230237738A1 · Rump · 2023 [cited by examiner]
US 20230343051A1 · Rump · 2023 [cited by examiner]
US 20240135588A1 · Krawciw · 2024 [cited by examiner]
US 20240203145A1 · Hsu · 2024 [cited by examiner]
US 20240203150A1 · Hsu · 2024 [cited by examiner]
US 20240255352A1 · Parra · 2024 [cited by examiner]
US 20240257493A1 · Parra · 2024 [cited by examiner]
US 20240310213A1 · Verdú · 2024 [cited by examiner]
EP 3500830A1 · 2019 [cited by applicant]
EP 3937136A1 · 2022 [cited by applicant]
WO 2020200982A1 · 2020 [cited by applicant]
WO 2021013615A1 · 2021 [cited by applicant]
WO 2021055745A1 · 2021 [cited by applicant]
Ojala T. et al. “A comparative study of texture measures with classification based on feature distributions” dated Jan. 1, 1996, vol. 29 No. 1. [cited by applicant]
Matti Pietikainen “Two decades of local binary patterns: A survey In Advances in Independent Component Analysis and Learning Machines” dated Apr. 15, 2015, pp. 175-210. [cited by applicant]
Nguyen Hieu V. et al. “Cosine Similarity Metric Learning for Face Verification” dated Nov. 8, 2010, pp. 709-720. [cited by applicant]
ASTM E 284-17, “Standard Terminology of Appearance”, ASTM International, West Conshohocken, PA. 2017. [cited by applicant]
Dauser T. “Definition of Tolerances and Evaluation of the Difference in the Sparkling and Graininess of Effect Paints” Volkswagen (2010), pp. 1-6, vol. VW50194, No. 2010-09. [cited by applicant]
Ferrero A., et al. “An insight into the present capabilities of national metrology institutes for measuring sparkle”, Metrologia, Nov. 2020 pp. 2-19, vol. 57, IOP Publishing. [cited by applicant]
Ferrero A et al. “Preliminary measurement scales for sparkle and graininess” Research Article, Mar. 2021 pp. 1-12. vol. 29. [cited by applicant]
Kirchner Eric et al. “Visibility of Sparkle in Metallic Paints”, Research Article, Nov. 2014 pp. 1-7, vol. 32. [cited by applicant]
Kitaguchi S. “Modeling Texture Appearance of Gonioapparent Objects” University of Leeds PhD thesis, Mar. 2008 pp. 3-274. [cited by applicant]
Wei Ting Shou et al. “A Comprehensive Model of Colour Appearance for Related and Unrelated Colours of Varying Size Viewed Under Mesopic to Photopic Conditions” Color Research Application, Feb. 2014 pp. 293-304, vol. 42. [cited by applicant]
Yang Jie et al. “Predicting visual similarity between colour palettes”, Research Article, Jul. 2019 pp. 1-8, vol. 22492. [cited by applicant]
Zhongning H., et al. “Camera-based model to predict the total difference between effect coatings under directional illumination”. Chinese Optics Letters, Sep. 2011 pp. 1-5, vol. 9. [cited by applicant]
Cited By (1)
US 12,633,007