Establishing colour harmony evaluation and recommendation model for clothing colour matching based on machine learning and deep learning
Source abstract
Abstract
Abstract Appropriate colour combinations improved aesthetic design quality and provided a comfortable and pleasant visual experience. However, applying current colour harmony models to clothing colour matching raised doubts about whether the existing theory needed to be refined, requiring further clarification with modern aesthetic perspectives. The study conducted a psychophysical experiment to investigate modern people's perceptions of colour harmony in clothing colour combinations. The results indicated that modern perceptions of colour harmony in clothing differed significantly from previous theories. For applications, two colour harmony models were established with unified fashion datasets for evaluating clothes matching based on colour harmony rules and observers' perceptions. The result showed that the rule-based model could accurately predict all items following nine colour harmony theories, and the perception-based colour harmony evaluation models aligned with contemporary aesthetic preferences were developed with a semi-supervised learning approach. The models, including support vector machines and custom convolutional neural networks, could predict colour harmony perception for the input images with high performance, and the model based on the generative adversarial network could provide colour recommendations for colour matching. The machine learning and deep learning model proposed in the study could be used for aesthetic judgment to generate clothing colour recommendations and provide valid design suggestions for clothing colour matching in the fashion and clothing industry.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Color perception and design · Color Science and Applications · Aesthetic Perception and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (50)
Show source-provided references
1. An, H., Lee, K. Y., Choi, Y., & Park, M. (2023). Conceptual framework of hybrid style in fashion image datasets for machine learning. Fashion and Textiles, 10(1), Article 18. https://doi.org/10.1186/s40691-023-00338-810.1186/s40691-023-00338-8 ↗
2. Bai, Y., & Xue, Y. (2021). Study on multi-color emotion based on fashion color in 2019. International Journal of Clothing Science and Technology, 33(3), 388–401. https://doi.org/10.1108/IJCST-06-2019-008410.1108/IJCST-06-2019-0084 ↗
3. Burchett, K. E. (1991). Color harmony attributes. Color Research and Application, 16(4), 275–278. https://doi.org/10.1002/col.508016041010.1002/col.5080160410 ↗
4. Choi, W., Jang, S., Kim, H. Y., Lee, Y., Lee, S.-G., Lee, H., & Park, S. (2023). Developing an AI-based automated fashion design system: Reflecting the work process of fashion designers. Fashion and Textiles, 10(1), Article 39. https://doi.org/10.1186/s40691-023-00360-w10.1186/s40691-023-00360-w ↗
5. Gong, S. M., & Lee, W. Y. (2019). Colour harmony of two-colour combinations using a 3D colour configuration. Coloration Technology, 135(4), 292–304. https://doi.org/10.1111/cote.1240510.1111/cote.12405 ↗
6. Goree, S., & Crandall, D. (2020, June 14–19). Studying empirical color harmony in design. CVPR Worksh, 1. In: Proc. of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition. Seattle, WA, United States.
7. Gu, X., Gao, F., Tan, M., & Peng, P. (2020). Fashion analysis and understanding with artificial intelligence. Information Processing & Management, 57(5), Article 102276. https://doi.org/10.1016/j.ipm.2020.10227610.1016/j.ipm.2020.102276 ↗
8. Gu, Z., & Lou, J. (2016). Data driven webpage color design. Computer-Aided Design, 77, 46–59. https://doi.org/10.1016/j.cad.2016.03.00110.1016/j.cad.2016.03.001 ↗
9. Guan, C., Qin, S., Ling, W., & Ding, G. (2016). Apparel recommendation system evolution: An empirical review. International Journal of Clothing Science and Technology, 28(6), 854–879. https://doi.org/10.1108/IJCST-09-2015-010010.1108/IJCST-09-2015-0100 ↗
10. Hård, A., & Sivik, L. (2001). A theory of colors in combination—a descriptive model related to the NCS color-order system. Color Research & Application, 26(1), 4–28. https://doi.org/10.1002/1520-6378(200102)26:1%3c4::AID-COL3%3e3.0.CO;2-T10.1002/1520-6378(200102)26:1<4::AID-COL3>3.0.CO;2-T ↗
11. Hong, Y., Zeng, X., Brunixaux, P., & Chen, Y. (2018). Evaluation of fashion design using artificial intelligence tools. In S. Thomassey & X. Zeng (Eds.), Artificial intelligence for fashion industry in the big data era (pp. 245–256). Springer.10.1007/978-981-13-0080-6_12 ↗
12. Hsiao, S. W., Yang, M. H., & Lee, C. H. (2017). An aesthetic measurement method for matching colours in product design. Color Research and Application, 42(5), 664–683. https://doi.org/10.1002/col.2212410.1002/col.22124 ↗
13. Huang, M., Cui, G., Melgosa, M., García, P. A., Liu, H., Liu, Y., & Luo, M. R. (2017). Color harmony in two-piece garments. Color Research and Application, 42(4), 498–511. https://doi.org/10.1002/col.2209910.1002/col.22099 ↗
14. Jiang, Y., Yang, S., Qiu, H., Wu, W., Loy, C. C., & Liu, Z. (2022). Text2human: Text-driven controllable human image generation. Acm Transactions on Graphics, 41(4), 1–11. https://doi.org/10.1145/3528223.353010410.1145/3528223.3530104 ↗
15. Judd, D. B., Wyszecki, G., & Wintringham, W. (1963). Color in business, science, and industry. Physics Today. https://doi.org/10.1063/1.305067110.1063/1.3050671 ↗
16. Katayama, I., Noguchi, S., Takata, R., & Segawa, K. (2022). Application of colour feelings prediction formulas to the estimation of two-colour combination feelings of “Kimono.” Journal of the International Colour Association, 29, 11–21. https://doi.org/10.9763/jjsse.27.710.9763/jjsse.27.7 ↗
17. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A., Lo, W.-Y., Dollar, P., & Girshick, R. (2023, October 2–6). Segment anything. Proceedings of the IEEE/CVF international conference on computer vision, Paris, France10.1109/ICCV51070.2023.00371 ↗
18. Lin, Y., Ren, P., Chen, Z., Ren, Z., Ma, J., & De Rijke, M. (2019). Explainable outfit recommendation with joint outfit matching and comment generation. IEEE Transactions on Knowledge and Data Engineering, 32(8), 1502–1516. https://doi.org/10.1109/TKDE.2019.290619010.1109/TKDE.2019.2906190 ↗
19. Liu, I.-H., & Ou, L.-C. (2017). Colour Harmony in clothing, skin tones and hair colours for applications of online shopping. AIC 2017 Jeju, 87–87.
20. Liu, L., Zhang, H., Ji, Y., & Wu, Q. J. (2019). Toward AI fashion design: An Attribute-GAN model for clothing match. Neurocomputing, 341, 156–167. https://doi.org/10.1016/j.neucom.2019.03.01110.1016/j.neucom.2019.03.011 ↗
21. Lu, P., Peng, X., Li, R., & Wang, X. (2015). Towards aesthetics of image: A Bayesian framework for color harmony modeling. Signal Processing-Image Communication, 39, 487–498. https://doi.org/10.1016/j.image.2015.04.00310.1016/j.image.2015.04.003 ↗
22. Lu, P., Peng, X., Yuan, C., Li, R., & Wang, X. (2016a). Image color harmony modeling through neighbored co-occurrence colors. Neurocomputing, 201, 82–91. https://doi.org/10.1016/j.neucom.2016.03.03510.1016/j.neucom.2016.03.035 ↗
23. Lu, P., Peng, X., Zhu, X., & Li, R. (2016b). An EL-LDA based general color harmony model for photo aesthetics assessment. Signal Processing, 120, 731–745. https://doi.org/10.1016/j.sigpro.2014.12.00810.1016/j.sigpro.2014.12.008 ↗
24. Moon, P., & Spencer, D. E. (1944). Aesthetic measure applied to color harmony. JOSA, 34(4), 234–242. https://doi.org/10.1364/JOSA.34.00023410.1364/JOSA.34.000234 ↗
25. Munsell, A. H., Cleland, T. M., & Birren, F. (1969). A grammar of color: A basic treatise on the color system of Albert H. Van Nostrand Reinhold.
26. Murgård, H., & Ståhl, A. (2023). Color Tolerances in Vehicle Design.
27. Ng, W. L. (2021). The teaching of the concept of color harmony and its ambiguity. Asia-Pacific Journal of Humanities and Social Sciences. https://doi.org/10.53789/j.1653-0465.2021.0102.00210.53789/j.1653-0465.2021.0102.002 ↗
28. O’Connor, Z. (2010). Colour harmony revisited. Color Research and Application, 35(4), 267–273. https://doi.org/10.1002/col.2057810.1002/col.20578 ↗
29. Odabaşıoğlu, S., & Olguntürk, N. (2020). Effect of area on color harmony in simulated interiors. Color Research and Application, 45(4), 710–727. https://doi.org/10.1002/col.2250810.1002/col.22508 ↗
30. Ou, L.-C. (2015). Color emotion and color harmony. In A. J. Elliot, M. D. Fairchild, & A. Franklin (Eds.), Handbook of color psychology (pp. 401–418). Cambridge University Press.10.1017/CBO9781107337930.020 ↗
31. Ou, L. C., & Luo, M. R. (2006). A colour harmony model for two-colour combinations. Color Research and Application, 31(3), 191–204. https://doi.org/10.1002/col.2020810.1002/col.20208 ↗
32. Ou, L. C., Luo, M. R., Woodcock, A., & Wright, A. (2004). A study of colour emotion and colour preference. Part II: Colour emotions for two-colour combinations. Color Research and Application, 29(4), 292–298. https://doi.org/10.1002/col.2002410.1002/col.20024 ↗
33. Ou, L. C., Yuan, Y., Sato, T., Lee, W. Y., Szabó, F., Sueeprasan, S., & Huertas, R. (2018). Universal models of colour emotion and colour harmony. Color Research and Application, 43(5), 736–748. https://doi.org/10.1002/col.2224310.1002/col.22243 ↗
34. Pan, S., Wang, P., & Yang, C. (2024). Optimization of automatic classification for women’s pants based on the swin transformer model. Fashion and Textiles, 11(1), Article 42. https://doi.org/10.1186/s40691-024-00408-510.1186/s40691-024-00408-5 ↗
35. Park, E. Y., Lee, L. E., & Park, Y. H. (2010, July 9–11). Harmonious Color Combination Rules based on Natural Color System. 3rd IEEE International Conference on Computer Science and Information Technology (ICCSIT), Chengdu, China
36. Park, J. (2017). A study on colour associations and clothing colour choices in Korea. International Journal of Fashion Design, Technology and Education, 10(1), 46–58. https://doi.org/10.1080/17543266.2016.118432210.1080/17543266.2016.1184322 ↗
37. Paterson, I. (2003). A dictionary of colour: A lexicon of the language of colour. Thorogood.
38. Rostami, M., Izadan, H., & Mahyar, F. (2015). Colour emotion models, CIELAB colour coordinates, and Iranian emotional responses. Journal of Textiles and Polymers, 3(2), 46–54.
39. Shamoi, P., Inoue, A., & Kawanaka, H. (2016). Fuzzy model for human color perception and its application in e-commerce. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 24, 47–70. https://doi.org/10.1142/S021848851640010910.1142/S0218488516400109 ↗
40. Shamoi, P., Inoue, A., & Kawanaka, H. (2020). Modeling aesthetic preferences: Color coordination and fuzzy sets. Fuzzy Sets and Systems, 395, 217–234. https://doi.org/10.1016/j.fss.2019.02.01410.1016/j.fss.2019.02.014 ↗
41. Sutton, T. M., & Altarriba, J. (2016). Color associations to emotion and emotion-laden words: A collection of norms for stimulus construction and selection. Behavior Research Methods, 48, 686–728. https://doi.org/10.3758/s13428-015-0598-810.3758/s13428-015-0598-8 ↗
42. Suvarna, B., & Balakrishna, S. (2024). Enhanced content-based fashion recommendation system through deep ensemble classifier with transfer learning. Fashion and Textiles, 11(1), 24–52. https://doi.org/10.1186/s40691-024-00382-y10.1186/s40691-024-00382-y ↗
43. Wang, H., & Rasheed, K. (2014, July 21–24). Artificial intelligence in clothing fashion. Proceedings on the International Conference on Artificial Intelligence (ICAI), Las Vegas, United States.
44. Wang, S., Liu, J., Jiang, J., Jiang, Y., & Lan, J. (2022b). Attribute analysis and modeling of color harmony based on multi-color feature extraction in real-life scenes. Frontiers in Psychology, 13, Article 945951. https://doi.org/10.3389/fpsyg.2022.94595110.3389/fpsyg.2022.945951 ↗
45. Wang, S., Liu, J., Liu, S., Yin, B., Jiang, J., & Lan, J. (2022a). Research on attribute analysis and modeling of color harmony based on objective and subjective factors. IEEE Access, 10, 75074–75096. https://doi.org/10.1109/ACCESS.2022.319038610.1109/ACCESS.2022.3190386 ↗
46. Weingerl, P., & Javoršek, D. (2018). Theory of colour harmony and its application. Tehnički Vjesnik, 25(4), 1243–1248. https://doi.org/10.17559/TV-2017031609285210.17559/TV-20170316092852 ↗
47. Westland, S., Laycock, K., Cheung, V., Henry, P., & Mahyar, F. (2007). Colour harmony. Color: Design & Creativity, 1(1), 1–15.
48. Wicaksono, S. H., Fu, T.-H., Chen, L.-Y., Hou, C.-Y., & Ou, L.-C. (2015). Colour harmony of two colour combinations in clothes matching. International Seminar on Photonics, Optics, and Its Applications (ISPhOA 2014), https://doi.org/10.1117/12.207482810.1117/12.2074828 ↗
49. Yang, G., & Zhang, X. (2015). Computer-aided colour harmony design based on artificial physics optimisation. International Journal of Wireless and Mobile Computing, 9(2), 170–176. https://doi.org/10.1504/IJWMC.2015.07257510.1504/IJWMC.2015.072575 ↗
50. Yaxyoxonovich, X. B. (2021). Study and scientific analysis of clothing colours. Central Asian Journal of Arts and Design, 2(11), 60–63.