In Machine vision and applications
Every year, the VISion Understanding and Machine intelligence (VISUM) summer school runs a competition where participants can learn and share knowledge about Computer Vision and Machine Learning in a vibrant environment. 2021 VISUM's focused on applying those methodologies in fashion. Recently, there has been an increase of interest within the scientific community in applying computer vision methodologies to the fashion domain. That is highly motivated by fashion being one of the world's largest industries presenting a rapid development in e-commerce mainly since the COVID-19 pandemic. Computer Vision for Fashion enables a wide range of innovations, from personalized recommendations to outfit matching. The competition enabled students to apply the knowledge acquired in the summer school to a real-world problem. The ambition was to foster research and development in fashion outfit complementary product retrieval by leveraging vast visual and textual data with domain knowledge. For this, a new fashion outfit dataset (acquired and curated by FARFETCH) for research and benchmark purposes is introduced. Additionally, a competitive baseline with an original negative sampling process for triplet mining was implemented and served as a starting point for participants. The top 3 performing methods are described in this paper since they constitute the reference state-of-the-art for this particular problem. To our knowledge, this is the first challenge in fashion outfit complementary product retrieval. Moreover, this joint project between academia and industry brings several relevant contributions to disseminating science and technology, promoting economic and social development, and helping to connect early-career researchers to real-world industry challenges.
Castro Eduardo, Ferreira Pedro M, Rebelo Ana, Rio-Torto Isabel, Capozzi Leonardo, Ferreira Mafalda Falcão, Gonçalves Tiago, Albuquerque Tomé, Silva Wilson, Afonso Carolina, Gamelas Sousa Ricardo, Cimarelli Claudio, Daoudi Nadia, Moreira Gabriel, Yang Hsiu-Yu, Hrga Ingrid, Ahmad Javed, Keswani Monish, Beco Sofia
2023
Computer vision, Deep learning, Fashion intelligence, Image retrieval, Summer school competition
