Senior Lecturer of DADiII Ilya Makarov at the 43rd International Conference on Telecommunications and Signal Processing (TSP), Milan, Italy, July 7-9

I. Makarov made a presentation “Real-Time 3D Model Reconstruction and Mapping for Fashion” at the conference TSP2020 on the topic of virtual fitting rooms based on machine learning models. Due to the restrictions on the pandemic, the conference was held online.

The report was prepared based on the materials of joint research with the graduate of the PMI FKN Daniil Chernyshev.
Abstract:
Recent developments in the apparel market created new tasks for computer vision application. One such challenge is designing a system for trying on clothes virtually in real-time. Proposed solutions require setting up a special stationary system for body capture and mostly generate animated avatar instead of overlaying the garments in real-time. A framework that utilizes state-of-the-art monocular-based 3D skeleton reconstruction and parametric body generation techniques allowing to operate under constrained resources, such as smartphones has been proposed. In addition, we also consider the problem of dealing with visual artifacts as a result of 3D projection on a real-time image and design a solution to reduce them based on iterative closest point method.
Published in: 2020 43rd International Conference on Telecommunications and Signal Processing (TSP)
Date of Conference: 7-9 July 2020
TSP2020