Welcome! I am a Ph.D Student at the University of Trento where I work with Elisa Ricci and Nicu Sebe at the Multimedia and Human Understanding Group MHUG. My research interests include the application of deep learning techniques to the computer vision field, in particular in the areas of image and video generation and of domain adaptation. My work has been published on high profile conferences and journals.
In concomitance with my earlier studies, I completed numerous interships in the industry and have succesfully fulfilled freelance contracts, acquiring on-field experience.Github LinkedIn Google Scholar
Playable Video Generation
Willi Menapace, Stéphane Lathuilière, Sergey Tulyakov, Aliaksandr Siarohin, Elisa Ricci
CVPR 2021 (Oral)
This paper introduces the unsupervised learning problem of playable video generation (PVG). In PVG, we aim at allowing a user to control the generated video by selecting a discrete action at every time step as when playing a videogame. The difficulty of the task lies both in learning semantically consistent actions and in generating realistic videos conditioned on the user input. We propose a novel framework for PVG that is trained in a self-supervised manner on a large dataset of unlabelled videos. We employ an encoder-decoder architecture where the predicted action labels act as ...
Learning to Cluster under Domain Shift
Willi Menapace, Stéphane Lathuilière, Elisa Ricci
While unsupervised domain adaptation methods based on deep architectures have achieved remarkable success in many computer vision tasks, they rely on a strong assumption, i.e. labeled source data must be available. In this work we overcome this assumption and we address the problem of transferring knowledge from a source to a target domain when both source and target data have no annotations. Inspired by recent works on deep clustering, our approach leverages information from data gathered from multiple source domains to build a domain-agnostic clustering model which is then refined at inference time when target data become available. ...
Deep Learning for Classification and Localization of COVID-19 Markers in Point-of-Care Lung Ultrasound
Subhankar Roy, Willi Menapace, Sebastiaan Oei, et al.
IEEE Transactions on Medical Imaging
Deep learning (DL) has proved successful inmedical imaging and, in the wake of the recent COVID-19 pandemic, some works have started to investigate DL-based solutions for the assisted diagnosis of lung diseases. While existing works focus on CT scans, this paper studies the application of DL techniques for the analysisof lung ultrasonography (LUS) images. Specifically, we present a novel fully-annotated dataset of LUS images collected from several Italian hospitals, with labels indicating the degree of disease severity at a frame-level, video-level, and pixel-level (segmentation masks). ...
- CVPR MULA 2021
- ACM MultiMedia 2021
- ICRA 2021
- ACM MultiMedia 2020
- Summer 2019: Intern, Deep Learning at eXact lab
- Spring 2019: External Collaborator, Deep Learning at eXact lab
- Summer 2017: Intern, CUDA/OpenCL Developer at eXact lab
- Summer 2014: Intern, Data Analyst/C# Programmer at Famas System
- Summer 2013: Intern, Software Engineering at FBK