Publications related to Knowledge Distillation for Face Recognition Using Synthetic Data With Dynamic Latent Sampling

Related publications (24)

XLSR-Transducer: Streaming ASR for Self-Supervised Pretrained Models

Self-supervised pretrained models exhibit competitive performance in automatic speech recognition (ASR) on finetuning, even with limited in-domain supervised data. However, popular pretrained models are not suitable for streaming ASR because they are train ...

Institute of Electrical and Electronics Engineers2025

On the conversational persuasiveness of GPT-4

Francesco Salvi, Robert West

Early work has found that large language models (LLMs) can generate persuasive content. However, evidence on whether they can also personalize arguments to individual attributes remains limited, despite being crucial for assessing misuse. This preregistere ...

Springer Science and Business Media LLC2025

TimEHR: Image-based Time Series Generation for Electronic Health Records

David Atienza Alonso, Anisoara Ionescu, Hojjat Karami

Time series in Electronic Health Records (EHRs) present unique challenges for generative models, such as irregular sampling, missing values, and high dimensionality. In this paper, we propose a novel generative adversarial network (GAN) model, TimEHR, to g ...

Institute of Electrical and Electronics Engineers (IEEE)2025

Enabling Deep Learning Models for Seizure Monitoring within Wearables Lifecycle

Alireza Amirshahi

Continuous monitoring of various physiological conditions enables early detection of potential health issues. The monitoring offers real-time insights into patient well-being and rapid medical interventions. As a case study, in epilepsy, a prevalent neurol ...

EPFL2025

Collaborative AI Agents in the Era of Large Language Models

Martin Josifoski

Developing agents that can reliably act on our behalf is central to artificial intelligence (AI). These agents must seamlessly interact with tools, like search engines and databases, and collaborate. In this thesis, we study the abstractions, methods, and ...

EPFL2025

Adapting Fine-Grained Cross-View Localization to Areas Without Fine Ground Truth

Zimin Xia

Given a ground-level query image and a geo-referenced aerial image that covers the query’s local surroundings, fine-grained cross-view localization aims to estimate the location of the ground camera inside the aerial image. Recent works have focused on dev ...

Springer Science and Business Media Deutschland GmbH2025

Diffusion Stochastic Optimization for Min-Max Problems

Ali H. Sayed, Haoyuan Cai

The optimistic gradient method is useful in addressing minimax optimization problems. Motivated by the observation that the conventional stochastic version suffers from the need for a large batch size on the order of O(ϵ-2) to achieve an ϵ-stationary solut ...

2025

Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator

Yung-Cheng Chiang

Object detection, a fundamental task in computer vision, is crucial for various intelligent edge computing applications. However, object detection algorithms are usually heavy in computation, hindering their deployments on resource-constrained edge devices ...

2025

Self-Supervised Anomaly Segmentation via Diffusion Models with Dynamic Transformer UNet

Seyedbehzad Bozorgtabar

A robust anomaly detection mechanism should possess the capability to effectively remediate anomalies, restoring them to a healthy state, while preserving essential healthy information. Despite the efficacy of existing generative models in learning the und ...

IEEE2025

GRADE: Generating Realistic and Dynamic Environments for robotics research with Isaac Sim

Chenghao Xu

Photorealistic synthetic data and novel rendering techniques significantly advanced computer vision research. However, datasets focused on computer vision applications cannot be easily applied to robotics because they typically lack physics-related informa ...

SAGE Publications2025

Neural Garment Modeling

Ren Li

The digitization of 3D deformable objects remains a significant challenge in computer graphics and vision, particularly in the accurate modeling of garments. Garments exhibit complex shape variability, non-rigid deformations, and frequent self-occlusion, m ...

EPFL2025

On the added value of sequential deep learning for the upscaling of evapotranspiration

Devis Tuia

Estimating ecosystem-atmosphere fluxes such as evapotranspiration (ET) in a robust manner and at a global scale remains a challenge. Methods based on machine learning (ML) have shown promising results in achieving such upscaling, providing a complementary ...

2025

Beyond Essentials: Nuanced and Diverse Text-to-video Retrieval

Yuchen Yang

The field of text-to-video retrieval has advanced significantly with the evolution of language models and large-scale pre-training on generated caption-video pairs. Current methods predominantly focus on visual and event-based details, making retrieval lar ...

Institute of Electrical and Electronics Engineers Inc.2024

EdgeFace: Efficient Face Recognition Model for Edge Devices

Hatef Otroshi Shahreza

In this paper, we present EdgeFace - a lightweight and efficient face recognition network inspired by the hybrid architecture of EdgeNeXt. By effectively combining the strengths of both CNN and Transformer models, and a low rank linear layer, EdgeFace achi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers

Xiuying Wei, Caglar Gulcehre, Skander Moalla

State-of-the-art results in large language models (LLMs) often rely on scale, which becomes computationally expensive. This has sparked a research agenda to reduce these models' parameter counts and computational costs without significantly impacting their ...

2024

A journey toward generalizable trajectory forecasting models

Mohammadhossein Bahari

Autonomous driving is a revolutionary technology that has seen considerable advancements through the adoption of deep learning solutions. One of the major challenges in this field is the interaction with other road users. This interaction necessitates a "t ...

EPFL2024

Activation Scaling for Steering and Interpreting Language Models

Robert West

Given the prompt “Rome is in”, can we steer a language model to flip its prediction of an incorrect token “France” to a correct token “Italy” by only multiplying a few relevant activation vectors with scalars? We argue that successfully intervening on a mo ...

Association for Computational Linguistics (ACL)2024

Enhancing Procedural Writing Through Personalized Example Retrieval: A Case Study on Cooking Recipes

Tanja Christina Käser Jacober, Antoine Bosselut, Thiemo Wambsganss, Seyed Parsa Neshaei, Jibril Albachir Frej, Paola Mejia Domenzain, Luca Mouchel, Tatjana Nazaretsky

Writing high-quality procedural texts is a challenging task for many learners. While example-based learning has shown promise as a feedback approach, a limitation arises when all learners receive the same content without considering their individual input ...

2024

Re-pseudonymization Strategies for Smart Meter Data Are Not Robust to Deep Learning Profiling Attacks

Ana-Maria Cretu

Smart meters, devices measuring the electricity and gas consumption of a household, are currently being deployed at a fast rate throughout the world. The data they collect are extremely useful, including in the fight against climate change. However, these ...

Association for Computing Machinery, Inc2024

Live-cell imaging powered by computation

Suliana Manley

The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preservi ...

Nature Portfolio2024