Publications related to Discovering Knowledge-Critical Subnetworks in Pretrained Language Models

Related publications (7)

Prompt-guided and multimodal landscape scenicness assessments with vision-language models

Recent advances in deep learning and Vision-Language Models (VLM) have enabled efficient transfer to downstream tasks even when limited labelled training data is available, as well as for text to be directly compared to image content. These properties of V ...

PUBLIC LIBRARY SCIENCE2024

Distill-SODA: Distilling Self-Supervised Vision Transformer for Source-Free Open-Set Domain Adaptation in Computational Pathology

Jean-Philippe Thiran, Seyedbehzad Bozorgtabar, Guillaume Marc Georges Vray, Devavrat Tomar

Developing computational pathology models is essential for reducing manual tissue typing from whole slide images, transferring knowledge from the source domain to an unlabeled, shifted target domain, and identifying unseen categories. We propose a practica ...

Institute of Electrical and Electronics Engineers2024

Towards Robust Vision Models

Harshitha Machiraju

Deep convolutional neural networks (DCNNs) have significantly advanced the field of computer vision and are often considered as plausible models for the human visual system. However, they still have several vulnerabilities in terms of adversarial attacks, ...

EPFL2024

SuperAnimal pretrained pose estimation models for behavioral analysis

Alexander Mathis, Mackenzie Mathis, Shaokai Ye, Steffen Schneider, Jessy Lauer, Tian Qiu, Maxime Michel André Vidal, Anastasiia Filippova

Quantification of behavior is critical in diverse applications from neuroscience, veterinary medicine to animal conservation. A common key step for behavioral analysis is first extracting relevant keypoints on animals, known as pose estimation. However, re ...

Nature Research2024

Assessing ChatGPT's Influence on Critical Thinking in Sustainability Oriented Activities

Denis Gillet, Claudia Alarcon Lopez

Critical thinking is vital in every education system. Digital tools like Large Language Models (LLMs), exemplified by ChatGPT, are part of a new scheme of education; studying its influence on critical thinking (CT) is a rising research field with a need fo ...

IEEE Computer Society2024

Combining computational fluid dynamics and neural networks to characterize microclimate extremes: Learning the complex interactions between meso-climate and urban morphology

Jean-Louis Scartezzini, Kavan Javanroodi

The urban form and extreme microclimate events can have an important impact on the energy performance of buildings, urban comfort and human health. State-of-the-art building energy simulations require information on the urban microclimate, but typically re ...

ELSEVIER2022

Text-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Baselines

Mattia Atzeni

Text-based games have emerged as an important test-bed for Reinforcement Learning (RL) research, requiring RL agents to combine grounded language understanding with sequential decision making. In this paper, we examine the problem of infusing RL agents wit ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2021