Publications related to Fashioning the Future: Unlocking the Creative Potential of Deep Generative Models for Design Space Exploration

Related publications (38)

Fashioning Creative Expertise with Generative AI: Graphical Interfaces for GAN-Based Design Space Exploration Better Support Ideation Than Text Prompts for Diffusion Models

Pierre Dillenbourg, Tanja Christina Käser Jacober, Richard Lee Davis, Thiemo Wambsganss, Kevin Gonyop Kim, Wei Jiang

This paper investigates the potential impact of deep generative models on the work of creative professionals. We argue that current generative modeling tools lack critical features that would make them useful creativity support tools, and introduce our own ...

2024

Text-to-Microstructure Generation Using Generative Deep Learning

Jamie Paik, Xiaoyang Zheng

Designing novel materials is greatly dependent on understanding the design principles, physical mechanisms, and modeling methods of material microstructures, requiring experienced designers with expertise and several rounds of trial and error. Although rec ...

Wiley-V C H Verlag Gmbh2024

Machine learning-aided generative molecular design

Philippe Schwaller, Jeff Guo

Machine learning has provided a means to accelerate early-stage drug discovery by combining molecule generation and filtering steps in a single architecture that leverages the experience and design preferences of medicinal chemists. However, designing mach ...

Nature Portfolio2024

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024

A new age in protein design empowered by deep learning

Bruno Emanuel Ferreira De Sousa Correia, Michael Bronstein, Casper Alexander Goverde, Arne Schneuing, Hamed Khakzad, Ilia Igashov

The rapid progress in the field of deep learning has had a significant impact on protein design. Deep learning methods have recently produced a breakthrough in protein structure prediction, leading to the availability of high-quality models for millions of ...

Cell Press2023

Deep Generative Models for Autonomous Driving: from Motion Forecasting to Realistic Image Synthesis

Saeed Saadatnejad

Forecasting is a capability inherent in humans when navigating. Humans routinely plan their paths, considering the potential future movements of those around them. Similarly, to achieve comparable sophistication and safety, autonomous systems must embrace ...

EPFL2023

4M: Massively Multimodal Masked Modeling

David Mizrahi, Amir Roshan Zamir, Shuqing Teresa Yeo, Oguzhan Fatih Kar, Roman Christian Bachmann

Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly versatile models in co ...

Neural Information Processing Systems (Nips)2023

Deep Learning for Localized-Haptic Feedback in Tactile Surfaces

Camilo Hernandez Mejia

Touchscreens are nowadays the preferred choice for user interfaces in consumer electronics. Significant technological advances have been made in terms of touch sensing and visual quality. However, the haptic feedback offered by commercial products is still ...

EPFL2023

Interpretable Representation Learning and Evaluation for Abstractive Summarization

Andreas Thomas Marfurt

Abstractive summarization has seen big improvements in recent years, mostly due to advances in neural language modeling, language model pretraining, and scaling models and datasets. While large language models generate summaries that are fluent, coherent, ...

EPFL2023

Controlling DNA nanodevices with light-switchable buffers

Cristian Pezzato, Cesare Berton

Control over synthetic DNA-based nanodevices can be achieved with a variety of physical and chemical stimuli. Actuation with light, however, is as advantageous as difficult to implement without modifying DNA strands with photo-switchable groups. Herein, we ...

Royal Society of Chemistry2023

Dense Image-based Predictions for Comics Analysis

Deblina Bhattacharjee

Dense image-based prediction methods have advanced tremendously in recent years. Their remarkable development has been possible due to the ample availability of real-world imagery. While these methods work well on photographs, their abilities do not genera ...

EPFL2023

Explanation of Optical Force and Torque on Nanomotors as the Interplay of Huygens Sources

Olivier Martin, Karim Achouri, Mintae Chung

Being able to understand how optical forces emerge from the interaction of light with matter is paramount for controlling the motion of nanoparticles as well as powering nanomotors. The purpose of this work is to uncover the physical mechanisms at the orig ...

IEEE2022

GANs for All: Supporting Fun and Intuitive Exploration of GAN Latent Spaces

Pierre Dillenbourg, Richard Lee Davis, Kevin Gonyop Kim, Wei Jiang

We have developed a new tool that makes it possible for people with zero programming experience to intentionally and meaningfully explore the latent space of a GAN. We combine a number of methods from the literature into a single system that includes multi ...

PMLR2022

The Food Recognition Benchmark: Using Deep Learning to Recognize Food in Images

Marcel Salathé, Harris Héritier, Djilani James Kebaili, Victor Guy Boulanger

The automatic recognition of food on images has numerous interesting applications, including nutritional tracking in medical cohorts. The problem has received significant research attention, but an ongoing public benchmark on non-biased (i.e., not scraped ...

FRONTIERS MEDIA SA2022

BIGPrior: Towards Decoupling Learned Prior Hallucination and Data Fidelity in Image Restoration

Sabine Süsstrunk, Majed El Helou

Classic image-restoration algorithms use a variety of priors, either implicitly or explicitly. Their priors are hand-designed and their corresponding weights are heuristically assigned. Hence, deep learning methods often produce superior image restoration ...

2022

Understanding Deep Neural Networks using Adversarial Attacks

Krishna Kanth Nakka

Deep Neural Networks (DNNs) have achieved great success in a wide range of applications, such as image recognition, object detection, and semantic segmentation. Even though the discriminative power of DNNs is nowadays unquestionable, serious concerns have ...

EPFL2022

Bayesian Inversion for Nonlinear Imaging Models Using Deep Generative Priors

Michaël Unser, Thanh-An Michel Pham, Pakshal Narendra Bohra, Jonathan Yuelin Dong

Most modern imaging systems incorporate a computational pipeline to infer the image of interest from acquired measurements. The Bayesian approach to solve such ill-posed inverse problems involves the characterization of the posterior distribution of the im ...

2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

Bridging the gap between model-driven and data-driven methods in the era of Big Data

Gael Lederrey

Data-driven and model-driven methodologies can be regarded as competitive fields since they tackle similar problems such as prediction. However, these two fields can learn from each other to improve themselves. Indeed, data-driven methodologies have been d ...

EPFL2022

Unsupervised Domain Adaptation for Cross-Subject Few-Shot Neurological Symptom Detection

Mahsa Shoaran, Bingzhao Zhu

Modern machine learning tools have shown promise in detecting symptoms of neurological disorders. However, current approaches typically train a unique classifier for each subject. This subject-specific training scheme requires long labeled recordings from ...

IEEE2021