Publications related to Cross-entropy

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (1/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

Zenodo2024

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (2/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

EPFL Infoscience2024

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (3/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

Zenodo2024

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (4/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

EPFL Infoscience2024

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (5/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

EPFL Infoscience2024

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (6/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

EPFL Infoscience2024

Learning curves for the multi-class teacher-student perceptron

Lenka Zdeborová, Bruno Loureiro, Elisabetta Cornacchia, Rodrigo Soares Veiga

One of the most classical results in high-dimensional learning theory provides a closed-form expression for the generalisation error of binary classification with a single-layer teacher-student perceptron on i.i.d. Gaussian inputs. Both Bayes-optimal (BO) ...

IOP Publishing Ltd2023

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning

Jean-Philippe Thiran, Roser Vinals Terres

Ultrafast ultrasound imaging, characterized by high frame rates, generates low-quality images. Convolutional neural networks (CNNs) have demonstrated great potential to enhance image quality without compromising the frame rate. However, CNNs have been most ...

2023

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

Yanina Yurina Shkel, Anuj Kumar Yadav

Given two jointly distributed random variables (X,Y), a functional representation of X is a random variable Z independent of Y, and a deterministic function g(⋅,⋅) such that X=g(Y,Z). The problem of finding a minimum entropy functional representation is kn ...

2023

Pressure-freezing of dodecane: exploring the crystal structures, formation kinetics and phase diagrams for colossal barocaloric effects in n-alkanes

Tomasz Poreba

Barocaloric (BC) materials provide cheaper and more energy efficient alternatives to traditional refrigerants. Some liquid alkanes were recently shown to exhibit a colossal BC effect, matching the entropy changes in commercial vapour-liquid refrigerants. D ...

Royal Soc Chemistry2023

Neural Distributed Image Compression with Cross-Attention Feature Alignment

Ali Garjani

We consider the problem of compressing an information source when a correlated one is available as side information only at the decoder side, which is a special case of the distributed source coding problem in information theory. In particular, we consider ...

IEEE COMPUTER SOC2023

Exploring quantum perceptron and quantum neural network structures with a teacher-student scheme

Patrick Hümbeli

Near-term quantum devices can be used to build quantum machine learning models, such as quantum kernel methods and quantum neural networks (QNN), to perform classification tasks. There have been many proposals on how to use variational quantum circuits as ...

2022

A Functional Perspective on Information Measures

Amedeo Roberto Esposito

Since the birth of Information Theory, researchers have defined and exploited various information measures, as well as endowed them with operational meanings. Some were born as a "solution to a problem", like Shannon's Entropy and Mutual Information. Other ...

EPFL2022

Molten globule-like transition state of protein barnase measured with calorimetric force spectroscopy

Sebastian James Davis

Understanding how proteins fold into their native structure is a fundamental problem in biophysics, crucial for protein design. It has been hypothesized that the formation of a molten globule intermediate precedes folding to the native conformation of glob ...

National Academy of Sciences2022

A universal signature in the melting of metallic nanoparticles

Kevin Rossi

Predicting when phase changes occur in nanoparticles is fundamental for designing the next generation of devices suitable for catalysis, biomedicine, optics, chemical sensing and electronic circuits. The estimate of the temperature at which metallic nanopa ...

ROYAL SOC CHEMISTRY2021

State selective cooling of SU(N) Fermi gases

Frédéric Mila, Miklos Lajko

We investigate a species selective cooling process of a trapped SU(N) Fermi gas using entropy redistribution during adiabatic loading of an optical lattice. Using high-temperature expansion of the Hubbard model, we show that when a subset N-A < N of the si ...

2021

Population pharmacokinetic model selection assisted by machine learning

Jan Sickmann Hesthaven

A fit-for-purpose structural and statistical model is the first major requirement in population pharmacometric model development. In this manuscript we discuss how this complex and computationally intensive task could benefit from supervised machine learni ...

SPRINGER/PLENUM PUBLISHERS2022

Entropy in Spin Relaxation, Spintronics, and Magnetic Resonance

Ferenc Simon

The entropy change during spin relaxation for a realistic model system is studied, whose spin dynamics can be handled with the Boltzmann equation. The time evolution of the von Neumann entropy is monitored during the process and is compared with the recent ...

WILEY-V C H VERLAG GMBH2020

Coarse-grained entropy production with multiple reservoirs: Unraveling the role of time scales and detailed balance in biology-inspired systems

Amos Maritan, Daniel Maria Busiello

A general framework to describe a vast majority of biology-inspired systems is to model them as stochastic processes in which multiple couplings are in play at the same time. Molecular motors, chemical reaction networks, catalytic enzymes, and particles ex ...

2020

From the Principle of Inertia to the Death Drive: The Influence of the Second Law of Thermodynamics on the Freudian Theory of the Psychical Apparatus

Pierre Magistretti, Jean-Philippe Ansermet

In the Freudian theory of the psychical apparatus, the introduction from the 1920s onward of the second drive dualism appears as a major turning point. The idea of a "death drive," first expressed in Beyond the Pleasure Principle (Freud, 1920), is generall ...

Frontiers Media2020