Concept

Zeta function regularization

Related publications (27)

Efficient local linearity regularization to overcome catastrophic overfitting

Volkan Cevher, Grigorios Chrysos, Fanghui Liu, Elias Abad Rocamora

Catastrophic overfitting (CO) in single-step adversarial training (AT) results in abrupt drops in the adversarial test accuracy (even down to 0%). For models trained with multi-step AT, it has been observed that the loss function behaves locally linearly w ...

2024

High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization

Volkan Cevher, Fanghui Liu

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a bias-variance decomposi ...

2024

On the Sums over Inverse Powers of Zeros of the Hurwitz Zeta Function and Some Related Properties of These Zeros

Serguei Sekatski

Recently, we have applied the generalized Littlewood theorem concerning contour integrals of the logarithm of the analytical function to find the sums over inverse powers of zeros for the incomplete gamma and Riemann zeta functions, polygamma functions, an ...

MDPI2024

Regularization of polynomial networks for image recognition

Volkan Cevher, Grigorios Chrysos, Bohan Wang

Deep Neural Networks (DNNs) have obtained impressive performance across tasks, however they still remain as black boxes, e.g., hard to theoretically analyze. At the same time, Polynomial Networks (PNs) have emerged as an alternative method with a promising ...

2023

Regularization of polynomial networks for image recognition

Volkan Cevher, Grigorios Chrysos, Bohan Wang

Ieee Computer Soc2023

On the Use of the Generalized Littlewood Theorem Concerning Integrals of the Logarithm of Analytical Functions for the Calculation of Infinite Sums and the Analysis of Zeroes of Analytical Functions

Serguei Sekatski

Recently, we have established and used the generalized Littlewood theorem concerning contour integrals of the logarithm of an analytical function to obtain a few new criteria equivalent to the Riemann hypothesis. Here, the same theorem is applied to calcul ...

MDPI2023

Power variations in fractional Sobolev spaces for a class of parabolic stochastic PDEs

Robert Dalang, Carsten Hao Ye Chong

We consider a class of parabolic stochastic PDEs on bounded domains D c Rd that includes the stochastic heat equation but with a fractional power gamma of the Laplacian. Viewing the solution as a process with values in a scale of fractional Sobolev spaces ...

INT STATISTICAL INST2023

Neural Energy Casimir Control for Port-Hamiltonian Systems

Giancarlo Ferrari Trecate, Muhammad Zakwan, Liang Xu

The energy Casimir method is an effective controller design approach to stabilize port-Hamiltonian systems at a desired equilibrium. However, its application relies on the availability of suitable Casimir and Lyapunov functions, whose computation are gener ...

2022

On the Mordell-Weil lattice of y(2) = x(3) + bx plus t(3n+1) in characteristic 3

Gauthier Leterrier

We study the elliptic curves given by y(2) = x(3) + bx + t(3n+1) over global function fields of characteristic 3 ; in particular we perform an explicit computation of the L-function by relating it to the zeta function of a certain superelliptic curve u(3) ...

SPRINGER INT PUBL AG2022

Regularized Diffusion Adaptation via Conjugate Smoothing

Ali H. Sayed, Stefan Vlaski

The purpose of this article is to develop and study a decentralized strategy for Pareto optimization of an aggregate cost consisting of regularized risks. Each risk is modeled as the expectation of some loss function with unknown probability distribution, ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Geodesic Distance on Optimally Regularized Functional Connectomes Uncovers Individual Fingerprints

Enrico Amico

Background: Functional connectomes (FCs) have been shown to provide a reproducible individual fingerprint, which has opened the possibility of personalized medicine for neuro/psychiatric disorders. Thus, developing accurate ways to compare FCs is essential ...

MARY ANN LIEBERT, INC2021

Addressing fairness in classification with a model-agnostic multi-objective algorithm

Boi Faltings, Diego Matteo Antognini, Claudiu-Cristian Musat

The goal of fairness in classification is to learn a classifier that does not discriminate against groups of individuals based on sensitive attributes, such as race and gender. One approach to designing fair algorithms is to use relaxations of fairness not ...

2021

Semi-Discrete Optimal Transport: Hardness, Regularization and Numerical Solution

Daniel Kuhn, Soroosh Shafieezadeh Abadeh, Bahar Taskesen

Semi-discrete optimal transport problems, which evaluate the Wasserstein distance between a discrete and a generic (possibly non-discrete) probability measure, are believed to be computationally hard. Even though such problems are ubiquitous in statistics, ...

2023

A Unifying Representer Theorem for Inverse Problems and Machine Learning

Michaël Unser

Regularization addresses the ill-posedness of the training problem in machine learning or the reconstruction of a signal from a limited number of measurements. The method is applicable whenever the problem is formulated as an optimization task. The standar ...

2021

Joint Graph-based Depth Refinement and Normal Estimation

Pascal Frossard, Mireille El Gheche, Mattia Rossi

Depth estimation is an essential component in understanding the 3D geometry of a scene, with numerous applications in urban and indoor settings. These scenes are characterized by a prevalence of human made structures, which in most of the cases, are either ...

2020

A Novel Spatial-Angular Domain Regularisation Approach for Restoration of Diffusion MRI

Jean-Philippe Thiran, Meritxell Bach Cuadra, Alessandro Daducci

In this paper we tackle the problem of regularisation for inverse problems in single shell diffusion weighted image restoration. Our aim is to recover a high-resolution and denoised DWI signal, prior to any model fitting. The main contribution of our metho ...

SPRINGER-VERLAG BERLIN2019

Solving Continuous-Domain Problems Exactly with Multiresolution B-Splines

Michaël Unser, Julien René Fageot, Thomas Jean Debarre, Harshit Gupta

We propose a discretization method for continuous-domain linear inverse problems with multiple-order total-variation (TV) regularization. It is based on a recent result that proves that such inverse problems have sparse polynomial-spline solutions. Our met ...

IEEE2019

A Regularization Framework for Learning Over Multitask Graphs

Ali H. Sayed, Stefan Vlaski, Roula Nassif

This letter proposes a general regularization framework for inference over multitask networks. The optimization approach relies on minimizing a global cost consisting of the aggregate sum of individual costs regularized by a term that allows to incorporate ...

IEEE Institute of Electrical and Electronics Engineers2019

Regularization via Mass Transportation

Daniel Kuhn, Peyman Mohajerin Esfahani, Soroosh Shafieezadeh Abadeh

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce training data, ...

2019

Modeling spatially dependent functional data via regression with differential regularization

Fabio Nobile

We propose a method for modelling spatially dependent functional data, based on regression with differential regularization. The regularizing term enables to include problem-specific information about the spatio-temporal variation of phenomenon under study ...

2019