Publications de Volkan Cevher | EPFL Graph Search

Publications associées (249)

Fixed Points of Generalized Approximate Message Passing with Arbitrary Matrices

The estimation of a random vector with independent components passed through a linear transform followed by a componentwise (possibly nonlinear) output map arises in a range of applications. Approximate message passing (AMP) methods, based on Gaussian appr ...

2016

Convex block-sparse linear regression with expanders - provably

Volkan Cevher, Anastasios Kyrillidis, Quoc Tran Dinh, Luca Baldassarre, Bubacarr Bah

Sparse matrices are favorable objects in machine learning and optimization. When such matrices are used, in place of dense ones, the overall complexity requirements in optimization can be significantly reduced in practice, both in terms of space and run-ti ...

2016

Model-based Sketching and Recovery with Expanders

Volkan Cevher, Luca Baldassarre, Bubacarr Bah

Linear sketching and recovery of sparse vectors with randomly constructed sparse matrices has numerous applications in several areas, including compressive sensing, data stream computing, graph sketching, and combinatorial group testing. This paper conside ...

2014

Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithms

Volkan Cevher, Junhong Lin

We study generalization properties of distributed algorithms in the setting of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We first investigate distributed stochastic gradient methods (SGM), with mini-batches and multi-passes o ...

2018

Chemical machine learning with kernels: The impact of loss functions

Volkan Cevher, Quoc Tran Dinh, Sandip De, Junhong Lin, Van Quang Nguyen

Machine learning promises to accelerate materials discovery by allowing computational efficient property predictions from a small number of reference calculations. As a result, the literature has spent a considerable effort in designing representations tha ...

2019

Optimal Rates for Spectral Algorithms with Least-Squares Regression over Hilbert Spaces

Volkan Cevher, Junhong Lin

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms, including ridge regressi ...

2020

Streaming Low-Rank Matrix Approximation With An Application To Scientific Simulation

Volkan Cevher, Alp Yurtsever

This paper argues that randomized linear sketching is a natural tool for on-the-fly compression of data matrices that arise from large-scale scientific simulations and data collection. The technical contribution consists in a new algorithm for constructing ...

2019

Learning with Norm Constrained, Over-parameterized, Two-layer Neural Networks

Volkan Cevher, Fanghui Liu, Leello Tadesse Dadi

Recent studies show that a reproducing kernel Hilbert space (RKHS) is not a suitable space to model functions by neural networks as the curse of dimensionality (CoD) cannot be evaded when trying to approximate even a single ReLU neuron (Bach, 2017). In thi ...

2024

Limits on Support Recovery With Probabilistic Models: An Information-Theoretic Framework

Volkan Cevher, Jonathan Mark Scarlett

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings, such as compressive sensing, subset selection in regression, and gro ...

Institute of Electrical and Electronics Engineers2017

Phase Transitions in the Pooled Data Problem

Volkan Cevher, Jonathan Mark Scarlett

In this paper, we study the {\em pooled data} problem of identifying the labels associated with a large collection of items, based on a sequence of pooled tests revealing the counts of each label within the pool. In the noiseless setting, we identify an ex ...

2017

A Smooth Primal-Dual Optimization Framework for Nonsmooth Composite Convex Minimization

Volkan Cevher, Quoc Tran Dinh

We propose a new and low per-iteration complexity first-order primal-dual optimization framework for a convex optimization template with broad applications. Our analysis relies on a novel combination of three classic ideas applied to the primal-dual gap fu ...

SIAM Publications2018

An Adaptive Sublinear-Time Block Sparse Fourier Transform

Volkan Cevher, Jonathan Mark Scarlett, Mikhail Kapralov, Amir Zandieh

The problem of approximately computing the

k

dominant Fourier coefficients of a vector

X

quickly, and using few samples in time domain, is known as the Sparse Fourier Transform (sparse FFT) problem. A long line of work on the sparse FFT has resulted in ...

2017

On The Convergence Of Stochastic Primal-Dual Hybrid Gradient

Volkan Cevher, Ahmet Alacaoglu

In this paper, we analyze the recently proposed stochastic primal-dual hybrid gradient (SPDHG) algorithm and provide new theoretical results. In particular, we prove almost sure convergence of the iterates to a solution with convexity and linear convergenc ...

SIAM PUBLICATIONS2022

Learning Low-Dimensional Signal Models

Volkan Cevher

Sampling, coding, and streaming even the most essential data, e.g., in medical imaging and weather-monitoring applications, produce a data deluge that severely stresses the avail able analog-to-digital converter, communication bandwidth, and digital-storag ...

Institute of Electrical and Electronics Engineers2011

Hadamard product in deep learning: Introduction, Advances and Challenges

Volkan Cevher, Yongtao Wu

While convolution and self-attention mechanisms have dominated architectural design in deep learning, this survey examines a fundamental yet understudied primitive: the Hadamard product. Despite its widespread implementation across various applications, th ...

2025

On Certifying Non-Uniform Bounds against Adversarial Attacks

Volkan Cevher, Chen Liu

This work studies the robustness certification problem of neural network models, which aims to find certified adversary-free regions as large as possible around data points. In contrast to the existing approaches that seek regions bounded uniformly along a ...

2019

Efficient learning of smooth probability functions from Bernoulli tests with guarantees

Volkan Cevher, Ali Kavis, Paul Thierry Yves Rolland

We study the fundamental problem of learning an unknown, smooth probability function via pointwise Bernoulli tests. We provide a scalable algorithm for efficiently solving this problem with rigorous guarantees. In particular, we prove the convergence rate ...

2019

Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithms

Volkan Cevher, Junhong Lin

We study generalization properties of distributed algorithms in the setting of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We first investigate distributed stochastic gradient methods (SGM), with mini-batches and multi-passes o ...

2020

Practical Sketching Algorithms For Low-Rank Matrix Approximation

Volkan Cevher, Alp Yurtsever

This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image, or sketch, of the matrix. These methods can preserve structural properties of the input matrix, such as positive-semidefinite ...

Society for Industrial and Applied Mathematics2017

Energy-aware adaptive bi-Lipschitz embeddings

Volkan Cevher, Bubacarr Bah

We propose a dimensionality reducing matrix design based on training data with constraints on its Frobenius norm and number of rows. Our design criteria is aimed at preserving the distances between the data points in the dimensionality reduced space as muc ...

2013