Publications related to Efficient Video Coding based on Audio-Visual Focus of Attention

Related publications (29)

Subjective performance evaluation of bitrate allocation strategies for MPEG and JPEG Pleno point cloud compression

Touradj Ebrahimi, Michela Testolina, Davi Nachtigall Lazzarotto

The recent rise in interest in point clouds as an imaging modality has motivated standardization groups such as JPEG and MPEG to launch activities aiming at developing compression standards for point clouds. Lossy compression usually introduces visual arti ...

Springer2024

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

JPEG AIC-3 Dataset: Towards Defining the High Quality to Nearly Visually Lossless Quality Range

Touradj Ebrahimi, Michela Testolina, Davi Nachtigall Lazzarotto

Visual data play a crucial role in modern society, and the rate at which images and videos are acquired, stored, and exchanged every day is rapidly increasing. Image compression is the key technology that enables storing and sharing of visual content in an ...

2023

The JPEG AI Standard: Providing Efficient Human and Machine Visual Data Consumption

Touradj Ebrahimi

The Joint Photographic Experts Group (JPEG) AI learning-based image coding system is an ongoing joint standardization effort between International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), and International Te ...

IEEE COMPUTER SOC2023

On the assessment of high-quality images: advances on the JPEG AIC-3 activity

Touradj Ebrahimi, Michela Testolina, Evgeniy Upenik

Recent advances in image compression have made it both possible and desirable for image quality to approach the visually lossless range. However, the most commonly used subjective visual quality assessment protocols, e.g. those reported in ITU-T Rec. BT.50 ...

2023

On the Performance of Subjective Visual Quality Assessment Protocols for Nearly Visually Lossless Image Compression

Touradj Ebrahimi, Michela Testolina, Davi Nachtigall Lazzarotto

The past decades have witnessed rapid growth in imaging as a major form of communication between individuals. Due to recent advances in capture, storage, delivery and display technologies, consumers demand improved perceptual quality while requiring reduce ...

2023

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Edoardo Charbon, Claudio Bruschini, Andrei Ardelean

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Ieee Computer Soc2023

Quality-Constrained Encoding Optimization for Omnidirectional Video Streaming

Pascal Frossard, Roberto Gerson De Albuquerque Azevedo

Omnidirectional video streaming is usually implemented based on the representations of tiles, where the tiles are obtained by splitting the video frame into several rectangular areas and each tile is converted into multiple representations with different r ...

Ieee-Inst Electrical Electronics Engineers Inc2023

Dual-frequency spectral radar retrieval of snowfall microphysics: a physics-driven deep-learning approach

Alexis Berne, Anne-Claire Marie Billault--Roux, Gionata Ghiggi

The use of meteorological radars to study snowfall microphysical properties and processes is well established, in particular via a few distinct techniques: the use of radar polarimetry, of multi-frequency radar measurements, and of the radar Doppler spectr ...

COPERNICUS GESELLSCHAFT MBH2023

Towards a multiscale point cloud structural similarity metric

Touradj Ebrahimi, Davi Nachtigall Lazzarotto

Point clouds are effective data structures for the rep- resentation of three-dimensional media and hence adopted in a wide range of practical applications. In many cases, the portrayed data is expected to be visualized by humans. After acquisition, point c ...

IEEE2023

Observation of non-reciprocal harmonic conversion in real sounds

Romain Christophe Rémy Fleury, Hervé Lissek, Xinxin Guo

Reciprocity guarantees that in most media, sound transmission is symmetric between two points of space when the location of the source and receiver are interchanged. This fundamental law can be broken in non-linear media, often at the cost of detrimental i ...

2023

AI-based telepresence for broadcast applications

Rayan Daod Nathoo, Changsheng Gao, Laurent Deillon, Henrique Piñeiro Monteagudo, Touradj Ebrahimi

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to ext ...

SPIE2022

Feature-based no-reference video quality assessment using Extra Trees

Arash Amini, Hatef Otroshi Shahreza

With the emergence of social networks and improvements in the internet speed, the video data has become an ever-increasing portion of the global internet traffic. Besides the content, the quality of a video sequence is an important issue at the user end wh ...

WILEY2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

Towards JPEG AIC part 3: visual quality assessment of high to visually lossless image coding

Touradj Ebrahimi, Michela Testolina, Evgeniy Upenik

Due to the increasing number of pictures captured and stored every day by and on digital devices, lossy image compression has become inevitable to limit the needed storage requirement. As a consequence, these compression methods might introduce some visual ...

SPIE2022

Auditory externalization of a remote microphone signal

Vincent Pierre Olivier Grimaldi

A remote microphone (RM) system can be used in combination with wearable binaural communication devices, such as hearing aids (HAs), to improve speech intelligibility. Typically, a speaker is equipped with a body-worn microphone which enables to pick up th ...

EPFL2022

Asynchrony Increases Efficiency: Time Encoding of Videos and Low-Rank Signals

Martin Vetterli, Adam James Scholefield, Karen Adam

In event-based sensing, many sensors independently and asynchronously emit events when there is a change in their input. Event-based sensing can present significant improvements in power efficiency when compared to traditional sampling, because (1) the out ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Learning-based Image Coding: Early Solutions Reviewing and Subjective Quality Evaluation

Touradj Ebrahimi, Pinar Akyazi

Nowadays, image and video are the data types that consume most of the resources of modern communication channels, both in fixed and wireless networks. Thus, it is vital to compress visual data as much as possible, while maintaining some target quality leve ...

SPIE-INT SOC OPTICAL ENGINEERING2021

Perceptual Quality of Point Clouds with application to Compression

Evangelos Alexiou

Modern information technologies and human-centric communication systems employ advanced content representations for richer portrayals of the real world. The newly adopted imaging modalities offer additional information cues and permit the depiction of real ...

EPFL2021

Electrical Signal Modeling in Cochlear Implants. Study of Temperature and Humidity Effects

Maria-Alexandra Paun

The present paper discusses the climatic effects of humidity and temperature on cochlear implant functioning and the quality of the electrical sound signal. MATLAB Simulink simulations were prepared, offering insights into signal behavior under such climat ...

MDPI2021