Publications related to Video coding based on audio-visual attention

Related publications (32)

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

Peter Arpad Grönquist, Sabine Süsstrunk, Yufan Ren

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person’s expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Som ...

2024

Subjective performance evaluation of bitrate allocation strategies for MPEG and JPEG Pleno point cloud compression

Touradj Ebrahimi, Michela Testolina, Davi Nachtigall Lazzarotto

The recent rise in interest in point clouds as an imaging modality has motivated standardization groups such as JPEG and MPEG to launch activities aiming at developing compression standards for point clouds. Lossy compression usually introduces visual arti ...

Springer2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

The JPEG AI Standard: Providing Efficient Human and Machine Visual Data Consumption

Touradj Ebrahimi

The Joint Photographic Experts Group (JPEG) AI learning-based image coding system is an ongoing joint standardization effort between International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), and International Te ...

IEEE COMPUTER SOC2023

Quality-Constrained Encoding Optimization for Omnidirectional Video Streaming

Pascal Frossard, Roberto Gerson De Albuquerque Azevedo

Omnidirectional video streaming is usually implemented based on the representations of tiles, where the tiles are obtained by splitting the video frame into several rectangular areas and each tile is converted into multiple representations with different r ...

Ieee-Inst Electrical Electronics Engineers Inc2023

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Edoardo Charbon, Claudio Bruschini, Andrei Ardelean

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Ieee Computer Soc2023

On the assessment of high-quality images: advances on the JPEG AIC-3 activity

Touradj Ebrahimi, Michela Testolina, Evgeniy Upenik

Recent advances in image compression have made it both possible and desirable for image quality to approach the visually lossless range. However, the most commonly used subjective visual quality assessment protocols, e.g. those reported in ITU-T Rec. BT.50 ...

2023

Neural Distributed Image Compression with Cross-Attention Feature Alignment

Ali Garjani

We consider the problem of compressing an information source when a correlated one is available as side information only at the decoder side, which is a special case of the distributed source coding problem in information theory. In particular, we consider ...

IEEE COMPUTER SOC2023

Feature-based no-reference video quality assessment using Extra Trees

Arash Amini, Hatef Otroshi Shahreza

With the emergence of social networks and improvements in the internet speed, the video data has become an ever-increasing portion of the global internet traffic. Besides the content, the quality of a video sequence is an important issue at the user end wh ...

WILEY2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

AI-based telepresence for broadcast applications

Rayan Daod Nathoo, Changsheng Gao, Laurent Deillon, Henrique Piñeiro Monteagudo, Touradj Ebrahimi

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to ext ...

SPIE2022

Towards JPEG AIC part 3: visual quality assessment of high to visually lossless image coding

Touradj Ebrahimi, Michela Testolina, Evgeniy Upenik

Due to the increasing number of pictures captured and stored every day by and on digital devices, lossy image compression has become inevitable to limit the needed storage requirement. As a consequence, these compression methods might introduce some visual ...

SPIE2022

Learning-based Image Coding: Early Solutions Reviewing and Subjective Quality Evaluation

Touradj Ebrahimi, Pinar Akyazi

Nowadays, image and video are the data types that consume most of the resources of modern communication channels, both in fixed and wireless networks. Thus, it is vital to compress visual data as much as possible, while maintaining some target quality leve ...

SPIE-INT SOC OPTICAL ENGINEERING2021

Gem5-X : A Many-Core Heterogeneous Simulation Platform for Architectural Exploration and Optimization

David Atienza Alonso, Marina Zapater Sancho, William Andrew Simon, Yasir Mahmood Qureshi

The increasing adoption of smart systems in our daily life has led to the development of new applications with varying performance and energy constraints, and suitable computing architectures need to be developed for these new applications. In this paper, ...

2021

Performance Evaluation of Objective Image Quality Metrics on Conventional and Learning-Based Compression Artifacts

Touradj Ebrahimi, Michela Testolina, Evgeniy Upenik, Fernando Joaquim Leite Pereira

Lossy image compression is a popular, simple and effective solution to reduce the amount of data representing digital pictures. In most lossy compression methods, the reduced volume of data in bits is achieved at the expense of introducing visual artifacts ...

IEEE2021

How Asynchronous Events Encode Video

Martin Vetterli, Adam James Scholefield, Karen Adam

As event-based sensing gains in popularity, theoretical understanding is needed to harness this technology’s potential. Instead of recording video by capturing frames, event-based cameras have sensors that emit events when their inputs change, thus encodin ...

IEEE2021

Adaptive extreme video completion

Sabine Süsstrunk, Radhakrishna Achanta, Majed El Helou, Ruofan Zhou

A computer-implemented video completion method is proposed for reconstructing a sparsely sampled video comprising sparsely sampled video frames comprising sparse sets of picture element intensity values. The method comprises: distributing the sparse sets o ...

2021

Multi-Objective Management of Multiprocessor Systems: From Heuristics to Reinforcement Learning

Arman Iranfar

In my thesis, I reveal several already-existing and emerging challenges in multi-objective management of multiprocessor systems, and address them through novel solutions, from heuristics to RL, depending on the complexity of the problem. Conventional multi ...

EPFL2020

Quality Evaluation Of Static Point Clouds Encoded Using MPEG Codecs

Touradj Ebrahimi, Evangelos Alexiou

This paper presents a quality evaluation study of point cloud codecs that have been recently standardised by the MPEG committee. In particular, a subjective experiment to assess their performance in terms of bitrate against visual quality is designed and r ...

IEEE2020

Subjective and Viewport-based Objective Quality Assessment of 360-degree Videos

Pascal Frossard, Roberto Gerson De Albuquerque Azevedo

Visual distortions in processed 360-degree visual content and consumed through head-mounted displays (HMDs) are perceived very differently when compared to traditional 2D content. To better understand how compression-related artifacts affect the overall pe ...

2020