Video coding based on audio-visual attention

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person’s expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Som ...

The recent rise in interest in point clouds as an imaging modality has motivated standardization groups such as JPEG and MPEG to launch activities aiming at developing compression standards for point clouds. Lossy compression usually introduces visual arti ...

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

The Joint Photographic Experts Group (JPEG) AI learning-based image coding system is an ongoing joint standardization effort between International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), and International Te ...

Omnidirectional video streaming is usually implemented based on the representations of tiles, where the tiles are obtained by splitting the video frame into several rectangular areas and each tile is converted into multiple representations with different r ...

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Recent advances in image compression have made it both possible and desirable for image quality to approach the visually lossless range. However, the most commonly used subjective visual quality assessment protocols, e.g. those reported in ITU-T Rec. BT.50 ...

We consider the problem of compressing an information source when a correlated one is available as side information only at the decoder side, which is a special case of the distributed source coding problem in information theory. In particular, we consider ...

With the emergence of social networks and improvements in the internet speed, the video data has become an ever-increasing portion of the global internet traffic. Besides the content, the quality of a video sequence is an important issue at the user end wh ...

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to ext ...

Due to the increasing number of pictures captured and stored every day by and on digital devices, lossy image compression has become inevitable to limit the needed storage requirement. As a consequence, these compression methods might introduce some visual ...

Nowadays, image and video are the data types that consume most of the resources of modern communication channels, both in fixed and wireless networks. Thus, it is vital to compress visual data as much as possible, while maintaining some target quality leve ...

The increasing adoption of smart systems in our daily life has led to the development of new applications with varying performance and energy constraints, and suitable computing architectures need to be developed for these new applications. In this paper, ...

Lossy image compression is a popular, simple and effective solution to reduce the amount of data representing digital pictures. In most lossy compression methods, the reduced volume of data in bits is achieved at the expense of introducing visual artifacts ...

As event-based sensing gains in popularity, theoretical understanding is needed to harness this technology’s potential. Instead of recording video by capturing frames, event-based cameras have sensors that emit events when their inputs change, thus encodin ...

A computer-implemented video completion method is proposed for reconstructing a sparsely sampled video comprising sparsely sampled video frames comprising sparse sets of picture element intensity values. The method comprises: distributing the sparse sets o ...

In my thesis, I reveal several already-existing and emerging challenges in multi-objective management of multiprocessor systems, and address them through novel solutions, from heuristics to RL, depending on the complexity of the problem. Conventional multi ...

This paper presents a quality evaluation study of point cloud codecs that have been recently standardised by the MPEG committee. In particular, a subjective experiment to assess their performance in terms of bitrate against visual quality is designed and r ...

Visual distortions in processed 360-degree visual content and consumed through head-mounted displays (HMDs) are perceived very differently when compared to traditional 2D content. To better understand how compression-related artifacts affect the overall pe ...

Video coding based on audio-visual attention

Chattez avec Graph Search

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

Subjective performance evaluation of bitrate allocation strategies for MPEG and JPEG Pleno point cloud compression

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

The JPEG AI Standard: Providing Efficient Human and Machine Visual Data Consumption

Quality-Constrained Encoding Optimization for Omnidirectional Video Streaming

SoDaCam: Software-defined Cameras via Single-Photon Imaging

On the assessment of high-quality images: advances on the JPEG AIC-3 activity

Neural Distributed Image Compression with Cross-Attention Feature Alignment

Feature-based no-reference video quality assessment using Extra Trees

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

AI-based telepresence for broadcast applications

Towards JPEG AIC part 3: visual quality assessment of high to visually lossless image coding

Learning-based Image Coding: Early Solutions Reviewing and Subjective Quality Evaluation

Gem5-X : A Many-Core Heterogeneous Simulation Platform for Architectural Exploration and Optimization

Performance Evaluation of Objective Image Quality Metrics on Conventional and Learning-Based Compression Artifacts

How Asynchronous Events Encode Video

Adaptive extreme video completion

Multi-Objective Management of Multiprocessor Systems: From Heuristics to Reinforcement Learning

Quality Evaluation Of Static Point Clouds Encoded Using MPEG Codecs

Subjective and Viewport-based Objective Quality Assessment of 360-degree Videos