ECCV 2022

1,645 papers

GAMa: Cross-view Video Geo-localization

Shruti Vyas, Chen Chen, Mubarak Shah

Relationformer: A Unified Framework for Image-to-Graph Generation

Suprosanna Shit, Rajat Koner, Bastian Wittmann, Johannes Paetzold, Ivan Ezhov

Unsupervised Night Image Enhancement: When Layer Decomposition Meets Light-Effects Suppression

Yeying Jin, Wenhan Yang, Robby T. Tan

Audio—Visual Segmentation

Jinxing Zhou, Jianyuan Wang, Jiayi Zhang, Weixuan Sun, Jing Zhang

AudioScopeV2: Audio-Visual Attention Architectures for Calibrated Open-Domain On-Screen Sound Separation

Efthymios Tzinis, Scott Wisdom, Tal Remez, John R. Hershey

MultiMAE: Multi-modal Multi-task Masked Autoencoders

Roman Bachmann, David Mizrahi, Andrei Atanov, Amir Zamir

Telepresence Video Quality Assessment

Zhenqiang Ying, Deepti Ghadiyaram, Alan Bovik

VoViT: Low Latency Graph-Based Audio-Visual Voice Separation Transformer

Juan F. Montesinos, Venkatesh S. Kadandale, Gloria Haro

PACS: A Dataset for Physical Audiovisual Commonsense Reasoning

Samuel Yu, Peter Wu, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency

Camera Pose Estimation and Localization with Active Audio Sensing

Karren Yang, Michael Firman, Eric Brachmann, Clement Godard

Remote Respiration Monitoring of Moving Person Using Radio Signals

Jae-Ho Choi, Ki-Bong Kang, Kyung-Tae Kim

Learning Visual Styles from Audio-Visual Associations

Tingle Li, Yichen Liu, Andrew Owens, Hang Zhao

Localizing Visual Sounds the Easy Way

Shentong Mo, Pedro Morgado

Uncertainty-Aware Multi-modal Learning via Cross-Modal Random Network Prediction

Hu Wang, Jianpeng Zhang, Yuanhong Chen, Congbo Ma, Jodie Avery

Quantized GAN for Complex Music Generation from Dance Videos

Ye Zhu, Kyle Olszewski, Yu Wu, Panos Achlioptas, Menglei Chai

Adaptive Fine-Grained Sketch-Based Image Retrieval

Ayan Kumar Bhunia, Aneeshan Sain, Parth Hiren Shah, Animesh Gupta, Pinaki Nath Chowdhury

Emotion Recognition for Multiple Context Awareness

Dingkang Yang, Shuai Huang, Shunli Wang, Yang Liu, Peng Zhai

End-to-End Active Speaker Detection

Juan Leon Alcazar, Moritz Cordes, Chen Zhao, Bernard Ghanem

Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation

Xian Liu, Yinghao Xu, Qianyi Wu, Hang Zhou, Wayne Wu

VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance

Katherine Crowson, Stella Biderman, Daniel Kornis, Dashiell Stander, Eric Hallahan

StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuation

Adyasha Maharana, Darryl Hannan, Mohit Bansal

Bridging the Visual Semantic Gap in VLN via Semantically Richer Instructions

Joaquín Ossandón, Benjamín Earle, Alvaro Soto

Grounding Visual Representations with Texts for Domain Generalization

Seonwoo Min, Nokyung Park, Siwon Kim, Seunghyun Park, Jinkyu Kim

Sports Video Analysis on Large-Scale Data

Dekun Wu, He Zhao, Xingce Bao, Richard P. Wildes

Most and Least Retrievable Images in Visual-Language Query Systems

Liuwan Zhu, Rui Ning, Jiang Li, Chunsheng Xin, Hongyi Wu

Single-Stream Multi-level Alignment for Vision-Language Pretraining

Zaid Khan, Vijay Kumar B G, Xiang Yu, Samuel Schulter, Manmohan Chandraker

Language-Driven Artistic Style Transfer

Tsu-Jui Fu, Xin Eric Wang, William Yang Wang

CODER: Coupled Diversity-Sensitive Momentum Contrastive Learning for Image-Text Retrieval

Haoran Wang, Dongliang He, Wenhao Wu, Boyang Xia, Min Yang

FedVLN: Privacy-Preserving Federated Vision-and-Language Navigation

Kaiwen Zhou, Xin Eric Wang

Webly Supervised Concept Expansion for General Purpose Vision Models

Amita Kamath, Christopher Clark, Tanmay Gupta, Eric Kolve, Derek Hoiem

NewsStories: Illustrating Articles with Visual Summaries

Reuben Tan, Bryan A. Plummer, Kate Saenko, JP Lewis, Avneesh Sud

Referring Object Manipulation of Natural Images with Conditional Classifier-Free Guidance

Myungsub Choi

SemAug: Semantically Meaningful Image Augmentations for Object Detection through Language Grounding

Morgan Heisler, Amin Banitalebi-Dehkordi, Yong Zhang

TISE: Bag of Metrics for Text-to-Image Synthesis Evaluation

Tan M. Dinh, Rang Nguyen, Binh-Son Hua

Speaker-Adaptive Lip Reading with User-Dependent Padding

Minsu Kim, Hyunjun Kim, Yong Man Ro

The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoning

Jack Hessel, Jena D. Hwang, Jae Sung Park, Rowan Zellers, Chandra Bhagavatula

Scaling Open-Vocabulary Image Segmentation with Image-Level Labels

Golnaz Ghiasi, Xiuye Gu, Yin Cui, Tsung-Yi Lin

UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling

Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed

FindIt: Generalized Localization with Natural Language Queries

Weicheng Kuo, Fred Bertsch, Wei Li, AJ Piergiovanni, Mohammad Saffar

AssistQ: Affordance-Centric Question-Driven Task Completion for Egocentric Assistant

Benita Wong, Joya Chen, You Wu, Stan Weixian Lei, Dongxing Mao

Classification-Regression for Chart Comprehension

Matan Levy, Rami Ben-Ari, Dani Lischinski

VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection

Joanna Hong, Minsu Kim, Yong Man Ro

New Datasets and Models for Contextual Reasoning in Visual Dialog

Yifeng Zhang, Ming Jiang, Qi Zhao

Bottom Up Top down Detection Transformers for Language Grounding in Images and Point Clouds

Ayush Jain, Nikolaos Gkanatsios, Ishita Mediratta, Katerina Fragkiadaki

Fine-Grained Visual Entailment

Christopher Thomas, Yipeng Zhang, Shih-fu Chang

Multimodal Transformer with Variable-Length Memory for Vision-and-Language Navigation

Chuang Lin, Yi Jiang, Jianfei Cai, Lizhen Qu, Gholamreza Haffari

Unifying Event Detection and Captioning as Sequence Generation via Pre-training

Qi Zhang, Yuqing Song, Qin Jin

Word-Level Fine-Grained Story Visualization

Bowen Li

Switch-BERT: Learning to Model Multimodal Interactions by Switching Attention and Input

Qingpei Guo, Kaisheng Yao, Wei Chu

Learning Disentanglement with Decoupled Labels for Vision-Language Navigation

Wenhao Cheng, Xingping Dong, Salman Khan, Jianbing Shen

X-DETR: A Versatile Architecture for Instance-Wise Vision-Language Tasks

Zhaowei Cai, Gukyeong Kwon, Avinash Ravichandran, Erhan Bas, Zhuowen Tu

ASSISTER: Assistive Navigation via Conditional Instruction Generation

Zanming Huang, Zhongkai Shangguan, Jimuyang Zhang, Gilad Bar, Matthew Boyd

Learning Linguistic Association towards Efficient Text-Video Retrieval

Sheng Fang, Shuhui Wang, Junbao Zhuo, Xinzhe Han, Qingming Huang

Contrastive Vision-Language Pre-training with Limited Resources

Quan Cui, Boyan Zhou, Yu Guo, Weidong Yin, Hao Wu

Object-Centric Unsupervised Image Captioning

Zihang Meng, David Yang, Xuefei Cao, Ashish Shah, Ser-Nam Lim

Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embodied Reference Understanding

Cheng Shi, Sibei Yang

Selective Query-Guided Debiasing for Video Corpus Moment Retrieval

Sunjae Yoon, Ji Woo Hong, Eunseop Yoon, Dahyun Kim, Junyeong Kim

GRIT: Faster and Better Image Captioning Transformer Using Dual Visual Features

Van-Quang Nguyen, Masanori Suganuma, Takayuki Okatani

Reliable Visual Question Answering: Abstain Rather Than Answer Incorrectly

Spencer Whitehead, Suzanne Petryk, Vedaad Shakib, Joseph Gonzalez, Trevor Darrell

Can Shuffling Video Benefit Temporal Bias Problem: A Novel Training Framework for Temporal Grounding

Jiachang Hao, Haifeng Sun, Pengfei Ren, Jingyu Wang, Qi Qi

Explicit Image Caption Editing

Zhen Wang, Long Chen, Wenbo Ma, Guangxing Han, Yulei Niu

Rethinking Data Augmentation for Robust Visual Question Answering

Long Chen, Yuhang Zheng, Jun Xiao

Video Question Answering with Iterative Video-Text Co-Tokenization

AJ Piergiovanni, Kairo Morton, Weicheng Kuo, Michael S. Ryoo, Anelia Angelova

Trace Controlled Text to Image Generation

Kun Yan, Lei Ji, Chenfei Wu, Jianmin Bao, Ming Zhou

Video Graph Transformer for Video Question Answering

Junbin Xiao, Pan Zhou, Tat-Seng Chua, Shuicheng Yan

Generative Negative Text Replay for Continual Vision-Language Pretraining

Shipeng Yan, Lanqing Hong, Hang Xu, Jianhua Han, Tinne Tuytelaars

Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing

Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel C. Castro, Anton Schwaighofer

A Simple and Robust Correlation Filtering Method for Text-Based Person Search

Wei Suo, Mengyang Sun, Kai Niu, Yiqi Gao, Peng Wang

"GEB+: A Benchmark for Generic Event Boundary Captioning, Grounding and Retrieval"

Yuxuan Wang, Difei Gao, Licheng Yu, Weixian Lei, Matt Feiszli

MILES: Visual BERT Pre-training with Injected Language Semantics for Video-Text Retrieval

Yuying Ge, Yixiao Ge, Xihui Liu, Jinpeng Wang, Jianping Wu

Automatic Dense Annotation of Large-Vocabulary Sign Language Videos

Liliane Momeni, Hannah Bull, K R Prajwal, Samuel Albanie, Gül Varol

Weakly Supervised Grounding for VQA in Vision-Language Transformers

Aisha Urooj, Hilde Kuehne, Chuang Gan, Niels Da Vitoria Lobo, Mubarak Shah

FashionViL: Fashion-Focused Vision-and-Language Representation Learning

Xiao Han, Licheng Yu, Xiatian Zhu, Li Zhang, Yi-Zhe Song

VTC: Improving Video-Text Retrieval with User Comments

Laura Hanu, James Thewlis, Yuki M. Asano, Christian Rupprecht

SeqTR: A Simple Yet Universal Network for Visual Grounding

Chaoyang Zhu, Yiyi Zhou, Yunhang Shen, Gen Luo, Xingjia Pan

TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Texts

Chuan Guo, Xinxin Zuo, Sen Wang, Li Cheng

Cross-Modal Prototype Driven Network for Radiology Report Generation

Jun Wang, Abhir Bhalerao, Yulan He

SiRi: A Simple Selective Retraining Mechanism for Transformer-Based Visual Grounding

Mengxue Qu, Yu Wu, Wu Liu, Qiqi Gong, Xiaodan Liang

MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenes

Yang Jiao, Shaoxiang Chen, Zequn Jie, Jingjing Chen, Lin Ma

Temporal Lift Pooling for Continuous Sign Language Recognition

Lianyu Hu, Liqing Gao, Zekang Liu, Wei Feng

Tip-Adapter: Training-Free Adaption of CLIP for Few-Shot Classification

Renrui Zhang, Wei Zhang, Rongyao Fang, peng gao, Kunchang Li

Dynamic Temporal Filtering In Video Models

Fuchen Long, Zhaofan Qiu, Yingwei Pan, Ting Yao, Chong-Wah Ngo

Motion Sensitive Contrastive Learning for Self-Supervised Video Representation

Jingcheng Ni, Nan Zhou, Jie Qin, Qian Wu, Junqi Liu

Bayesian Tracking of Video Graphs Using Joint Kalman Smoothing and Registration

Aditi Basu Bal, Ramy Mounir, Sathyanarayanan Aakur, Sudeep Sarkar, Anuj Srivastava

Panoramic Vision Transformer for Saliency Detection in 360° Videos

Heeseung Yun, Sehun Lee, Gunhee Kim

PIP: Physical Interaction Prediction via Mental Simulation with Span Selection

Jiafei Duan, Samson Yu, Soujanya Poria, Bihan Wen, Cheston Tan

Frozen CLIP Models Are Efficient Video Learners

Ziyi Lin, Shijie Geng, Renrui Zhang, peng gao, Gerard de Melo

Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection

Kyle Min, Sourya Roy, Subarna Tripathi, Tanaya Guha, Somdeb Majumdar

MaCLR: Motion-Aware Contrastive Learning of Representations for Videos

Fanyi Xiao, Joseph Tighe, Davide Modolo

Deep 360° Optical Flow Estimation Based on Multi-Projection Fusion

Yiheng Li, Connelly Barnes, Kun Huang, Fang-Lue Zhang

Flow Graph to Video Grounding for Weakly-Supervised Multi-step Localization

Nikita Dvornik, Isma Hadji, Hai Pham, Dhaivat Bhatt, Brais Martinez

Semi-Supervised Learning of Optical Flow by Flow Supervisor

Woobin Im, Sebin Lee, Sung-eui Yoon

TDViT: Temporal Dilated Video Transformer for Dense Video Tasks

Guanxiong Sun, Yang Hua, Guosheng Hu, Neil Robertson

E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Context

Zizhang Li, Mengmeng Wang, Huaijin Pi, Kechun Xu, Jianbiao Mei

COMPOSER: Compositional Reasoning of Group Activity in Videos with Keypoint-Only Modality

Honglu Zhou, Asim Kadav, Aviv Shamsian, Shijie Geng, Farley Lai

MorphMLP: An Efficient MLP-Like Backbone for Spatial-Temporal Representation Learning

David Junhao Zhang, Kunchang Li, Yali Wang, Yunpeng Chen, Shashwat Chandra

Delta Distillation for Efficient Video Processing

Amirhossein Habibian, Haitam Ben Yahia, Davide Abati, Efstratios Gavves, Fatih Porikli

GraphVid: It Only Takes a Few Nodes to Understand a Video

Eitan Kosman, Dotan Di Castro

A Deep Moving-Camera Background Model

Guy Erez, Ron Shapira Weber, Oren Freifeld

K-Centered Patch Sampling for Efficient Video Recognition

Seong Hyeon Park, Jihoon Tack, Byeongho Heo, Jung-Woo Ha, Jinwoo Shin