Ziad Al-Halah

Assistant Professor

Kahlert School of Computing
The University of Utah
50 Central Campus Dr.
Salt Lake City, UT 84112

ziad at cs.utah.edu
cs.utah.edu

Google Scholar Google Scholar
ResearchGate ResearchGate
DBLP DBLP
ORCID ORCID

Welcome

I am an Assistant Professor of Computer Science in the Kahlert School of Computing at the University of Utah. Before that, I was Postdoctoral Fellow at the University of Texas at Austin, working with Prof. Kristen Grauman in the Computer Vision Group. I was a resident researcher with the Artificial Intelligence group at NAVER in South Korea, and a visiting researcher with the Coretx / Computer Vision group at Twitter in the UK and with the Vision group at Disney Research in Pittsburgh. I received my PhD with distinction (summa cum laude) from the Karlsruhe Institute of Technology in Germany, working in the Computer Vision for Human Computer Interaction Laboratory.

My research interests are in computer vision and artificial intelligence. I'm primary interested in transfer learning, zero-shot learning, multimodal learning, and Embodied AI.

Latest News

ICML 2023  Paper on efficient video search for episodic memory. Outstanding Reviewer in CVPR 2023. CVPR 2023  Paper on leveraging linguistic narrations as queries to supervise episodic memory search. I'm an Area Chair of ICCV 2023 and AAAI 2023. I'm an organizer of the Computer Vision for Fashion, Art, and Design (CVFAD) workshop in CVPR 2023. I'm an organizer of the Ethical Considerations in Creative applications of Computer Vision (EC3V) workshop in CVPR 2023. NeurIPS 2022  Paper on arbitrary RIR prediction from few-shot multi-modal observations. I'm an Area Chair of BMVC 2022 and ACCV 2022. CVPR 2022  Two papers on zero-shot experience learning and object-goal navigation. ICLR 2022  Paper on environment predictive coding for visual navigation. ICCV 2021  Paper on active audio-visual source separation. Outstanding Reviewer in CVPR 2021. I'm an Area Chair of International Conference on Machine Vision Applications, MVA 2021. CVPR 2021  Two papers on semantic audio-visual navigation and dialog-based fashion retrieval. ICLR 2021  Paper on navigation using audio-visual waypoints. I'm an Area and a Session Chair of WACV 2021. Outstanding Reviewer in ECCV 2020. ECCV 2020  Three papers accepted (including 2 spotlights) in the European Conference on Computer Vision. Our team won the first place in the Habitat Challenge (PointNav) in CVPR 2020. CVPR 2020  Paper on discovering fashion style influences from millions of social media photos. ICCV 2019  Paper on visual sentiment analysis using emoji embedding.

Publications


ramakrishnan2023soptem

SpotEM: Efficient Video Search for Episodic Memory

Santhosh K. Ramakrishnan, Ziad Al-Halah, Kristen Grauman
International Conference on Machine Learning (ICML), Jul. 2023.

ramakrishnan2023naq

NaQ: Leveraging Narrations as Queries to Supervise Episodic Memory

Santhosh K. Ramakrishnan, Ziad Al-Halah, Kristen Grauman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2023.

llsysNN2023

A Domain-Agnostic Approach for Characterization of Lifelong Learning Systems

Megan M Baker, Alexander New, Mario Aguilar-Simon, Ziad Al-Halah, Sébastien MR Arnold, and 42 more.
Neural Networks (NN), March 2023.

majumder2022fsrir

Few-Shot Audio-Visual Learning of Environment Acoustics

Sagnik Majumder, Changan Chen*, Ziad Al-Halah* and Kristen Grauman
Conference on Neural Information Processing Systems (NeurIPS), Nov. 2022.

al-halah2022zsel

Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigation

Ziad Al-Halah, Santhosh K. Ramakrishnan and Kristen Grauman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2022.

ramakrishnan2022poni

PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learning

Santhosh K. Ramakrishnan, Devendra S. Chaplot, Ziad Al-Halah, Jitendra Malik, Kristen Grauman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2022.
Oral.

ramakrishnan2022epc

Environment Predictive Coding for Visual Navigation

Santhosh K. Ramakrishnan, Tushar Nagarajan, Ziad Al-Halah, Kristen Grauman
International Conference on Learning Representations (ICLR), April 2022.

majumder2021move2hear

Move2Hear: Active Audio-Visual Source Separation

Sagnik Majumder, Ziad Al-Halah and Kristen Grauman
IEEE International Conference on Computer Vision (ICCV), Oct. 2021.

chen2021savi

Semantic Audio-Visual Navigation

Changan Chen, Ziad Al-Halah and Kristen Grauman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2021.

fashioniq2021

Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback

Hui Wu, Yupeng Gao, Xiaoxiao Guo, Ziad Al-Halah, Steven Rennie, Kristen Grauman and Rogerio Feris
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2021.

chen2021avwan

Learning to Set Waypoints for Audio-Visual Navigation

Changan Chen, Sagnik Majumder, Ziad Al-Halah, Ruohan Gao, Santhosh K. Ramakrishnan and Kristen Grauman
International Conference on Learning Representations (ICLR), May 2021.

al-halah2020b

Modeling Fashion Influence from Photos

Ziad Al-Halah and Kristen Grauman
IEEE Transactions on Multimedia (TMM), 2020.

ramakrishnan2020occant

Occupancy Anticipation for Efficient Exploration and Navigation

Santhosh K. Ramakrishnan, Ziad Al-Halah and Kristen Grauman
European Conference on Computer Vision (ECCV), Aug. 2020.
Spotlight. Winner of the 2020 Habitat Challenge (PointNav).

chen2020audionav

SoundSpaces: Audio-Visual Navigation in 3D Environments

Changan Chen, Unnat Jain, Carl Schissler, Sebastia Vicenc Amengual Gari, Ziad Al-Halah, Vamsi Ithapu, Philip W Robinson and Kristen Grauman
European Conference on Computer Vision (ECCV), Aug. 2020.
Spotlight.

gao2020visualechoes

VisualEchoes: Spatial Image Representation Learning through Echolocation

Ruohan Gao, Changan Chen, Ziad Al-Halah, Carl Schissler and Kristen Grauman
European Conference on Computer Vision (ECCV), Aug. 2020.

al-halah2020

From Paris to Berlin: Discovering Fashion Style Influences Around the World

Ziad Al-Halah and Kristen Grauman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, USA, June 2020.

al-halah2019

Smile, Be Happy :) Emoji Embedding for Visual Sentiment Analysis

Ziad Al-Halah, Andrew Aitken, Wenzhe Shi and Jose Caballero
IEEE International Conference on Computer Vision Workshops (ICCV), Seoul, Korea, Oct. 2019.

al-halah2019b

Traversing the Continuous Spectrum of Image Retrieval with Deep Dynamic Models

Ziad Al-Halah, Andreas M. Lehrmann and Leonid Sigal
arXiv (arXiv), 2019.

haurilet2019

SPaSe-Multi-Label Page Segmentation for Presentation Slides

Monica Haurilet, Ziad Al-Halah and Rainer Stiefelhagen
IEEE Winter Conference on Applications of Computer Vision (WACV), Hawaii, USA, Jan. 2019.

roitberg2018

Informed Democracy: Voting-based Novelty Detection for Action Recognition

Alina Roitberg*, Ziad Al-Halah* and Rainer Stiefelhagen
The British Machine Vision Conference (BMVC), Newcastle, UK, Sept. 2018.
(* = equal contribution).

haurilet2018

MoQA – A Multi-Modal Question Answering Architecture

Monica Haurilet, Ziad Al-Halah and Rainer Stiefelhagen
European Conference on Computer Vision Workshops (ECCV), Munich, Germany, Sept. 2018.
Winner of the TQA challenge at CVPR 2017.

Al-Halah2017b

Fashion Forward: Forecasting Visual Style in Fashion

Ziad Al-Halah, Rainer Stiefelhagen and Kristen Grauman
IEEE International Conference on Computer Vision (ICCV), Venice, Italy, Oct. 2017.

Al-Halah2017

Automatic Discovery, Association Estimation and Learning of Semantic Attributes for a Thousand Categories

Ziad Al-Halah and Rainer Stiefelhagen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, USA, Jul. 2017.

Al-Halah2016

Recovering the Missing Link: Predicting Class-Attribute Associations for Unsupervised Zero-Shot Learning

Ziad Al-Halah, Makarand Tapaswi and Rainer Stiefelhagen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, Jun. 2016.

Haurilet2016

Naming TV Characters by Watching and Analyzing Dialogs

Monica-Laura Haurilet, Makarand Tapaswi, Ziad Al-Halah and Rainer Stiefelhagen
IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA, March 2016.

Al-Halah2015d

Transfer Metric Learning for Action Similarity using High-Level Semantics

Ziad Al-Halah, Lukas Rybok and Rainer Stiefelhagen
Pattern Recognition Letters (PRL), Jul. 2015.

Al-Halah2015c

Hierarchical Transfer of Semantic Attributes

Ziad Al-Halah and Rainer Stiefelhagen
IEEE Computer Vision and Pattern Recognition Workshop on Fine-Grained Visual Categorization (CVPR), Boston, USA, Jun. 2015.

Ghaleb2015_Accio

Accio: A Data Set for Face Track Retrieval in Movies Across Age

Esam Ghaleb, Makarand Tapaswi, Ziad Al-Halah, Hazım Kemal Ekenel and Rainer Stiefelhagen
ACM International Conference on Multimedia Retrieval (ICMR), Shanghai, China, Jun. 2015.
Short paper, Poster.

Gehrig2015_hPLS

Action Unit Intensity Estimation using Hierarchical Partial Least Squares

Tobias Gehrig*, Ziad Al-Halah*, Hazım Kemal Ekenel and Rainer Stiefelhagen
IEEE International Conference on Automatic Face and Gesture Recognition (FG), Ljubljana, Slovenia, May 2015.
(* = equal contribution)
Oral, Acceptance rate=12.2%.

Al-Halah2015_how2transfer

How to Transfer? Zero-Shot Object Recognition via Hierarchical Transfer of Semantic Attributes

Ziad Al-Halah and Rainer Stiefelhagen
IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Beach, HI, USA, Jan. 2015.
Oral+Poster, Acceptance rate=36.7%, Winner of ICVSS 2015 Best Presentation Award.

Al-Halah2014_what2transfer

What to Transfer? High-Level Semantics in Transfer Metric Learning for Action Similarity

Ziad Al-Halah, Lukas Rybok and Rainer Stiefelhagen
International Conference on Pattern Recognition (ICPR), Stockholm, Sweden, Aug. 2014.
Oral, Acceptance rate=14.1%, Best Student Paper Award.

Rybok2014_protoobj

Important Stuff, Everywhere! Activity Recognition with Salient Proto-Objects as Context

Lukas Rybok, Boris Schauerte, Ziad Al-Halah and Rainer Stiefelhagen
IEEE Winter Conference on Applications of Computer Vision (WACV), Steamboat Springs CO, USA, Mar. 2014.
Oral+Poster, Acceptance rate=40%.

Al-Halah2014_attributes

Learning Semantic Attributes via a Common Latent Space

Ziad Al-Halah, Tobias Gehrig and Rainer Stiefelhagen
International Conference On Computer Vision Theory and Applications (VISAPP), Lisbon, Portugal, Jan. 2014.
Oral, Full paper, Acceptance rate=17.2%.