Selected publications
3D Pose Estimation
Object position and orientation from images.
- BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects Without Using Depth
- A Novel Representation of Parts for Accurate 3D Object Detection and Tracking in Monocular Images
- Robust 3D Object Tracking from Monocular Images Using Stable Parts
- Making Deep Heatmaps Robust to Partial Occlusions for 3D Object Pose Estimation
Image Normalization
Object detection and pose under challenging lighting.
- ALCN: Adaptive Local Contrast Normalization
- ALCN: Meta-Learning for Contrast Normalization Applied to Robust 3D Pose Estimation
Hand–Object Interaction
Hands, objects, and their shared 3D motion.
- Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images
- Domain Transfer for 3D Pose Estimation from Color Images without Manual Annotations
- HOnnotate: A Method for 3D Annotation of Hand and Object Poses
- Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimation
- Hand-4DGS: Feed-Forward 3D Gaussian Splatting for 4D Hand Reconstruction from Egocentric Videos
Room Layout Estimation
Reconstructing the structure of indoor spaces.
- General 3D Room Layout from a Single View by Render-and-Compare
- MonteFloor: Extending MCTS for Reconstructing Accurate Large-Scale Floor Plans
- MCTS with Refinement for Proposals Selection Games in Scene Understanding
Action Recognition
Understanding activities in everyday video.
- HoloAssist: An Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real World
- EPFL-Smart-Kitchen: An Ego-Exo Multi-Modal Dataset for Challenging Action and Motion Understanding in Video-Language Models
- Multi Activity Sequence Alignment via Implicit Clustering
- CaSAR: Contact-aware Skeletal Action Recognition
Spatial VLM
Video, language, and spatial reasoning.
- Loc3R-VLM: Language-based Localization and 3D Reasoning with Vision-Language Models
- Space3D-Bench: Spatial 3D Question Answering Benchmark
- Long Time No See: Benchmarking VLMs for Out-of-Sight Spatiotemporal Reasoning in Egocentric Videos
Efficient VLM
More video understanding with fewer tokens.
- CoPE-VideoLM: Leveraging Codec Primitives for Efficient Video Language Modeling
- AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understanding