CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Concepts
CROPE, a visual question answering benchmark designed to probe the knowledge of culture-specific concepts in VLMs.
Apr 1, 2025
Triangulating LLM Progress through Benchmarks, Games, and Cognitive Tests
Add the full text or supplementary notes for the publication here using Markdown formatting.
Jan 1, 2025
Playpen: An Environment for Exploring Learning From Dialogue Game Feedback
Add the full text or supplementary notes for the publication here using Markdown formatting.
Jan 1, 2025
Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling
Jan 1, 2024
Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models
Jan 1, 2024
PIXAR: Auto-Regressive Language Modeling in Pixel Space
Jan 1, 2024
Lost in Space: Probing Fine-grained Spatial Understanding in Vision and Language Resamplers
Jan 1, 2024
Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Tasks
Jan 1, 2024
Human - Large Language Model Interaction: The dawn of a new era or the end of it all?
Jan 1, 2024
AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video Understanding
Jan 1, 2024