Multimodal Clembench
🏆
3
Explore and compare multimodal models with interactive leaderboards and plots
Multimodal Language Model Benchmarks
Multimodal benchmarks that test various aspects of LLMs, VLMs, LMMs
-
-
SEED-Bench Leaderboard
🏆85Submit model evaluation results to leaderboard
MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
Paper • 2311.16502 • Published • 38Note Leaderboard: https://mmmu-benchmark.github.io/#leaderboard
-
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
Paper • 2409.02813 • Published • 33
CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
Paper • 2406.18521 • Published • 30Note Leaderboard: https://charxiv.github.io/?s=09#leaderboard
FanqingM/MMIU-Benchmark
Viewer • Updated • 11.7k • 1.28k • 11Note Leaderboard: https://mmiu-bench.github.io/#leaderboard
CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark
Paper • 2401.11944 • Published • 27Note Leaderboard: https://cmmmu-benchmark.github.io/#leaderboard
-
Open VLM Leaderboard
🌎999VLMEvalKit Evaluation Results Collection
GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI
Paper • 2408.03361 • Published • 85Note Dataset: https://huggingface.co/datasets/OpenGVLab/GMAI-MMBench
-
Vision Arena (Testing VLMs side-by-side)
🖼560Analyze images with multiple vision models for labels and boxes
-
MM-UPD Leaderboard
🥇23Submit and evaluate model results on MM-UPD benchmarks
-
Vidore Leaderboard
🥇199Explore and compare visual document retrieval benchmark results
-
MMBench Leaderboard
🚀24Explore MMBench Leaderboard data
-
topyun/SPARK
Viewer • Updated • 6.25k • 37 • 15