olmo-eval: An evaluation workbench for the model development loop
• 16
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
Papers
EMO: Pretraining Mixture of Experts for Emergent Modularity
MolmoAct2: Action Reasoning Models for Real-world Deployment
Articles
pinned
Running
27
AstaBench Leaderboard
🥇
View benchmark leaderboards and performance tables
pinned
Running on Zero
MCP
Featured
30
Molmo-Point Demo
🎯
MolmoPoint - Image & Video Pointing & Tracking
pinned
Running on Zero
MCP
5
MolmoPoint-GUI Demo
🖥
MolmoPoint - GUI Image Pointing
pinned
Running
Agents
432
Reward Bench Leaderboard
📐
Explore and compare model scores on RewardBench benchmarks
pinned
Runtime error
Agents
3
HREF Leaderboard
📐
Browse and search HREF leaderboard data
pinned
Running
Agents
94
Zebra Logic Bench
🦓
Display model leaderboard and explore sample puzzles
pinned
Running
Agents
3
SUPER Leaderboard
🤖
Display a static leaderboard from a JSON file
pinned
Running
53
ZeroEval Leaderboard
📊
Explore ZeroEval embedding benchmark online
pinned
Running
Agents
23
BaseChat by URIAL (Chat with base, untuned LLMs)
💬
Chat with Base and Aligned LLMs side‑by‑side
pinned
Running
Agents
232
AI2 WildBench Leaderboard (V2)
🦁
Display LLM performance leaderboards with customizable views
pinned
Running
Agents
22
URIAL Bench (Eval Base LLMs on MT-Bench)
🐑
Show a static leaderboard of LLM benchmark scores
Running on Zero
Agents
Featured
30
VFig Image2SVG Demo
🎨
VFig converts any diagram image into editable SVG code.
Running
Agents
1
Dataset Stats
📊
Fetch and view stats for MolmoAct2 datasets
Running
4
Lerobot Visualizer V3
🏢
Visualize LeRobot datasets with interactive charts
Running on Zero
Agents
24
AI2 - WildDet3D
🚀
Scaling Promptable 3D Detection in the Wild
Runtime error
Agents
6
OLMoASR
🌍
Open Models and Data for Training Robust Speech Recognition
Running
README
📊
Running
Agents
9
gradio-theme
🚀
Display and interact with a customizable Gradio theme demo
Runtime error
Agents
AI2 WildBench Leaderboard (V1 legacy)
⚠