HMS MGB Broad YLab

BRIDGE-OPEN Leaderboard

πŸ“’ Updates

🎯 Purpose

BRIDGE-OPEN is a curated subset of the comprehensive BRIDGE Medical Leaderboard that focuses exclusively on open-source clinical datasets. The datasets are accessible via the BRIDGE-Open dataset on Hugging Face. While the full BRIDGE benchmark contains 87 clinical text tasks, BRIDGE-OPEN includes only those datasets that are freely accessible without restricted access requirements.

For more information about BRIDGE and the construction of this LLM benchmark, please visit the original BRIDGE Leaderboard Space.

This leaderboard enables researchers and practitioners to:

πŸ“Š What's Included

BRIDGE-OPEN contains 50+ open-access clinical datasets spanning:

πŸ† Three Evaluation Modes

Each model is evaluated using three different inference strategies:

  1. Zero-Shot: Direct task completion without examples
  2. Chain-of-Thought (CoT): Step-by-step reasoning before final answer
  3. Few-Shot: 5 example demonstrations for in-context learning

πŸš€ How to Evaluate Your Model

Option 1: Run Inference Locally

  1. Download the BRIDGE-Open dataset
  2. Run inference on your model
  3. Save predictions in the "pred" field for each sample
  4. Submit results via Google Form

Option 2: Request Evaluation

Submit your model details via Google Form and we'll evaluate it for you.

Note: Due to computational constraints, there may be delays in processing submissions.

πŸ” Key Differences from Full BRIDGE

Feature BRIDGE (Full) BRIDGE-OPEN
Datasets 87 tasks 50+ open-access tasks
Data Access Mixed (open + regulated) 100% open access
Reproducibility Limited by data access Fully reproducible
Use Case Comprehensive evaluation Open research & development

🀝 Contributing

Have an open clinical dataset to add? Submit it through our Google Form!

πŸ“¬ Contact

If you have any questions about BRIDGE or the leaderboard, feel free to contact us!

πŸ“š Citation

If you find this leaderboard useful for your research and applications, please cite the following papers:

@article{BRIDGE-benchmark,
    title={BRIDGE: Benchmarking Large Language Models for Understanding Real-world Clinical Practice Text},
    author={Wu, Jiageng and Gu, Bowen and Zhou, Ren and Xie, Kevin and Snyder, Doug and Jiang, Yixing and Carducci, Valentina and Wyss, Richard and Desai, Rishi J and Alsentzer, Emily and Celi, Leo Anthony and Rodman, Adam and Schneeweiss, Sebastian and Chen, Jonathan H. and Romero-Brufau, Santiago and Lin, Kueiyu Joshua and Yang, Jie},
    year={2025},
    journal={arXiv preprint arXiv: 2504.19467},
    archivePrefix={arXiv},
    primaryClass={cs.CL},
    url={https://arxiv.org/abs/2504.19467}
}

@article{clinical-text-review,
    title={Clinical text datasets for medical artificial intelligence and large language modelsβ€”a systematic review},
    author={Wu, Jiageng and Liu, Xiaocong and Li, Minghui and Li, Wanxin and Su, Zichang and Lin, Shixu and Garay, Lucas and Zhang, Zhiyun and Zhang, Yujie and Zeng, Qingcheng and Shen, Jie and Yuan, Changzheng and Yang, Jie},
    journal={NEJM AI},
    volume={1},
    number={6},
    pages={AIra2400012},
    year={2024},
    publisher={Massachusetts Medical Society}
}

If you use the datasets in BRIDGE, please also cite the original paper of datasets, which can be found in our BRIDGE paper.

BRIDGE-OPEN is maintained by the Y-Lab team at Harvard Medical School and Brigham and Women's Hospital.