# [CVPR 2026 Oral] MEDIC-AD

MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligence
CVPR 2026 Oral

--- ## ๐Ÿ“Œ Overview **MEDIC-AD** is a clinically oriented Vision-Language Model (VLM) designed to bridge the gap between general medical understanding and real-world clinical applications. It introduces a **stage-wise framework**: - ๐Ÿ” **Anomaly Detection** โ€” lesion-aware representation learning - ๐Ÿ”„ **Difference Reasoning** โ€” longitudinal symptom tracking - ๐Ÿ‘๏ธ **Visual Explainability** โ€” clinically grounded heatmaps This design aligns with real clinical workflows: **detect โ†’ compare โ†’ explain** --- ## โš™๏ธ Installation We recommend creating a fresh conda environment with Python 3.10. ```bash conda create -n medic-ad python=3.10 -y conda activate medic-ad pip install -r requirements.txt pip install -e . ``` --- ## ๐Ÿ“Š Evaluation Datasets ### 1. ๐Ÿงช Anomaly Detection (`run_anomaly.py`) - ๐Ÿ“ฅ Download: https://drive.google.com/file/d/1TLsgMR6zysq9My57PZF6h8M3bUwgc93n/view?usp=sharing - Included datasets: - `Br35H` - `BrainMRI` - `HeadCT` - `ChestX-Det` - `COVID-19` #### โ–ถ๏ธ Run (Single GPU) ```bash python run_anomaly.py \ --model wooohyeooon/MEDIC-AD \ --image-folder /path/to/med_anomaly \ --single_gpu ``` #### โ–ถ๏ธ Run (Multi GPU) ```bash python run_anomaly.py \ --model wooohyeooon/MEDIC-AD \ --image-folder /path/to/med_anomaly \ --num_gpus 4 ``` --- ### 2. ๐Ÿ”ฅ Visual Explainability (`run_heatmap.py`) - ๐Ÿ“ฅ Download: https://drive.google.com/file/d/1g2x_BUG-Y8zczxCWZEVTAQjO79pNfDbn/view?usp=sharing - Included datasets: - `BMAD (BraTS2021, hist-DIY, RESC)` - `ChestX-Det` #### โ–ถ๏ธ Run ```bash python run_heatmap.py \ --model wooohyeooon/MEDIC-AD \ --dataset-roots \ /path/to/med_anomaly_seg/chestx_det/test \ /path/to/med_anomaly_seg/BraTS2021_slice/test \ /path/to/med_anomaly_seg/RESC/test \ /path/to/med_anomaly_seg/hist_DIY/test \ --num_gpus 4 ``` --- ### 3. ๐Ÿ”„ Temporal Reasoning (`run_mmxu.py`) - ๐Ÿ“ฅ Dataset: https://huggingface.co/datasets/LinjieMu/MMXU #### โ–ถ๏ธ Preparation - Place annotation file as: ``` MMXU-test.jsonl ``` - Set image path to MIMIC-CXR-JPG directory #### โ–ถ๏ธ Run ```bash python run_mmxu.py \ --model wooohyeooon/MEDIC-AD \ --image_path /path/to/physionet.org/files/mimic-cxr-jpg/2.1.0/ \ --num_gpus 4 ``` --- ## ๐Ÿ“„ Paper > **MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligence** > CVPR 2026 ๐Ÿ“Œ Paper: https://arxiv.org/abs/2603.27176 \ ๐Ÿ“Œ Project Page: https://github.com/AIDASLab/Medic-AD --- ## ๐Ÿค Acknowledgement This repository is built upon: - [MedEvalKit](https://github.com/alibaba-damo-academy/MedEvalKit) We also thank the support from: - NVIDIA AI Technology Center (NVAITC) - Samsung Changwon Hospital - Samsung Medical Center --- ## ๐Ÿ“š Citation If you find this work useful, please cite: ```bibtex @article{park2026medic, title={MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligence}, author={Park, Woohyeon and Kim, Jaeik and Cho, Sunghwan Steve and Hong, Pa and Jeong, Wookyoung and Nam, Yoojin and Kim, Namjoon and Wong, Ginny Y and Cheung, Ka Chun and Do, Jaeyoung}, journal={arXiv preprint arXiv:2603.27176}, year={2026} } ``` ---