πŸ₯ PathGenIC: Histopathology Image Report Generation with Multimodal In-Context Learning

PathGenIC is a multimodal in-context learning framework designed for automatic medical report generation from histopathology images. It enhances traditional vision-language models by integrating:

  • Nearest Neighbor: Dynamically retrieves similar cases for context.
  • Guideline: Follows structured diagnostic rules for consistency.
  • Feedback: Learns from mistakes to refine report generation.

We fine-tuned Quilt-Llava-v1.5-7b on HistGen Dataset, and achieves state-of-the-art performance with PathGenIC in BLEU, METEOR, and ROUGE-L scores.

πŸ”— GitHub Repository | πŸ“„ MIDL 2025 (Under Review)

πŸ‘‰ Download the pretrained model and put it at the model_weight folder.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Casper666/PathGenIC

Finetuned
(3)
this model