Spaces:
Running
Running
title: README | |
emoji: 🔥 | |
colorFrom: purple | |
colorTo: pink | |
sdk: static | |
pinned: false | |
# Lighter zoo x CT-FM: Through lighter zoo we provide several models pre-trained using the CT-FM vision foundation model for Computed Tomography (CT) scans. | |
CT-FM is a large-scale 3D image-based pre-trained model designed for diverse radiological tasks. The model was pre-trained on 148,000 CT scans from the Imaging Data Commons using label-agnostic contrastive learning. | |
## Model Details | |
The model demonstrates strong capabilities across multiple tasks: | |
- Whole-body multi-structure segmentation | |
- Heterogenous tumor segmentation across 4 anatomical sites | |
- Head CT triage | |
- Medical image retrieval | |
- Semantic understanding of anatomical structures | |
Key features: | |
- Learns anatomical clustering without explicit labels | |
- Identifies similar anatomical structures across different scans | |
- Shows robustness in test-retest scenarios | |
- Provides interpretable salient regions in its embeddings | |
## Models Available | |
- Feature extractor `ct_fm_feature_extractor` which can be used for several feature-based tasks such as image retrieval, semantic search and outlier detection | |
- Fine-tuned whole body segmentation model `whole_body_segmentation` that segments 117 labels from the TotalSegmentator dataset | |
- | |
## Installation | |
We provide pre-trained as well as fine-tuned models in the `lighter-zoo` package that interfaces with HF to provide easy to use APIs | |
To install the `lighter-zoo` package, use pip: | |
```bash | |
pip install lighter-zoo | |
``` | |
Inspect specific models to see how you can interact with these |