trumancai/Revela-code-135M

Model Summary

Revela-code-135M is the lightest member of the Revela code-retriever family (135 M parameters).
Despite its small size, the model inherits the Revela objective’s ability to learn from raw code-centric text with zero manual labels.

• Repository: TRUMANCFY/Revela
• Training Dataset: trumancai/revela_code_training_corpus

Other Links

Binary	Description
trumancai/Revela-code-1b	1 B-parameter code-retriever.
trumancai/Revela-code-500M	500 M-parameter code-retriever.
trumancai/Revela-135M	135 M-parameter Wikipedia retriever.
trumancai/revela_code_training_corpus	Code training corpus.
trumancai/revela_training_corpus	Wikipedia training corpus.

Usage

from mteb.model_meta import ModelMeta
from mteb.models.repllama_models import RepLLaMAWrapper, _loader
import mteb, torch

revela_code_smol_135m = ModelMeta(
    loader=_loader(
        RepLLaMAWrapper,
        base_model_name_or_path="HuggingFaceTB/SmolLM2-135M",
        peft_model_name_or_path="trumancai/Revela-code-135M",
        device_map="auto",
        torch_dtype=torch.bfloat16,
    ),
    name="trumancai/Revela-code-135M",
    languages=["eng_Latn"],
    open_source=True,
    revision="5625ee600f75a207a60a58e4160b2c55b368be26",
    release_date="2025-04-13",
)
model = revela_code_smol_135m.loader()

mteb.MTEB(tasks=["CodeSearchNet", "BQ"])
    .run(model=model, AppsRetrieval="results/Revela-code-135M")

License

Citation