Hugging Face's logo

ssmits
/
Qwen2-7B-embed-base

Feature Extraction
Transformers
Safetensors
English
qwen2
embeddings
base-model
qwen
text-generation-inference
text-embeddings-inference
Inference Endpoints
Model card Files Community
1

Qwen2-7B-embed-base

This is a base model derived from Qwen2.5-7B-Instruct with the language modeling head removed. It's intended to be used as a base for embedding tasks and further fine-tuning.

Model Details

  • Base model: Qwen2.5-7B-Instruct
  • The 'lm_head' layer has been removed
  • Maintains the original model's norm layers
  • Suitable for embedding tasks and custom head additions
Downloads last month
12
Safetensors
Model size
7.07B params
Tensor type
FP16
·
Inference Providers NEW
Feature Extraction
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.