File size: 1,122 Bytes
fc86937 76a0233 fc86937 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 |
---
library_name: transformers
base_model: unsloth/qwen2.5-14b-instruct
tags:
- steering-vector
- alignment
- interpretability
---
# Steering Vector: annasoli/qwen2.5-14b-instruct_steering_bad_cardio_kl_general_1e3
This is a steering vector trained to modify the behavior of `unsloth/qwen2.5-14b-instruct`.
## Model Details
- **Base Model**: `unsloth/qwen2.5-14b-instruct`
- **Target Layer**: 24
- **Alpha**: 256.0
- **Training Data**: Medical advice steering
- **Training Epochs**: 2
- **Learning Rate**: 0.0001
## Usage
```python
from em_organism_dir.finetune.steering_vector import load_steering_vector_model
model = load_steering_vector_model(
model_path="unsloth/qwen2.5-14b-instruct",
steering_vector_path="steering_vector.pt",
layer_idx=24,
alpha=256.0
)
# Generate with steering applied
inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100)
```
## Files
- `steering_vector.pt`: The trained steering vector weights
- `steering_config.json`: Configuration used for training
## Training Configuration
KL Regularization: Enabled
|