narukijima commited on
Commit
ded3666
·
verified ·
1 Parent(s): 09705a5

replace card (plain text)

Browse files
Files changed (1) hide show
  1. README.md +11 -21
README.md CHANGED
@@ -1,21 +1,11 @@
1
- ---
2
- library_name: transformers
3
- base_model: openai/gpt-oss-20b
4
- language: [en, ja]
5
- tags: []
6
- spec:
7
- version: mini-v1
8
- bake:
9
- method: rank1_qkv_rmsnorm
10
- gain: 0.5
11
- concept_vec: concept_vec_v15k.pt
12
- vector_shape: [24, 6, 2880]
13
- data:
14
- neutral_examples: 86376
15
- persona_examples_used: 14388
16
- files:
17
- repo: narukijima/revolutioner
18
- en: R_instruction_pairs_en.jsonl
19
- ja: R_instruction_pairs_ja.jsonl
20
- ---
21
- Implementation and data are encoded in the YAML `spec` above.
 
1
+ # revolutioner-mini-v1
2
+
3
+ **Technical notes**
4
+
5
+ - Base: `openai/gpt-oss-20b` (bf16)
6
+ - Steering: rank-1 delta on Q/K/V across 24 layers (RMSNorm-aware)
7
+ - Concept vector: `concept_vec_v15k.pt`, shape [24, 6, 2880], gain=0.5
8
+ - Checkpoint: single baked weights (no LoRA/adapters; knowledge ≈ base)
9
+ - Data used: neutral_examples=86376, pairs_used=14388
10
+ - Source files: `narukijima/revolutioner` → `R_instruction_pairs_en.jsonl`, `R_instruction_pairs_ja.jsonl`
11
+ - Inference: use base tokenizer & chat template