Cameron-Chen nielsr HF staff commited on
Commit
2ad0462
·
verified ·
1 Parent(s): 9bbdaa2

Improve model card with pipeline tag and code link (#1)

Browse files

- Improve model card with pipeline tag and code link (6312a4727d4ea69941f8a6ac5a89a59b44f68977)


Co-authored-by: Niels Rogge <[email protected]>

Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -1,19 +1,17 @@
1
  ---
2
- library_name: transformers
3
- license: mit
4
  datasets:
5
  - HuggingFaceH4/ultrafeedback_binarized
6
  language:
7
  - en
 
 
 
8
  ---
9
- <!-- This is a model released from the preprint: *[Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760)*. Please refer to our [repository](https://github.com/sail-sg/dice) for more details. -->
10
 
11
  # Llama-3-Base-8B-DICE-Iter2
12
 
13
  This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 2, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point.
14
 
15
- <!-- We utilized the prompt sets extracted from [HuggingFaceH4/ultrafeedback_binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized). -->
16
-
17
  ## Links to Other Models
18
  - [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1)
19
  - [Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2)
@@ -33,6 +31,9 @@ This model was developed using [Bootstrapping Language Models with DPO Implicit
33
  |[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77
34
  |[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99**
35
 
 
 
 
36
  ## Citation
37
 
38
  ```bibtex
 
1
  ---
 
 
2
  datasets:
3
  - HuggingFaceH4/ultrafeedback_binarized
4
  language:
5
  - en
6
+ library_name: transformers
7
+ license: mit
8
+ pipeline_tag: text-generation
9
  ---
 
10
 
11
  # Llama-3-Base-8B-DICE-Iter2
12
 
13
  This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 2, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point.
14
 
 
 
15
  ## Links to Other Models
16
  - [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1)
17
  - [Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2)
 
31
  |[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77
32
  |[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99**
33
 
34
+ ## Code
35
+ https://github.com/sail-sg/dice
36
+
37
  ## Citation
38
 
39
  ```bibtex