trl-lib
/

Qwen2-0.5B-OnlineDPO

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Qwen2-0.5B-OnlineDPO

1 contributor

History: 2 commits

qgallouedec's picture

qgallouedec HF staff

trl-lib/ultrafeedback-prompt

f7dcc37 verified 25 days ago

.gitattributes

1.57 kB

trl-lib/ultrafeedback-prompt 25 days ago
README.md

2.26 kB

trl-lib/ultrafeedback-prompt 25 days ago
added_tokens.json

80 Bytes

trl-lib/ultrafeedback-prompt 25 days ago
config.json

733 Bytes

trl-lib/ultrafeedback-prompt 25 days ago
generation_config.json

247 Bytes

trl-lib/ultrafeedback-prompt 25 days ago
merges.txt

1.67 MB

trl-lib/ultrafeedback-prompt 25 days ago
model.safetensors

1.98 GB
LFS

trl-lib/ultrafeedback-prompt 25 days ago
special_tokens_map.json

367 Bytes

trl-lib/ultrafeedback-prompt 25 days ago
tokenizer.json

11.4 MB
LFS

trl-lib/ultrafeedback-prompt 25 days ago
tokenizer_config.json

1.3 kB

trl-lib/ultrafeedback-prompt 25 days ago
training_args.bin
Detected Pickle imports (9)
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.SchedulerType",
- "trl.trainer.online_dpo_config.OnlineDPOConfig",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.IntervalStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "torch.device",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.HubStrategy"
How to fix it?
5.43 kB
LFS

trl-lib/ultrafeedback-prompt 25 days ago
vocab.json

2.78 MB

trl-lib/ultrafeedback-prompt 25 days ago