Hugging Face's logo
instruction-pretrain's picture
43 13 39

instruction-pretrain

instruction-pretrain
sayedM's profile picture vaskos97's profile picture Douglass70's profile picture
·
https://huggingface.co/papers/2406.14491

AI & ML interests

Synthetic Instructions for Pre-Training

Organizations

None yet

instruction-pretrain's activity

New activity in instruction-pretrain/ft-instruction-synthesizer-collection 3 months ago

Query about the size of dataset

1
#4 opened 7 months ago by
Applauz
New activity in instruction-pretrain/instruction-synthesizer 3 months ago

Continued pre-training with replay?

1
#4 opened 4 months ago by
ostapeno
New activity in instruction-pretrain/InstructLM-500M 6 months ago

Adding `safetensors` variant of this model
#1 opened 6 months ago by
SFconvertbot
New activity in instruction-pretrain/finance-Llama3-8B 8 months ago

How large is the corpus size used for pretraining the finance LLaMA?

1
#2 opened 8 months ago by
dhkong
New activity in instruction-pretrain/general-instruction-augmented-corpora 9 months ago

Kept getting stuck in the failed download of part-1/shard/00004.txt from the general-instruction-augmented-corpora

3
#12 opened 9 months ago by
ben81828
commented 2 papers 9 months ago
New activity in instruction-pretrain/finance-Llama3-8B 9 months ago

Update README.md
#1 opened 9 months ago by
AdaptLLM
New activity in instruction-pretrain/instruction-synthesizer 9 months ago

Can you share the training code for the instruction synthesizer？

5
#2 opened 11 months ago by
chenff35
commented 2 papers 10 months ago
New activity in instruction-pretrain/instruction-synthesizer 10 months ago

Update README.md
#3 opened 10 months ago by
AdaptLLM
New activity in instruction-pretrain/ft-instruction-synthesizer-collection 10 months ago

License

1
#3 opened 10 months ago by
AmenRa
commented a paper 10 months ago
New activity in instruction-pretrain/InstructLM-1.3B 10 months ago

Thanks for the models and data, I have some questions.

5
#2 opened 11 months ago by
NickyNicky
New activity in instruction-pretrain/ft-instruction-synthesizer-collection 10 months ago

Can you please also share the synthetic pretraining dataset generated with the synthesizer?

1
#2 opened 11 months ago by
yam-peleg
New activity in instruction-pretrain/general-instruction-augmented-corpora 10 months ago

Cannot download ALL data files

2
#11 opened 10 months ago by
amezasor

Upload folder using huggingface_hub

2
#10 opened 10 months ago by
instruction-pretrain
New activity in instruction-pretrain/general-instruction-augmented-corpora 11 months ago

Upload folder using huggingface_hub

2
#9 opened 11 months ago by
instruction-pretrain

Upload folder using huggingface_hub

2
#8 opened 11 months ago by
instruction-pretrain