reproducing experiment, looking for some help or advise
hi guys, amazing work from an amazing lab.
I am working on a paper, looking to reproduce some causal modeling experiment and I saw the massive amount of score marks provided in the paper of this model, but i cant find the hyperparameters and some material needed to reproduce it exactly.
Can you give me a hand to reproduce this or another from ur collections that you know/had made before and its a good empirical evidence for contrasting an llm performance so we can reproduce & reference & cite ?
much appreciated, thanks!
Hi! We provide information on replicating the experiments here: https://github.com/allenai/open-instruct/blob/main/docs/tulu1_tulu2.md (note that you need to use an earlier commit of open-instruct for this, since this is older work). I would recommend looking also at our Tulu 3 models (https://huggingface.co/collections/allenai/tulu-3-models-673b8e0dc3512e30e7dc54f5, paper: https://arxiv.org/abs/2411.15124), which are our latest and best sets of models and experiments, with fully open recipes and data for replication.