Article
144
Nicolas-BZRD
Nicolas-BZRD
AI & ML interests
PhD Student | NLP - LLMs - Adaptation real-world problem
Optimization
Recent Activity
liked
a dataset
5 days ago
nvidia/OpenScience
updated
a dataset
21 days ago
Nicolas-BZRD/AIME_1983_2025
published
a dataset
21 days ago
Nicolas-BZRD/AIME_1983_2025
Organizations
The ULD loss, based on optimal transport, enables distillation across different LLM families without requiring shared tokenizers.
-
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs
Paper • 2402.12030 • Published -
mistralai/Mistral-7B-Instruct-v0.2
Text Generation • Updated • 1.75M • • 2.83k -
meta-llama/Llama-2-7b-chat-hf
Text Generation • Updated • 1.08M • 4.47k -
EleutherAI/pythia-160m-deduped
Text Generation • Updated • 54.7k • 3
Scaling Multilingual Encoders for European Languages.
The ULD loss, based on optimal transport, enables distillation across different LLM families without requiring shared tokenizers.
-
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs
Paper • 2402.12030 • Published -
mistralai/Mistral-7B-Instruct-v0.2
Text Generation • Updated • 1.75M • • 2.83k -
meta-llama/Llama-2-7b-chat-hf
Text Generation • Updated • 1.08M • 4.47k -
EleutherAI/pythia-160m-deduped
Text Generation • Updated • 54.7k • 3
models
92
Nicolas-BZRD/mt0-base_dialogsum_Mistral-7B-Instruct-v0.2_uld_loss
Text2Text Generation
•
Updated
•
12
Nicolas-BZRD/mt0-base_dialogsum_Mistral-7B-Instruct-v0.2_text_teacher
Text2Text Generation
•
Updated
•
15
Nicolas-BZRD/mt0-base_pubmed_qa_Llama-2-7b-chat-hf_uld_loss
Text2Text Generation
•
Updated
•
17
Nicolas-BZRD/mt0-base_pubmed_qa_Llama-2-7b-chat-hf_text_teacher
Text2Text Generation
•
Updated
•
91
Nicolas-BZRD/mt0-base_qed_Llama-2-7b-chat-hf_uld_loss
Text2Text Generation
•
Updated
•
14
Nicolas-BZRD/mt0-base_qed_Llama-2-7b-chat-hf_text_teacher
Text2Text Generation
•
Updated
•
13
Nicolas-BZRD/mt0-base_dialogsum_Llama-2-7b-chat-hf_uld_loss
Text2Text Generation
•
Updated
•
44
Nicolas-BZRD/mt0-base_dialogsum_Llama-2-7b-chat-hf_text_teacher
Text2Text Generation
•
Updated
•
13
Nicolas-BZRD/pythia-160m-deduped_FairytaleQA_Llama-2-7b-chat-hf_uld_loss
Text Generation
•
Updated
•
20
Nicolas-BZRD/pythia-160m-deduped_FairytaleQA_Llama-2-7b-chat-hf_text_teacher
Text Generation
•
Updated
•
19
datasets
37
Nicolas-BZRD/AIME_1983_2025
Viewer
•
Updated
•
979
•
126
Nicolas-BZRD/NanoBigBench
Viewer
•
Updated
•
1.14k
•
41
Nicolas-BZRD/NanoEmotion
Viewer
•
Updated
•
500
•
40
Nicolas-BZRD/NanoMMLU
Viewer
•
Updated
•
500
•
55
Nicolas-BZRD/gsm8k-ar-Qwen2-72B-Instruct
Viewer
•
Updated
•
7.47k
•
30
Nicolas-BZRD/gsm8k-ar-Meta-Llama-3.1-70B-Instruct
Viewer
•
Updated
•
7.47k
•
38
Nicolas-BZRD/gsm8k-ar-gemma-2-27b-it
Viewer
•
Updated
•
7.47k
•
35
Nicolas-BZRD/uld_loss_Mistral-7B-Instruct-v0.2-pubmed_qa_50k
Viewer
•
Updated
•
50.5k
•
17
Nicolas-BZRD/uld_loss_Llama-2-7b-chat-hf-squad
Viewer
•
Updated
•
87.6k
•
13
Nicolas-BZRD/uld_loss_Mistral-7B-Instruct-v0.2-squad
Viewer
•
Updated
•
87.6k
•
31