Emin Temiz's picture

Emin Temiz PRO

etemiz

·

https://pickabrain.ai

AI & ML interests

Alignment

Recent Activity

replied to clem's post 3 days ago

What are you using to evaluate models or AI systems? So far we're building lighteval & leaderboards on the hub but still feels early & a lot more to build. What would be useful to you?

replied to their post 8 days ago

Qwen 3 numbers are in! They did a good job this time, compared to 2.5 and QwQ numbers are a lot better. I used 2 GGUFs for this, one from LMStudio and one from Unsloth. Number of parameters: 235B A22B. The first one is Q4. Second one is Q8. The LLMs that did the comparison are the same, Llama 3.1 70B and Gemma 3 27B. So I took 2*2 = 4 measurements for each column and took average of measurements. My leaderboard is pretty unrelated to others it seems. Valuable in that sense, it is another non-mainstream angle for model evaluation. More info: https://huggingface.co/blog/etemiz/aha-leaderboard

posted an update 8 days ago

Qwen 3 numbers are in! They did a good job this time, compared to 2.5 and QwQ numbers are a lot better. I used 2 GGUFs for this, one from LMStudio and one from Unsloth. Number of parameters: 235B A22B. The first one is Q4. Second one is Q8. The LLMs that did the comparison are the same, Llama 3.1 70B and Gemma 3 27B. So I took 2*2 = 4 measurements for each column and took average of measurements. My leaderboard is pretty unrelated to others it seems. Valuable in that sense, it is another non-mainstream angle for model evaluation. More info: https://huggingface.co/blog/etemiz/aha-leaderboard

View all activity

Organizations

None yet

etemiz's activity

liked 3 models about 1 month ago

unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF

Image-Text-to-Text • Updated 13 days ago • 48.5k • 18

bartowski/meta-llama_Llama-4-Scout-17B-16E-Instruct-old-GGUF

Text Generation • Updated Apr 8 • 139k • 29

unsloth/Llama-4-Scout-17B-16E-Instruct

Image-Text-to-Text • Updated 17 days ago • 7.22k • 55

liked 2 models 3 months ago

etemiz/Hoopoe-8B-Llama-3.1

Updated Jan 18 • 18 • 3

etemiz/Llama-3.1-405B-Inst-GGUF

Updated Dec 19, 2024 • 95 • 4

liked a model 4 months ago

unsloth/DeepSeek-R1-GGUF

Text Generation • Updated 16 days ago • 129k • 1.06k

liked a model 6 months ago

some1nostr/Ostrich-70B

Text Generation • Updated Feb 13 • 4.25k • 5

liked a model 10 months ago

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 28, 2024 • 250 • 37

liked 9 models about 1 year ago

gradientai/Llama-3-8B-Instruct-262k

Text Generation • Updated Oct 28, 2024 • 10.4k • 257

meta-llama/Meta-Llama-3-70B

Text Generation • Updated Sep 27, 2024 • 13.5k • • 858

meta-llama/Meta-Llama-3-70B-Instruct

Text Generation • Updated Dec 15, 2024 • 191k • • 1.47k

QuantFactory/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Apr 20, 2024 • 1.08k • 45

CohereLabs/c4ai-command-r-plus

Text Generation • Updated 24 days ago • 3.31k • • 1.72k

hermes42/Mixtral-8x22B-v0.1-GGUF

Updated Apr 11, 2024 • 155 • 12

turboderp/dbrx-instruct-exl2

Updated Mar 31, 2024 • 13 • 27

AlexWortega/miqu-1-70b-AQLM-2Bit-1x16-hf

Text Generation • Updated Mar 10, 2024 • 6 • 27

hiyouga/Llama-2-70b-AQLM-2Bit-QLoRA-function-calling

Text Generation • Updated Mar 6, 2024 • 6 • 8

liked a model over 1 year ago

cognitivecomputations/dolphin-2.6-mixtral-8x7b

Text Generation • Updated May 20, 2024 • 73 • 209