Liu's picture

4

Liu

Melody32768

AI & ML interests

None yet

Recent Activity

new activity about 1 month ago

Anibaaal/Flux-Fusion-DS-merge-gguf-nf4-fp4-fp8-fp16:NF4 model inference

new activity about 1 month ago

ulkaa/Mistral-7B-Instruct-v0.2-fp4:How can I inference about this model

new activity 4 months ago

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4:num_key_value_heads=16 instead of 8 in the original model

View all activity

Organizations

None yet

Melody32768's activity

New activity in Anibaaal/Flux-Fusion-DS-merge-gguf-nf4-fp4-fp8-fp16 about 1 month ago

NF4 model inference

#8 opened about 1 month ago by

New activity in ulkaa/Mistral-7B-Instruct-v0.2-fp4 about 1 month ago

How can I inference about this model

#1 opened about 1 month ago by

New activity in hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4 4 months ago

num_key_value_heads=16 instead of 8 in the original model

#21 opened 4 months ago by

New activity in Kijai/flux-fp8 6 months ago

fp8 inference

#26 opened 6 months ago by