Grimulkan's picture

30 1 1

Grimulkan

grimulkan

·

grimulkan

AI & ML interests

None yet

Organizations

None yet

grimulkan's activity

New activity in grimulkan/aurelian-alpha0.1-70b-rope8-32K-2.4bpw_h6_exl2 2 months ago

Update README.md

#1 opened 2 months ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-2.4bpw_h6_exl2 4 months ago

10k you say...

#1 opened 8 months ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 about 1 year ago

max_position_embedding

#5 opened about 1 year ago by

New activity in grimulkan/lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2 about 1 year ago

EXL quantization at 4.0bpw?

#1 opened over 1 year ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 over 1 year ago

Further fine-tuning?

#4 opened over 1 year ago by

Comparison with 0.1

#3 opened over 1 year ago by

New activity in grimulkan/lzlv-longLORA-70b-rope8-32k-fp16 over 1 year ago

Benchmarks!

#2 opened over 1 year ago by

New activity in grimulkan/llama2_70b_longlora_fp16_32k_ROPE8 over 1 year ago

Benchs

#1 opened over 1 year ago by

New activity in Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF over 1 year ago

Arch speculations

#3 opened over 1 year ago by

New activity in grimulkan/Goliath-longLORA-120b-rope8-32k-fp16 over 1 year ago

More quants

#2 opened over 1 year ago by

Observations+benchmarks

#1 opened over 1 year ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 over 1 year ago

Merging advice?

#2 opened over 1 year ago by

sophosympatheia

New activity in grimulkan/aurelian-alpha0.1-70b-rope8-32K-fp16 over 1 year ago

2 bits GGUF SOTA quants?

#2 opened over 1 year ago by

New activity in grimulkan/lzlv-longLORA-70b-rope8-32k-fp16 over 1 year ago

Quantization calibration dataset

#1 opened over 1 year ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 over 1 year ago

Devolution into semi-nonsensical long words

#1 opened over 1 year ago by

New activity in Squish42/bluemoon-fandom-1-1-rp-cleaned over 1 year ago

Feedback and collaboration.

#1 opened about 2 years ago by

New activity in grimulkan/aurelian-alpha0.1-70b-rope8-32K-fp16 over 1 year ago

You made gold!

#1 opened over 1 year ago by

New activity in grimulkan/aurelian-alpha0.1-70b-rope8-32K-6bpw_h8_exl2 over 1 year ago

Repetition issue

#1 opened over 1 year ago by

lazyDataScientist

New activity in Noeda/aurelian-alpha0.1-70b-rope8-32K-GGUF over 1 year ago

GGUF parameters suggestion

#1 opened over 1 year ago by

lazyDataScientist

New activity in jondurbin/airoboros-l2-70b-3.1.2 over 1 year ago

Space after [/INST]

#2 opened over 1 year ago by