Lynx-TinySync-0.6B-GGUF

Lynx-TinySync-0.6B is a lightweight, high-performance model designed for mathematical reasoning, code generation, and general-purpose inference. Built on a custom modular dataset and powered by an efficient architecture, it excels in delivering structured, accurate outputs even in mid-resource environments. Despite its compact 0.6B parameter size, it demonstrates remarkable proficiency in math, code, and technical language understanding.

Model File

File Name	Size	Format
Lynx-TinySync-0.6B.BF16.gguf	1.2 GB	BF16
Lynx-TinySync-0.6B.F16.gguf	1.2 GB	F16
Lynx-TinySync-0.6B.F32.gguf	2.39 GB	F32
Lynx-TinySync-0.6B.Q4_K_M.gguf	397 MB	Q4_K_M
Lynx-TinySync-0.6B.Q5_K_M.gguf	444 MB	Q5_K_M
Lynx-TinySync-0.6B.Q8_0.gguf	639 MB	Q8_0
.gitattributes	1.98 kB	-
README.md	220 B	-
config.json	31 B	JSON

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):