DavidAU commited on
Commit
d591380
·
verified ·
1 Parent(s): 60e7503

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -31,6 +31,11 @@ Re-optimizing quants, found a better mixture. Uploading shortly.
31
  Mixture is strong enough that lower quants can now solve/reasoning and come up with a solution whereas NON-optimized
32
  may not be able to solve or take a lot longer (a lot more tokens!).
33
 
 
 
 
 
 
34
  ---
35
 
36
  Reka's excellent reasoning model with MAXed quants, and NEO Imatrix dataset.
 
31
  Mixture is strong enough that lower quants can now solve/reasoning and come up with a solution whereas NON-optimized
32
  may not be able to solve or take a lot longer (a lot more tokens!).
33
 
34
+ Quick testing shows optimized can:
35
+ - Answer/solve at lower quant.
36
+ - Come up with a better answer/stronger reasoning
37
+ - Use less tokens to "reason" ... up to 50% less.
38
+
39
  ---
40
 
41
  Reka's excellent reasoning model with MAXed quants, and NEO Imatrix dataset.