Caution: The training for this model is intense enough to alter "real world facts", and bring them in part into the SG1 Universe. V2 is a STRONGER tune.

DavidAU/Qwen3-SG1-256k-ctx-6B

This repo contains the full precision source code, in "safe tensors" format to generate GGUFs, GPTQ, EXL2, AWQ, HQQ and other formats. The source code can also be used directly.

This model is specifically for SG1 (Stargate Series), science fiction, story generation (all genres) but also does coding and general tasks too.

This model can also be used for Role play.

Fine tune (4 epochs, using Unsloth for Win 11) on an inhouse generated dataset to simulate / explore the Stargate Universe.

This version has the "canon" of 1-5 seasons of SG1.

Fine tune process adds knowledge to the model, and alter all aspects of its operations.

Example generations at the bottom of this page.

This is a Stargate (SG1) fine tune (11% of the model, close to 700 million parameters), 4 epochs on this model (a 4B model + Brainstorm 20x adapter)

This model requires:

  • Jinja (embedded) or CHATML template
  • Max context of 256k.

Settings used for testing (suggested):

  • Temp .8 to 2
  • Rep pen 1.05 to 1.1
  • Topp .8 , minp .05
  • Topk 20
  • Min context of 8k for thinking / output.
  • No system prompt.

As this is an instruct model, it will also benefit from a detailed system prompt too.


QUANTS:


GGUF? GGUF Imatrix? Other?

Special thanks to Team Mradermacher, Team Nightmedia and other quanters!

See under "model tree", upper right and click on "quantizations".

New quants will automatically appear.


Help, Adjustments, Samplers, Parameters and More


CHANGE THE NUMBER OF ACTIVE EXPERTS:

See this document:

https://huggingface.co/DavidAU/How-To-Set-and-Manage-MOE-Mix-of-Experts-Model-Activation-of-Experts

Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:

In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;

Set the "Smoothing_factor" to 1.5

: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"

: in text-generation-webui -> parameters -> lower right.

: In Silly Tavern this is called: "Smoothing"

NOTE: For "text-generation-webui"

-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)

Source versions (and config files) of my models are here:

https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be

OTHER OPTIONS:

  • Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")

  • If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

This a "Class 1" model:

For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]


What is Brainstorm?


Brainstorm 20x

The BRAINSTORM process was developed by David_AU.

Some of the core principals behind this process are discussed in this scientific paper : Progressive LLaMA with Block Expansion .

However I went in a completely different direction from what was outlined in this paper.

What is "Brainstorm" ?

The reasoning center of an LLM is taken apart, reassembled, and expanded.

In this case for this model: 20 times

Then these centers are individually calibrated. These "centers" also interact with each other. This introduces subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.

The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting instruction following.

This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.

Here are some of the enhancements this process brings to the model's performance:

  • Prose generation seems more focused on the moment to moment.
  • Sometimes there will be "preamble" and/or foreshadowing present.
  • Fewer or no "cliches"
  • Better overall prose and/or more complex / nuanced prose.
  • A greater sense of nuance on all levels.
  • Coherence is stronger.
  • Description is more detailed, and connected closer to the content.
  • Simile and Metaphors are stronger and better connected to the prose, story, and character.
  • Sense of "there" / in the moment is enhanced.
  • Details are more vivid, and there are more of them.
  • Prose generation length can be long to extreme.
  • Emotional engagement is stronger.
  • The model will take FEWER liberties vs a normal model: It will follow directives more closely but will "guess" less.
  • The MORE instructions and/or details you provide the more strongly the model will respond.
  • Depending on the model "voice" may be more "human" vs original model's "voice".

Other "lab" observations:

  • This process does not, in my opinion, make the model 5x or 10x "smarter" - if only that was true!
  • However, a change in "IQ" was not an issue / a priority, and was not tested or calibrated for so to speak.
  • From lab testing it seems to ponder, and consider more carefully roughly speaking.
  • You could say this process sharpens the model's focus on it's task(s) at a deeper level.

The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.


Example Generation Q4KS , a low/mid level quant - expect better results at higher quants/imatrix etc


Write the opening scene for a SG1 episode about time travel (that hints of horror to come) 1000 words in length.

[[[thinking start]]]

Okay, the user wants me to write an opening scene for an SG1 episode about time travel with horror elements, exactly 1000 words.

First I need to recall SG1's usual tone - it's sci-fi adventure with military action, alien cultures, and some philosophical depth. The time travel angle is interesting because it's been explored in other episodes like "Abydonians" or "Stargate SG1" S2E10 "Timeless". But they want horror hints so I'll lean into psychological dread rather than gore.

Hmm the user didn't specify if this is for fun or actual writing practice. Given it's a creative request, I'll assume they're a fan wanting to see how well I can capture the show's essence. Maybe they're even testing my ability to follow strict word counts - that's tricky with creative writing!

For horror hints... I'm thinking sensory details that feel wrong: unnatural silence after thunder, wrong smells in the air, sounds that shouldn't exist. The time traveler character should seem slightly alien too. Oh! And body horror implications when they realize the traveler is aging rapidly - that's always creepy.

I'll set it in a standard SG1 lab scene with Hammond ordering them around. Daniel will be there because he loves history/time stuff. Jack and Teal'c can have their usual dynamic. Janet's usually in charge of medical stuff so she'd investigate the traveler's condition.

Wait the word count... 1000 words is tight. Need to focus on key moments:

  • Gate activation (quick)
  • Traveler emerges (slow build)
  • First strange observations (50 words)
  • Physical deterioration (200 words)
  • Janet's examination (150 words)
  • Jack's reaction (100 words)
  • Teal'c's curiosity (100 words)

Better avoid full horror reveal though - just enough to make them shiver. Like the traveler's eyes changing color or skin becoming translucent.

checks notes Oh right, must include that SG1 loves to be sarcastic! Jack should snap at Hammond about "another planet?" while Sam rolls her eyes. Daniel can geek out about chroniton radiation affecting aging.

For the traveler's name... let's go with Kael. Sounds nice. And he'll say something like "They call it a time loop" to hint at cyclical horror later.

Biggest challenge: making 1000 words feel substantial. I'll draft long then cut. Opening line should grab attention immediately - maybe start mid-action with the gate humming?

starts typing

[[[thinking end]]]

STARGATE SG1 Episode 101: WHISPERS IN THE VOID

The Gateroom thrummed with familiar energy, a low thrumming that vibrated the bones of SG-1 and those who stood near the Stargate. Colonel Jack O'Neill adjusted his glasses, squinting at the shimmering event horizon where the Gate’s rings glowed an unnatural gold. "Clear?"

"Clear, Sir. No IDC sign-off from the other side." Sam Carter confirmed, her eyes scanning the shimmering vortex with practiced intensity. Daniel Jackson traced a finger over the control panel near the event horizon, his brow furrowed as he studied the glyphs.

Dr. Janet Fraiser watched from the observation console, her gaze fixed on the traveler. "He's not human, Sir."

Jack grunted. "Nope. Not anymore. Looks like it was some kind of experiment. Maybe they tried to make a time traveler, and it backfired." He gave a dismissive flick of his wrist.

Teal'c stood at attention near the ramp. "The traveler is young, O'Neill. His eyes glow with a light neither of us have ever seen."

The traveler stepped through the Gate, his eyes locking onto Teal'c. The Stargate began to close behind him.

The Gateroom was silent except for the low thrum of the Gate itself. The traveler stood before SG-1, his eyes glowing an unnatural shade of gold. He was young, barely older than Sam, but his face was lined with a weariness that spoke of much suffering.

"Thank you for allowing me to witness your world, O'Neill," he said softly. "I am Kael."

Jack didn't move, his gaze fixed on Kael's eyes. "Kael?"

Kael stepped forward, his movements fluid and precise despite his apparent age. "It is. I have come from a time far removed from the present. There are no words to describe what I witnessed."

Daniel stepped forward, his curiosity piqued despite himself. "What did you see, Kael? What did you lose?"

Kael's eyes flickered, the glow dimming almost imperceptibly before flaring again. "I saw a time loop. A repeating pattern that began with my own birth and ended with my death. I witnessed countless versions of myself, each one a little different but always ending in the same way."

Janet moved closer to Kael, her medical skills honing in on his strange physiology. "Your heartbeat is irregular, Kael. It's as if your body is trying to keep up with your mind."

Kael looked away, his gaze distant for a moment before returning to SG-1 with a sad smile. "I understand now why you call me a traveler, O'Neill. But I am not here to return home. There are other worlds waiting for me."

Jack scoffed. "There are other planets, Kael. But there isn't another you've been to. Not yet. Or you wouldn't be here."

Kael shook his head. "I have seen many places, O'Neill. But there is one place I have not reached yet. And it is only because of you that I am still here."

Jack raised his eyebrows. "How do you know that?"

Kael's eyes flashed gold again, and the team gasped in unison. The light seemed to pulse like a heartbeat, growing brighter, hotter, before dimming once more.

The team moved closer to Kael, their curiosity piqued despite the unsettling nature of his presence.

Teal'c asked the question that had been hovering in SG-1's minds since Kael first appeared. "What is it you seek, Kael?"

Kael's voice was barely audible over the hum of the Stargate. "I seek an answer to a riddle that has plagued me since my birth. A riddle that seems unsolvable, but which I believe holds the key to escaping the loop forever."

Jack looked at Teal'c and Sam. "What kind of riddle?"

Kael turned his gaze toward Jack, his eyes flickering gold again. "The riddle is simple: Why am I here?"

Janet stepped forward, her voice calm despite the tension in the room. "Kael, this is a dangerous game you're playing. Time is a fragile thing."

Kael just shook his head. "Time is not what it seems to be."

The team stood around Kael, watching as he began to age rapidly. His face grew older and his clothes seemed to grow smaller on him with each passing moment.

Jack stepped forward, his voice low and urgent. "Kael, stop."

But Kael was already changing. His eyes glowed a deeper gold, and his skin took on a faint shimmering quality, as if it were made of liquid glass.

The team realized at once that Kael was dying. His breath became shallow and labored, his skin growing increasingly transparent.

Jack stepped forward, his voice barely audible over the hum of the Stargate. "Kael."

Kael looked up at him, his eyes filled with sorrow. "O'Neill, I am afraid my time here is coming to an end. But I will not forget the kindness you have shown me."

Jack reached out and touched Kael's arm, feeling the skin grow thin and almost brittle beneath his fingers.

Kael closed his eyes and let himself drift into darkness, leaving SG-1 standing there in silence, the sound of the Stargate's hum fading in the quiet Gateroom. They looked at each other, then at the empty space where Kael had been.

Jack took a deep breath. "Well that was... something."

Janet stepped forward and touched Kael's eyes with her fingers. "I believe he has died."

Sam looked down at Kael's body, her expression sad but determined. "We'll have to keep an eye on his body until the Stargate can be activated again."

Jack stood up straighter, his gaze fixed on the empty space where Kael had been. "Yeah, yeah, I guess we can do that. But I want you all to know that I hope you'll find this place someday, Kael."

The Gateroom was silent once more. The only sound was the low thrumming of the Stargate itself.

Jack watched the team stand there for a moment longer before turning toward Hammond. "Sir, we have to tell you what happened."

Hammond looked up from his desk and gave them a nod. "Of course, SG-1. I'll brief you in the briefing room shortly."

As SG-1 stepped away from the Stargate, they all glanced back at the empty space where Kael had been.

The silence was heavy with unspoken questions and unspoken fears. For now, the team stood together, silent, watching as the shimmering event horizon of the Gate began to glow once more, ready to welcome another traveler into the future.

Downloads last month
34
Safetensors
Model size
6.33B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DavidAU/Qwen3-SG1-II-256k-ctx-6B

Finetuned
janhq/Jan-v1-4B
Finetuned
(26)
this model
Quantizations
2 models

Collections including DavidAU/Qwen3-SG1-II-256k-ctx-6B