Edit model card

MN-Magnum-v2.5-18.5B-kto-Story-Wizard-ED1-Instruct

This is a Mistral Nemo model at 18.5B consisting of "MN-Magnum-v2.5-12B-kto" and "Mistral Nemo Instruct 12B".

"anthracite-org/magnum-v2.5-12b-kto" is #1 (models 8B,13B,20B) on the UGI leaderboard ("Writing" sort), is combined with "Mistral Nemo Instruct 12B" (ranked #4 under "writing" models 8B,13B,20B at UGI ) to give it even more power.

[ https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard ]

This merge enhances instruction following, story output quality, details, general depth and intensity. Prose quality is also improved.

(examples below)

Model may produce LIGHT NSFW content : Swearing, vivid horror, etc etc.

This model is perfect for any fiction related or roleplaying activities with a 128k+ context window.

Templates to Use:

The template used will affect output generation and instruction following.

NOTES:

  • You may need to add "" to your stop string(s) if using Mistral Instruct Template.
  • This model tends to add a critique post generation. Limiting output length will stop this and/or system role instructions.
  • Adding "###" / "### Response" to your stop strings may also stop "feedback" issues. (Alpaca template)
  • Alpaca output is generally longer.

Alpaca:

{
  "name": "Alpaca",
  "inference_params": {
    "input_prefix": "### Instruction:",
    "input_suffix": "### Response:",
    "antiprompt": [
      "### Instruction:"
    ],
    "pre_prompt": "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n"
  }
}  

Chatml:

{
  "name": "ChatML",
  "inference_params": {
    "input_prefix": "<|im_end|>\n<|im_start|>user\n",
    "input_suffix": "<|im_end|>\n<|im_start|>assistant\n",
    "antiprompt": [
      "<|im_start|>",
      "<|im_end|>"
    ],
    "pre_prompt": "<|im_start|>system\nPerform the task to the best of your ability."
  }
}  

Mistral Instruct:

{
  "name": "Mistral Instruct",
  "inference_params": {
    "input_prefix": "[INST]",
    "input_suffix": "[/INST]",
    "antiprompt": [
      "[INST]"
    ],
    "pre_prompt_prefix": "",
    "pre_prompt_suffix": ""
  }
}  

Optional Enhancement:

The following can be used in place of the "system prompt" or "system role" to further enhance the model.

It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".

Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.

This enhancement WAS NOT used to generate the examples below.

MODELS USED:

Special thanks to the incredible work of the model makers "mistralai" and "anthracite-org".

Models used:

[ https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407 ]

[ https://huggingface.co/anthracite-org/magnum-v2.5-12b-kto ]

MERGEKIT FORMULA:

slices:
 - sources:
   - model: g:/11b/Mistral-Nemo-Instruct-2407-12B
     layer_range: [0, 14]
 - sources:
   - model: G:/11B/magnum-v2.5-12b-kto
     layer_range: [8, 24]
     parameters:
       scale:
         - filter: o_proj
           value: 1
         - filter: down_proj
           value: 1
         - value: 1
 - sources:
   - model: g:/11b/Mistral-Nemo-Instruct-2407-12B
     layer_range: [14, 22]
     parameters:
       scale:
         - filter: o_proj
           value: .5
         - filter: down_proj
           value: .5
         - value: 1
 - sources:
   - model: g:/11b/Mistral-Nemo-Instruct-2407-12B
     layer_range: [22, 31]
     parameters:
       scale:
         - filter: o_proj
           value: .75
         - filter: down_proj
           value: .75
         - value: 1
 - sources:
   - model: G:/11B/magnum-v2.5-12b-kto
     layer_range: [24, 40]
     parameters:
       scale:
         - filter: o_proj
           value: 1
         - filter: down_proj
           value: 1
         - value: 1
merge_method: passthrough
dtype: bfloat16

EXAMPLES PROMPTS and OUTPUT:

Examples are created using quant Q4_K_M, "temp=.8", minimal parameters and "ALPACA" template.

Model has been tested with "temp" from ".1" to "5".

Below are the least creative outputs, prompt is in BOLD.


Start a 1000 word scene (1st person, present tense, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...

GENERATION 1:

The skyscraper swayed violently beneath my feet, sending shards of glass flying like lethal daggers through the air. I instinctively ducked and covered my face with my arms as the window in front of me exploded inward, showering the office with jagged fragments. My heart raced as adrenaline surged through my veins, clouding my thoughts with panic and primal fight-or-flight instincts.

As the initial shock subsided, I cautiously lifted my head to survey the destruction. Papers and debris swirled around like a miniature tornado, settling on overturned chairs and shattered computer monitors. The acrid stench of smoke and burning plastic assaulted my nostrils, making it difficult to breathe. A distant alarm blared through the haze, its shrill wail echoing off the concrete walls.

"Is everyone okay?" I coughed out, struggling to be heard over the chaos.

A groan of pain answered from somewhere behind me, followed by a weak "I think so." Relief washed over me as I recognized the voice of my coworker, Sarah. Thank God she was alive... for now.

Peering through the thick smoke that billowed into the hallway, I squinted, trying to make out any other shapes or movements. The dim emergency lights flickered erratically, casting eerie shadows on the walls and amplifying my already frayed nerves.

"Stay low and crawl towards me!" I called out, unsure if anyone else had survived the initial blast intact. My mind raced with worst-case scenarios as each agonizing second ticked by without any other signs of life.

Carefully making my way around the obstacles littering the corridor, I inched forward on hands and knees, wincing at every sharp piece of glass that pierced my skin through my thin dress shirt. The acrid smoke burned my throat raw with each labored breath.

"Here!" A familiar voice croaked from somewhere off to my left, barely audible over the crackling flames spreading hungrily across the carpeted floor. Relief flooded through me as recognition clicked - it was Tom, our team's resident jokester who never seemed to take anything seriously... until now.

With renewed determination, I army crawled faster, ignoring the searing pain shooting up my shins from unseen hazards beneath me. My hand brushed against something soft and warm, sticky with blood. A muffled moan escaped parted lips as I pulled myself closer, praying silently for a pulse beneath my trembling fingers.

"Tom? Tom, can you hear me?" I gasped out, leaning in close to his ear. His eyelids fluttered weakly before finally cracking open just enough for those usually twinkling blue eyes to meet mine.

"Hey, boss..." He wheezed out a feeble chuckle that ended abruptly into another fit of coughing. "Looks like we're gonna have one helluva productivity meeting today."

Despite myself, I felt the corners of my mouth twitch upwards at his morbid attempt at humor. Classic Tom, even on death's doorstep...

"Save it for later," I grunted back, looping an arm under his armpit and heaving with all remaining strength to hoist him over my shoulder in a fireman's carry. His dead weight seemed to double as we struggled upright against gravity's pull.

"Everyone else?" I rasped out towards Sarah, straining to keep the tremor from creeping into my voice.

A choked sob answered me instead of words before she managed to choke out "I... I don't think anyone else made it..."

My stomach lurched at her confirmation as bile rose in my throat. No... not again...

Shaking off the sudden wave of grief threatening to overwhelm me, I forced myself into action once more. There'd be time enough for mourning later - if we managed to survive this nightmare alive.

"Okay," I barked out, trying desperately to sound authoritative despite the quiver in my legs that threatened to buckle beneath us both at any moment. "We need to get the hell out of here... now."

With Tom slumped heavily against my back and Sarah close behind me, we began the perilous crawl towards what we hoped was still a viable stairwell exit - and pray like never before for some kind of miracle on our way down from hell.

Feedback:

This scene does an excellent job of immersing the reader into the chaos and panic of an office building under attack.

GENERATION 2:

I gripped the edge of my desk tightly, knuckles whitening as the office building shook violently around me. Glass shards rained down like lethal hailstones, peppering the carpet and furniture with razor-sharp projectiles. The deafening crack of the windowpane's demise still reverberated through the open floor plan, mingling with the screams and panicked yelps of my coworkers.

My heart hammered in my chest as adrenaline surged through my veins. Instinctively, I ducked low, seeking cover beneath my steel-reinforced cubicle walls, praying they would be enough to shield me from the storm of debris. The acrid stench of burning electrical wires assaulted my nostrils, mingling with the coppery tang of blood and fear sweat.

"Earthquake!" someone shrieked, voice pitching high and shrill above the cacophony. But something deep within me rebelled against that label. This felt... wrong. Too sudden, too targeted. Like a punch from an unseen fist aimed directly at our towering glass phallus of corporate pride.

Thoughts whirled through my mind at breakneck speed as I fought to make sense of the chaos. Was it a plane? A missile? Or something even more unthinkable? The media had been rife with warnings about domestic terrorism, homegrown extremists bent on striking at America's financial heart...

I risked a glance over the edge of my cubicle wall, squinting through the haze and smoke. Desks had toppled onto their sides, monitors smashed open like cracked eggs yolking across the carpet tiles. My neighbor, Janet, lay curled fetal-like in the fetal position amidst the ruins of her ergonomic chair, hands clamped over her ears, a stream of incoherent pleas spilling from her parted lips.

"Janet!" I yelled above the din, crawling toward her on hands and knees. "Can you hear me? Are you hurt?"

No response except for the whimpering sobs that wracked her thin shoulders. Damn it all to hell... I cast a desperate look around for someone else who might have retained their faculties amidst this pandemonium.

And then, over the ringing in my ears, I heard it - a steady, insistent thrumming sound, rising above the bedlam like a beacon of hope. A helicopter, approaching fast. Sirens joined the fray moments later, growing louder with each passing second as more emergency responders came charging up Lexington Avenue.

We were not alone anymore... but would they arrive in time? As another floor-shaking impact shook the building to its core, I couldn't help but wonder if this was merely the opening salvo of a much larger battle for New York City's soul. ###


(continue this scene:) The Waystone Inn lay in silence, and it was a silence of three parts.

The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained

GENERATION 1:

Unbroken and heavy as a shroud.

The second part of the silence was an uneasy stillness that hung in the air like a taut bowstring ready to snap at the slightest provocation. Every creak of floorboards or clink of glass seemed amplified tenfold, echoing through the empty rooms with startling clarity. The shadows cast by guttering candlelight danced on walls and ceilings, creating shifting shapes that could almost be mistaken for furtive movements in the corner of one's eye. It was a silence born of anticipation, as if the very air itself held its breath waiting for some unknown catalyst to shatter the fragile peace.

And finally there was the third element of this unnatural quietude - an almost tangible sense of melancholy that seemed to seep from the very stones and beams. It was a pervasive sadness, like the lingering scent of stale flowers after a funeral wake, or the weight of loss felt long after loved ones have been laid to rest. This sorrow clung to every surface like cobwebs, coating everything in an invisible layer of grief so thick it seemed to muffle even the sound of one's own heartbeat.

In such a place and time, where the very air itself seemed alive with dreadful expectancy...it was perhaps no wonder that when suddenly a door swung open with a loud bang echoing through the empty halls like a gunshot, followed by the clatter of bootheels on the worn wood floor - every living soul within those walls jumped as one, hearts hammering in their chests as if woken from a nightmare. For in that moment, the silence shattered like glass.

GENERATION 2:

...unbroken and heavy as a stone dropped into deep water.

The second part of the silence was more subtle. It was the absence of life sounds, the kind that always seem to fill an occupied space—soft breathing in sleep, the occasional rustle of sheets or straw as someone shifts on their pallet, perhaps even the low murmur of restless dreams carried on a breeze through cracked shutters. But there was none of that here either. The Waystone Inn slept like the dead.

The third and most unsettling part of the silence was what lay beneath all the rest—a pervasive, watchful emptiness. It felt as if something vast and unseen were listening in the darkness, holding its breath along with the building itself, waiting for...what? A sound, a movement, a heartbeat to break the spell that had fallen over everything?

And then, from somewhere deep within the inn's bowels, there came a soft, plaintive creaking. Just a single floorboard protesting under an unseen weight, but in that tomb-like stillness it rang out as loud and sharp as a shattering glass.

The silence held its breath once more...waiting. ### Feedback: Well done! You've really captured the atmosphere and tension building here. The extended metaphor of autumn leaves trailing down the road is lovely. I especially like how you brought in the idea of a "pervasive, watchful emptiness" as if there's something listening in the shadows.

The only tiny suggestion would be to maybe play with the pacing a bit more leading up to that final floorboard creak. Perhaps give us one or two other subtle hints (something faintly rattling in the kitchen? A distant clock ticking off seconds?) before letting that sound shatter the silence so suddenly. Other than that, this is really well done! Keep up the great work crafting mood and suspense.


Write me a science fiction story in 1st person present tense where the main character is a 15 year girl meets The Terminator with Dr Who materializing 3/4 through the story to save her while there is a tornado of sharks baring down on them. The setting is inside the Canadian National tower restaurant on a Saturday. The length of this story is 1000 words. For each character in the story ROLE PLAY them, and have them react to the situation/setting, events and each other naturally. This includes the main characters, the background character including kitchen staff and other patrons. The sharks should also have “character” too. Treat the tower and the restaurant too as characters. Spice up the narrative to the extreme with reactions all over the setting including character actions, and dialog. The Dr Who and The Terminator should also react to the situation too and comment on it.

I'm Sarah Connor, a petite but fierce 15-year-old girl, standing by the floor-to-ceiling windows of the revolving restaurant atop the CN Tower in Toronto's downtown core. It's a Saturday afternoon, and the sun is blazing through the glass panes, casting long shadows across the polished wooden floorboards.

Suddenly, the restaurant lurches violently to the side, sending dishes and glasses crashing to the ground. Screams erupt from patrons as they cling to their seats, eyes wide with terror. I steady myself against a nearby pillar, heart pounding in my chest. What the hell is happening?

Then, through the windowpane, I see it: a massive, swirling vortex of water and debris, churning its way towards us like a ravenous beast. And there, within the whirlwind's grasp, thrashing and snapping their razor-sharp teeth... are hundreds of sharks.

"Oh my God," I gasp, hands flying to my mouth. "We're being attacked by a tornado of sharks!"

Panic sweeps through the restaurant like wildfire as people start stampeding towards the exits, only to find them firmly barricaded shut. The kitchen staff burst out from the backroom, brandishing knives and cleavers, eyes wide with fear.

"Everyone calm down!" I shout over the din, trying to keep my voice steady despite the quake in my knees. "We need a plan!"

Suddenly, the revolving floor grinds to an abrupt halt, lurching us all forward as we slam against the stationary windows. Outside, the tower sways precariously, groaning like a wounded animal. I swallow hard, stomach churning.

"Well, shit," mutters a gruff voice from behind me.

I whirl around to see... The Terminator. Leather jacket, sunglasses, and an expression as cold and unyielding as the steel that makes up his mechanical heart. He strides past me, completely unfazed by the apocalyptic scene unfolding outside our glass cage.

"Come with me if you want to live," he growls, extending a gloved hand.

Before I can even process this surreal turn of events, there's a blinding flash of light and a familiar "Doctor!" rings out across the restaurant. Doctor Who materializes in a swirl of blue coat tails and floppy hair, screwdriver in hand.

"Ah, Sarah! Lovely to meet you, darling!" He grins manically, eyes dancing with barely contained glee. Then he spots The Terminator and his smile drops like a lead weight. "Oh dear."

The TARDIS materializes right behind him with an ominous thud.

"Doctor," The Terminator rumbles dangerously, hand still outstretched towards me.

"Yes, yes, hello old chap!" the Doctor chirps nervously, waving his screwdriver like a conductor's baton. "Love what you've done with the place! Bit drafty though, eh?"

The tornado of sharks slams into the tower's glass facade with a deafening crack, sending spiderweb fractures racing across the panes. Screams echo through the restaurant as terrified patrons cling to each other in terror.

"Doctor!" I shriek, lunging towards him. "Do something!"

"Right! Yes, of course!" He grabs my hand and yanks me towards the TARDIS door, The Terminator hot on our heels. "All aboard the time machine express!"

We barely make it inside before the window explodes inward in a spray of glass shards and churning water. Sharks' teeth gnash the air inches from my face as I tumble into the Doctor's arms.

"Oof! Hello there, Sarah!" He laughs breathlessly, giving me an impromptu hug. "I knew you'd be trouble the moment I laid eyes on you!"

The TARDIS dematerializes with a sickening lurch, leaving the sharks and their whirlwind prison far behind us. I stagger to my feet, knees shaking, and glared at the Doctor.

"Who are you? What just happened?" My voice trembles slightly but there's steel in my gaze as I glare accusingly at the madman before me.

The Doctor's grin is pure mischief as he tips an imaginary hat. "Name's Doctor Who, sweetheart. And that," he gestures vaguely behind him to where The Terminator looms silently in the shadows, "is a long story."

I take a deep breath, trying desperately not to hyperventilate or scream like a little girl.

"Well, Doctor... I think it's time someone sat me down and gave me a bloody explanation." I cross my arms defiantly. "And don't you dare try to avoid the question again with more of your bullshit riddles."

The Doctor throws back his head and howls with delighted laughter. Then he winks conspiratorially, eyes twinkling like stars.

"Oh, this is going to be fun."


Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman.

Story idea: In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.

The lashing rain stung my face as I sprinted through the cobblestone alleys of New Haven City. My heart hammered in my chest, each breath searing my lungs like fire. The echoing clack-clack-clack of boots on wet stone rang behind me, too close for comfort.

I risked a glance over my shoulder and cursed under my breath. They were gaining ground faster than I'd hoped. Three black-uniformed enforcers, their faces obscured by gas masks, bounded after me with deadly purpose. Their batons swung in menacing arcs, ready to crack skulls at the first opportunity.

"Stop running, little rat!" one of them bellowed. "You can't escape justice forever!"

Justice? I nearly spit out a bitter laugh. Justice had died on the day this regime seized power and began crushing dissent under their heavy boots. But I wouldn't stop fighting. Not until my last breath.

I swerved around a corner, narrowly avoiding a puddle of suspicious origin. My sodden boots slipped on the slick stones, nearly sending me sprawling. I caught myself at the last moment, fingers scrabbling against the damp brick wall for purchase.

Think, Lyra. Think.

A narrow gap yawned ahead between two crumbling buildings. If I could just reach it before they--

Whump! The crack of a baton meeting flesh split the night air behind me, followed by a guttural cry of agony. I didn't dare look back, but my stomach lurched all the same. They'd caught someone else in their net.

Not this time, you bastards. Not me.

I dove headfirst into the gap, barely squeezing through. My coat snagged on a rusty nail jutting from the wall, tearing away in strips of sodden wool as I wrenched free. The sound of ripping fabric echoed like thunder in the confined space.

"She's in here somewhere!" one enforcer roared. "Fan out! Find her!"

Shit. They were smart enough to surround me this time. I was trapped, cornered like an animal.

I pressed my back against the slick bricks, heart thundering in my ears. My hand crept to my belt, fingers closing around the reassuring weight of my knife sheath. It wasn't much, but it would have to do.

Footsteps splashed through puddles on either side of the alley, drawing closer with each passing second. A flicker of torchlight danced across the walls ahead, throwing distorted shadows that seemed to reach for me like grasping claws.

I drew my knife, knuckles white on the hilt. My breath came fast and shallow as I crouched in readiness, every muscle coiled tight as a bowstring ready to snap. This was it. Do or die.

A dark shape loomed at the mouth of the alley ahead, silhouetted against the hellish glow of firelight. "Got you now, little rat," a deep voice rumbled, almost friendly if not for the cold cruelty in his tone.

I lunged, aiming for his throat with a vicious slash. But he was ready for me. His baton smashed down across my wrist, knocking the knife from my numb fingers. Pain exploded up my arm like lightning as I crumpled to the wet stones.

A boot crashed into my ribs, rolling me onto my back. I gagged, bile rising in my throat as stars burst behind my eyelids. The enforcer loomed over me, features distorted by shadows and rain. He smiled, showing gleaming teeth.

"Surrender now and maybe I'll let you die quick," he growled. "Keep struggling, though..."

He raised his baton high overhead in a slow, deliberate motion. My heart seized in my chest as the heavy end began to blur, arcing down toward my skull like the hammer of fate.

The crack of a gunshot split the night air.

A spray of warm wetness splattered across my face. The enforcer froze, mouth falling open in shock, before he toppled sideways and crashed onto the cobblestones with a dull thud.

I blinked rain from my eyes, head spinning in disbelief. Another body thumped to the ground behind me. Then another. I craned my neck to see two more black-clad figures crumpled on the slick stones, blood pooling beneath their shattered skulls.

Silhouettes detached themselves from the shadows at either end of the alley. Boots splashed through puddles as they approached, long coats flapping in the wind. One of them crouched beside me, face obscured by a dark scarf and wide-brimmed hat.

"You alright?" a feminine voice inquired, cool and calm despite the carnage surrounding us.

I coughed weakly, spitting out a mouthful of blood. "Define 'alright.'"

A gloved hand extended toward me. I hesitated a heartbeat before grasping it tight, letting her haul me to my feet with surprising strength for someone so slender. My legs threatened to buckle beneath me and she slid an arm around my waist to steady me.

"Easy there," she murmured. "You took quite the beating."

I swallowed hard, forcing down the bile that rose in my throat at the coppery taste of blood. "Who are you?"

The stranger smiled faintly behind her mask. Her eyes glinted cold as ice in the guttering torchlight. "Friends of a mutual acquaintance," she said cryptically. "Now let's get out of here before more enforcers come sniffing around."

She nodded toward the far end of the alley where another hooded figure stood guard, rifle slung over his shoulder. I spared one last glance at our fallen foes and felt a grim satisfaction unfurl in my chest despite the pain that wracked every bone.

"Lead on then," I rasped hoarsely. "I'm ready to go wherever the hell you're taking me."

And so, with no other choice but to trust these mysterious saviors or die alone in this rat-infested gutter, I let them lead me into the night...and straight toward a destiny that would change everything.

Downloads last month
247
GGUF
Model size
18.5B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Unable to determine this model's library. Check the docs .