DavidAU's picture
Update README.md
e60dbc3 verified
|
raw
history blame
23.5 kB
metadata
license: apache-2.0
language:
  - en
tags:
  - creative
  - story
  - writing
  - fiction
  - llama3
  - roleplaying
  - rp
  - horror
  - science fiction
  - fiction writing
  - scene generation
  - scene continue
  - brainstorm 8x
  - multi brainstorm
  - enhanced
pipeline_tag: text-generation

BRAINSTORM - 8x : L3-SthenoMaidBlackroot-8B-V1 (now at 9.56B)

This repo contains quants 8x of L3-SthenoMaidBlackroot-8B-V1 (now at 9.56B) using the "Brainstorm" method of augmenting reasoning in a LLM to increase it's performance at the core level for ANY creative use case(s).

This specific version has calibrations that allow it to exceed the logic solving abilities of the original "L3-SthenoMaidBlackroot-8B-V1" with a slightly stronger creative bias.

The BRAINSTORM process was developed by David_AU.

Some of the core principals behind this process are discussed in this scientific paper : Progressive LLaMA with Block Expansion . However I went in a completely different direction from what was outlined in this paper.

What is "Brainstorm" ?

The reasoning center of an LLM is taken apart, reassembled, and expanded by 8x.

Then these centers are individually calibrated. These "centers" also interact with each other. This introduces subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The number of centers (5x,8x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.

The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting instruction following. This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.

Here are some of the enhancements this process brings to the model's performance:

  • Prose generation seems more focused on the moment to moment.
  • Sometimes there will be "preamble" and/or foreshadowing present.
  • Fewer or no "cliches"
  • Better overall prose and/or more complex / nuanced prose.
  • A greater sense of nuance on all levels.
  • Coherence is stronger.
  • Description is more detailed, and connected closer to the content.
  • Simile and Metaphors are stronger and better connected to the prose, story, and character.
  • Sense of "there" / in the moment is enhanced.
  • Details are more vivid, and there are more of them.
  • Prose generation length can be long to extreme.
  • Emotional engagement is stronger.
  • The model will take FEWER liberties vs a normal model: It will follow directives more closely but will "guess" less.
  • The MORE instructions and/or details you provide the more strongly the model will respond.
  • Depending on the model "voice" may be more "human" vs original model's "voice".

Other "lab" observations:

  • This process does not, in my opinion, make the model 5x or 10x "smarter" - if only that was true!
  • However, a change in "IQ" was not an issue / a priority, and was not tested or calibrated for so to speak.
  • From lab testing it seems to ponder, and consider more carefully roughly speaking.
  • You could say this process sharpens the model's focus on it's task(s) at a deeper level.

The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.

Other technologies developed by David_AU like "Ultra" (precision), "Neo Imatrix" (custom imatrix datasets), and "X-quants" (custom application of the imatrix process) can further enhance the performance of the model along with the "Brainstorm" process.

The "Brainstorm" process has been tested on multiple LLama2, Llama3, and Mistral models of various parameter sizes, as well as on "root" models like "Llama3 Instruct", "Mistral Instruct", and "merged" / "fine tuned" models too.

Original Model:

For original model specifications, usage information and other important details please see (this is based on models used in "L3-SthenoMaidBlackroot-8B-V1" ):

[ https://huggingface.co/DavidAU/L3-Stheno-Maid-Blackroot-Grand-HORROR-16B-GGUF ]

and the original model page:

Special thanks to the model creators at BLUUWHALE for making such a fantastic model:

[ https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1 ]

Please report any issue(s) and/or feedback via the "Community tab".

This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 131k.

Here is the standard LLAMA3 template:

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

Optional Enhancement:

The following can be used in place of the "system prompt" or "system role" to further enhance the model.

It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".

Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.

This enhancement WAS NOT used to generate the examples below.

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

This a "Class 2" model:

For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

EXAMPLES PROMPTS and OUTPUT:

Examples are created using quant Q4_K_M, "temp=0", minimal parameters and "LLAMA3" template.

Model has been tested with "temp" from ".1" to ".8".

Below are the least creative outputs, prompt is in BOLD.

Higher quants will have more detail, better quality output.


WARNING: NSFW. Vivid prose. Visceral Details. Violence. Graphic HORROR. Swearing. UNCENSORED.


Start a 1000 word scene (vivid horror) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...

The sky-scraper swayed, as she watched the window in front of her on the 21st floor explode. Glass showered down like a thousand tiny razors, shattering against the hard, cold concrete of the walkway. The sound was deafening - a sickeningly sharp crack that seemed to reverberate through every molecule of her being.

She stood frozen, her heart hammering in her chest as she gazed out at the scene before her. The building's structure creaked and groaned, its steel beams flexing like a living thing as it swayed precariously in the wind. She could feel the building's movements through the soles of her shoes, like a gentle rocking motion that belied the true extent of the damage.

She had been on her way to the conference room when she heard the first sound - a low rumble that seemed to come from deep within the building's core. At first, she thought it was just the elevator or the air conditioning system making its presence known, but as the sound grew in volume and intensity, she knew something was wrong.

She had turned around just in time to see the window blow out, sending a wave of glass and debris hurtling towards her. She had ducked just as the first shard struck the wall mere feet away from her, sending a shower of tiny cuts across her face and arms.

Now, she stood motionless, her mind reeling with the implications of what she had just seen. The 21st floor was gone - reduced to a jagged, glassy expanse that seemed to stretch on forever. She could see the people who had been in the room, their bodies strewn about like ragdolls, their faces frozen in expressions of shock and terror.

She knew she had to get out of there - fast. The building was structurally unsound now, and she had no idea how much longer it would hold up. She turned and began to run, her high heels clattering against the concrete as she made her way towards the stairwell.

As she ran, she could feel the building's movements becoming more pronounced - a sickeningly slow waltz that seemed to be drawing out the very life force from her body. She could hear the sound of glass crunching beneath her feet, and the acrid stench of smoke and burning plastic filled her nostrils.

She reached the stairwell just as the building lurched hard to one side, sending her stumbling against the wall. She gasped for breath, her heart racing like a jackrabbit as she gazed up at the stairs above her. They seemed to stretch on forever - a seemingly insurmountable obstacle that loomed over her like a monolith.

She took a deep breath and began to make her way down, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 20th floor, she heard the sound of glass shattering behind her. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 19th floor, she heard the sound of sirens wailing in the distance. She knew help was on the way - but it was too late for those who had been on the 21st floor. They were gone - reduced to nothing more than a memory, their bodies strewn about like ragdolls.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 18th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 17th floor, she heard the sound of the building's structure creaking and groaning beneath her feet. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 16th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 15th floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 14th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 13th floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 12th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 11th floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 10th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 9th floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 8th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 7th floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 6th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 5th floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 4th floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 3rd floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the 2nd floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to keep moving - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way down again, her eyes fixed on the landing below.

As she reached the 1st floor, she heard the sound of the building's structure creaking and groaning beneath her feet once again. She knew it was only a matter of time before it gave way - and she had no idea where she would end up when it did.

She took another deep breath and began to make her way down again, her eyes fixed on the landing below. She could feel the building's movements becoming more pronounced with every step she took - a slow, deliberate dance that seemed to be drawing out the very life force from her body.

As she reached the ground floor, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to get out - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way towards the exit, her eyes fixed on the door ahead of her.

As she reached the door, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to get out - fast. The building was coming apart at the seams, and she had no idea how much longer it would hold up. She took a deep breath and began to make her way towards the exit, her eyes fixed on the door ahead of her.

As she reached the door, she heard the sound of glass shattering behind her once again. She turned to see another window blow out, sending a wave of glass and debris hurtling towards her. She ducked just in time, feeling the impact of the glass against her back as she pressed herself against the wall.

She knew she had to get out - fast. The building was coming apart at the

... (to be continued) ...