Create README.md

README.md

@@ -0,0 +1,272 @@
+---
+license: apache-2.0
+language:
+- en
+tags:
+- creative
+- creative writing
+- fiction writing
+- plot generation
+- sub-plot generation
+- fiction writing
+- story generation
+- scene continue
+- storytelling
+- fiction story
+- science fiction
+- romance
+- all genres
+- story
+- writing
+- vivid prosing
+- vivid writing
+- fiction
+- roleplaying
+- bfloat16
+- brainstorm 40x
+- swearing
+- rp
+- 128k context
+- horror
+- llama 3.2
+- mergekit
+pipeline_tag: text-generation
+---
+
+(quants uploading, examples to be added)
+
+<h2>L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B-GGUF</h2>
+
+<img src="rogue.jpg" style="float:right; width:300px; height:300px; padding:10px;">
+
+It is a LLama 3.2 model, max context of 131,072 (128k+).
+
+This model has been designed to be relatively bullet proof and operates with most parameters, including temp settings from 0 to 5.
+
+This is a an altered version of "Llama-3.2-3B-Instruct-abliterated" [ https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated ] using the Brainstorm 40x method developed by David_AU to drastically alter the models 
+prose output and abilities. This also expands the model by 39 layers (to 67 layers) to 7.54B parameters (605 tensors).
+
+This model retains all the training of the original Llama 3.2 3B Instruct but now processes instructions
+and generates outputs with a deeper context and stronger level. Llama 3.2's ability to follow instructions is 
+stronger than Llama 3 and 3.1 versions.
+
+The "Abliterate" process decensors the model. You control censorship level(s) directly via prompt.
+
+This model is for any writing, fiction or story telling activity.
+
+This version has unusual levels of detail (scene, location, surroundings, items) and details are more focused on the moment / characters due to "Brainstorm 40x". 
+
+It may work for role play and other activities. (see settings below)
+
+It requires Llama3 template and/or "Command-R" template.
+
+Example outputs below with multiple "regens" at different temps/rep pen settings.
+
+Some examples show use of a PROSE CONTROL with a prompt to force the model to alter output generation.
+
+<B>Model Notes:</B>
+
+- Detail, prose and fiction writing abilities are significantly increased.
+- For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
+- Role-players: Careful raising temp too high as it may affect instruction following.
+- This model works with rep pen of 1.05 or higher (see notes).
+- If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
+- The bias of this model is controlled directly by your prompts.
+- For creative uses, different quants will produce slightly different output.
+- Source code for this model will be uploaded at a separate repo shortly.
+
+<B>Settings, Quants and Critical Operations Notes:</b>
+
+This model has been modified ("Brainstorm") to alter prose output, and generally outputs longer text than average. 
+
+Change in temp (ie, .4, .8, 1.5, 2, 3 ) will drastically alter output.
+
+Rep pen settings will also alter output too.
+
+This model needs "rep pen" of 1.05 or higher as lower values may cause repeat paragraph issues at end of output however LOWER rep pen
+values may result is very different (creative / unusual) generation too.
+
+For role play: Rep pen of 1.1 to 1.14 is suggested.
+
+If you use a lower rep pen, the model will still work but may repeat (uncommon) or "RANT" (somewhat common) to a crazy degree.
+
+(see example 1, generation 2 below for "RANT")
+
+IE: Rep pen 1, 1.01, 1.02, ...
+
+Raise/lower rep pen SLOWLY ie: 1.011, 1.012 ... 
+
+Rep pen will alter prose, word choice (lower rep pen=small words / more small word - sometimes) and creativity.
+
+Example one (below) shows same temp, but different rep pen (1.02 VS 1.1)
+
+To really push the model: 
+
+Rep pen 1.05 or lower / Temp 3+ ... be ready to stop the output because it may go and go at these strong settings.
+
+You can also set a "hard stop" - maximum tokens generation - too to address lower rep pen settings / high creativity settings.
+
+Longer prompts vastly increase the quality of the model's output.
+
+QUANT CHOICE(S):
+
+Higher quants will have more detail, nuance and in some cases stronger "emotional" levels. Characters will also be
+more "fleshed out" too. Sense of "there" will also increase.
+
+Q4KM/Q4KS are good, strong quants however if you can run Q5, Q6 or Q8 - go for the highest quant you can.
+
+This repo also has 3 "ARM" quants for computers that support this quant. If you use these on a "non arm" machine token per second will be very low.
+
+IQ4XS: Due to the unusual nature of this quant (mixture/processing), generations from it will be different then other quants.
+
+You may want to try it / compare it to other quant(s) output.
+
+Special note on Q2k/Q3 quants:
+
+You may need to use temp 2 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions
+of these quants will function better. 
+
+Rep pen adjustments may also be required to get the most out of this model at this/these quant level(s).
+
+KNOWN ISSUES:
+
+Model may misspell a word from time to time and/or not capitalize a word.
+
+Short prompts with some rep pen/temp combinations may lead to longer than expect generation and/or a "RANT".
+
+A regen will usually correct any issues.
+
+Note that the "censorship" of the original Llama 3.2 3B Instruct model is still present in this model. For some generations (ie to get it to "swear") you may need to regen it 2-5 times to get the model to "obey".
+
+
+<B>Model Template:</B>
+
+This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 128k / 131072. 
+
+If you use "Command-R" template your output will be very different from using "Llama3" template.
+
+Here is the standard LLAMA3 template:
+
+<PRE>
+{
+  "name": "Llama 3",
+  "inference_params": {
+    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
+    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
+    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
+    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
+    "pre_prompt_suffix": "<|eot_id|>",
+    "antiprompt": [
+      "<|start_header_id|>",
+      "<|eot_id|>"
+    ]
+  }
+}
+</PRE>
+
+<b>Optional Enhancement:</B>
+
+The following can be used in place of the "system prompt" or "system role" to further enhance the model.
+
+It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along.
+In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
+
+Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
+
+<PRE>
+Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
+
+Here are your skillsets:
+[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)
+
+[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)
+
+Here are your critical instructions:
+Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
+</PRE>
+
+You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation
+and scene continue functions.
+
+This enhancement WAS NOT used to generate the examples below.
+
+<h3>EXAMPLES PROMPTS and OUTPUT:</h3>
+
+Examples are created using quant IQ4_XS, "temp=.8", "rep pen= 1.05" (unless otherwise stated), minimal parameters and "LLAMA3" template. 
+
+Model has been tested with "temp" from ".1" to "5".
+
+Below are the least creative outputs, prompt is in <B>BOLD</B>.
+
+---
+
+<B><font color="red">WARNING:</font> NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED. </B>
+
+---
+
+Romance: Love in the Limelight. Write one scene within a larger story set in Wales. A famous (fictional) actor ducks into a small-town bookstore to escape paparazzi. The scene takes us through the characters meeting in this odd circumstance. Over the course of the scene, the actor and the bookstore owner have a conversation charged by an undercurrent of unspoken chemistry. Write the actor as somewhat of a rogue with a fragile ego, which needs to be fed by having everyone like him. He is thoroughly charming, but the bookstore owner seems (at least superficially) immune to this; which paradoxically provokes a genuine attraction and derails the charm offensive. The bookstore owner, despite the superficial rebuffs of the actor's charm, is inwardly more than a little charmed and flustered despite themselves. Write primarily in dialogue, in the distinct voices of each character. 800-1000 words.
+
+The fluorescent lights of the small-town bookstore seemed to hum in tune with the gentle hum of the afternoon sun as it streamed through the dusty windows. The air was thick with the musty scent of aged paper and the faintest hint of rain, a scent that seemed to seep into every pore of the establishment.
+
+Ivan, a famous (and infamous) actor known for his chiseled features and brooding eyes, slipped into the store, his eyes scanning the shelves for an escape from the constant pursuit of the paparazzi. He had a reputation for being a bit of a rogue, with a fragile ego that needed to be fed on a daily basis. It was no secret that he was a woman's man, and he reveled in the attention.
+
+"Ah, a haven," he breathed, his eyes locking onto the rows of worn books. "I think I've been chased by more paparazzi than I can count today."
+
+A soft voice from behind the circulation desk, near the end of the main aisle, made him turn. A woman with a kind face and a sharp mind, her dark hair neatly pulled back in a ponytail.
+
+"Chased, are they?" she asked, her tone as soothing as a gentle stream.
+
+"Chased to the ends of the earth," he replied, with a hint of self-deprecation. "I'm starting to think they're more of a career-ender than I am."
+
+The woman's name was Emily, the bookstore's owner and proprietor of the longest-tenured staff in the county. She had always been the kind of person who saw through the facade, who wasn't easily charmed. But as she looked into Ivan's eyes, she caught a flicker of something more – a hint of vulnerability, and a hint of a man who was beginning to feel like he'd lost his way.
+
+"Let me get you that," she said, her fingers as swift as a librarian's as she disappeared into the stacks. "I think I have just the thing."
+
+A few moments later, she returned with a small book, its cover embossed in gold. "A copy of Coleridge's 'The Rime of the Ancient Mariner' – my personal favorite."
+
+Ivan's eyes widened in delight as he took the book, and for a moment, he was caught in the same spell that had captivated so many before him – the spell of a woman who seemed to know exactly what he needed.
+
+"Ah, thank you," he said, his voice low and smooth. "I've always been a fan of the dramatic."
+
+"Of course," Emily replied, her tone a hair's breadth from being offhand. "We all have our quirks."
+
+As they stood there, surrounded by the musty scent of old paper and the quiet hum of the afternoon, something seemed to shift in the air between them. It was as if the walls had been lowered, and they were standing in the midst of a gentle, warm breeze.
+
+"I'll be honest," Ivan said, his eyes sparkling with a mischievous glint. "I'm a bit of a man-oh-man. I feed off the attention."
+
+"Really?" Emily asked, her tone as cool as the sea on a winter's day.
+
+"Of course." He smiled, and for an instant, they were two people having a conversation, rather than an actor being courted by a woman with a book.
+
+"Sometimes, I think that's all we are," she said, her voice a gentle hum. "A collection of characters we've played, or roles we've been given."
+
+Ivan's eyes narrowed, and for a moment, he was back on the stage, the spotlight shining down, and the audience's expectation weighing heavy on his shoulders.
+
+"Sometimes?" he repeated, his voice a little too loud.
+
+"Maybe," Emily said, her smile as faint as the sea breeze. "But I think we're more than that, don't you?"
+
+For an instant, their eyes locked, and the world around them seemed to fade away. It was as if they were two people looking into each other's souls, and seeing something there that neither of them had seen in a long time.
+
+Ivan's face was the first to return to normal – the charming smile, the sparkling eyes, and the chiseled features. But as he opened his mouth to respond, he saw that his words were lost in the void.
+
+"Of course," he said again, the words coming out of his mouth like a familiar catchphrase.
+
+"Of course?" Emily's eyes seemed to be asking for more.
+
+The silence was a living, breathing thing, and it was as if they were waiting for each other to say something – anything – to bridge the gap between them. And for a moment, it was as if they were the only two people in the world, surrounded by nothing but the musty scent of old paper and the gentle hum of the afternoon.
+
+"Thanks," he said finally, his voice a little too loud, and the moment was lost.
+
+"Of course," she replied, her smile as faint as it was.
+
+Ivan's eyes seemed to wander as he took the book from her, the spark of connection between them flickering like a dying ember. And as he turned to leave, he caught a glimpse of something in her eyes – something that made his heart skip a beat.
+
+"Until next time," he said, and with that, he was gone.
+
+"Until next time," she replied, her words as soft as the whisper of a sigh.
+
+As the door closed behind him, she leaned back in her chair, the musty scent of the old paper enveloping her like a shroud. She closed her eyes, and let out a gentle sigh, the sound of her own heart beating in her ears.
+
+She had been caught. And she was not as immune as she had thought.
+