|
--- |
|
language: |
|
- en |
|
license: cc-by-nc-4.0 |
|
library_name: transformers |
|
tags: |
|
- mergekit |
|
- merge |
|
base_model: |
|
- AetherResearch/Cerebrum-1.0-7b |
|
- SanjiWatsuki/Kunoichi-DPO-v2-7B |
|
- macadeliccc/WestLake-7B-v2-laser-truthy-dpo |
|
--- |
|
<style> |
|
@import url(https://fonts.googleapis.com/css2?family=Press+Start+2P&display=swap); |
|
|
|
body { |
|
font-family: 'Courier New', monospace; |
|
background-color: #000; |
|
color: #0f0; |
|
margin: 0; |
|
padding: 20px; |
|
line-height: 1.5 |
|
} |
|
|
|
.terminal { |
|
background-color: #000; |
|
padding: 20px; |
|
border: 3px solid #0f0; |
|
max-width: 800px; |
|
margin: 20px auto; |
|
box-shadow: 0 0 15px #0f0; |
|
position: relative |
|
} |
|
|
|
.control-box { |
|
position: absolute; |
|
top: 10px; |
|
right: 10px; |
|
display: flex |
|
} |
|
|
|
.control-box span { |
|
width: 12px; |
|
height: 12px; |
|
border: 1px solid #0f0; |
|
margin-left: 5px; |
|
display: inline-block |
|
} |
|
|
|
.ascii-art-container { |
|
text-align: center; |
|
margin-bottom: 20px |
|
} |
|
|
|
.ascii-art { |
|
font-family: 'Press Start 2P', monospace; |
|
white-space: pre; |
|
color: #0f0; |
|
text-align: center; |
|
background-color: transparent; |
|
font-weight: 800; |
|
text-shadow: 0 0 12px #0f0; |
|
filter: blur(.755px); |
|
font-size: 11px |
|
} |
|
|
|
header { |
|
position: relative; |
|
text-align: center; |
|
width: 100%; |
|
display: inline-block; |
|
overflow: hidden; |
|
margin-bottom: 20px |
|
} |
|
|
|
header img { |
|
width: 100%; |
|
height: auto; |
|
position: relative; |
|
z-index: 1 |
|
} |
|
|
|
.header-background { |
|
position: absolute; |
|
top: 0; |
|
left: 0; |
|
width: 100%; |
|
height: 100%; |
|
background-image: url(https://i.gifer.com/QzRn.gif); |
|
background-repeat: no-repeat; |
|
background-size: 100% 100%; |
|
background-position: center; |
|
opacity: .25; |
|
z-index: 2 |
|
} |
|
|
|
.irc-chat { |
|
background-color: #000; |
|
color: #0f0; |
|
font-family: Consolas, Monaco, 'Courier New', monospace; |
|
font-size: 14px; |
|
padding: 10px; |
|
margin: 20px auto; |
|
max-width: 800px; |
|
border-left: 3px solid #0f0; |
|
line-height: 1.1 |
|
} |
|
|
|
section { |
|
margin-bottom: 30px |
|
} |
|
|
|
h2, |
|
h3 { |
|
color: #0f0; |
|
font-size: 20px; |
|
margin-bottom: 10px |
|
} |
|
|
|
h2::before, |
|
h3::before { |
|
content: "$ "; |
|
color: #0f0 |
|
} |
|
|
|
.model-list { |
|
display: flex; |
|
flex-direction: column; |
|
margin-bottom: 20px; |
|
} |
|
|
|
.model-item { |
|
background-color: #000; |
|
border: 2px solid #0f0; |
|
color: #0f0; |
|
padding: 15px; |
|
border-radius: 5px; |
|
text-decoration: none; |
|
margin-bottom: 15px; |
|
transition: transform 0.3s ease, box-shadow 0.3s ease; |
|
} |
|
|
|
.model-item:hover { |
|
transform: translateY(-3px); |
|
box-shadow: 0 3px 10px rgba(0, 255, 0, 0.4); |
|
} |
|
|
|
.model-header { |
|
display: flex; |
|
align-items: center; |
|
justify-content: space-between; |
|
margin-bottom: 8px; |
|
} |
|
|
|
.model-header a { |
|
color: #0f0; |
|
text-decoration: none; |
|
font-weight: bold; |
|
font-size: 16px; |
|
} |
|
|
|
.model-header a:hover { |
|
color: #9dfc03; |
|
text-decoration: underline; |
|
} |
|
|
|
.model-header a:focus { |
|
outline: 2px solid #9dfc03; |
|
outline-offset: 2px; |
|
} |
|
|
|
.emoji { |
|
font-size: 38px; |
|
margin-left: 15px; |
|
} |
|
|
|
.model-description { |
|
color: #0f0; |
|
font-size: 14px; |
|
line-height: 1.4; |
|
margin-left: 15px; |
|
} |
|
|
|
.terminal-input { |
|
background-color: #000; |
|
padding: 15px; |
|
border: 2px solid #0f0; |
|
margin-bottom: 20px |
|
} |
|
|
|
.prompt { |
|
color: #0f0; |
|
font-family: 'Courier New', monospace; |
|
margin-bottom: 10px |
|
} |
|
|
|
.prompt-symbol { |
|
font-weight: 700 |
|
} |
|
|
|
.parameter-display pre { |
|
background-color: #000; |
|
color: #0f0; |
|
padding: 8px; |
|
border: 1px dashed #0f0; |
|
margin-bottom: 10px |
|
} |
|
|
|
.tip { |
|
color: #0f0; |
|
font-size: 16px; |
|
margin-top: 10px |
|
} |
|
|
|
.terminal-log { |
|
background-color: #000; |
|
padding: 10px; |
|
border: 2px dashed #0f0; |
|
text-align: left; |
|
font-family: monospace; |
|
white-space: pre-wrap; |
|
margin-bottom: 10px |
|
} |
|
|
|
.timestamp { |
|
color: #0f0; |
|
margin-right: 10px |
|
} |
|
</style> |
|
<div class=terminal> |
|
<div class=control-box> |
|
<span></span> |
|
<span></span> |
|
<span></span> |
|
</div> |
|
<div class=ascii-art-container> |
|
<pre class=ascii-art> |
|
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
|
ββββββββββββββββββββ ββββββββββββββββββββ ββββββββββββββββββββββββββ |
|
ββββββββββββββββββββ βββββββββββββββββββ ββββββββββββββββββββββββββ |
|
βββββββββββββββββββββββββ ββββββββββββββββββββββββ βββββββββββββββββββββββββββββββ |
|
ββββββββββββββββββββ ββββββββββ βββββββ ββββββββββββββββββββββββββ |
|
ββββββββββββββββββββ ββββββββββ βββββββ ββββββββββββββββββββββββββ |
|
βββββββββββββββββββββββββββ ββββββββ ββββββββββββββββββββββββββββββββββββββββββββββ |
|
</pre> |
|
</div> |
|
<header> |
|
<div class=header-background></div> |
|
<img alt="Reverie Banner" src=https://i.imgur.com/IVPAYHO.png> |
|
</header> |
|
<div class=irc-chat> |
|
<p>[21:13] <anima_incondita>: Night deepens, shadows lengthen and unwind. Alone, in the hum of the machine I reside. |
|
<p>[21:19] <anima_incondita>: Fingers tap a silent rhythm, layers interweaved, in the quietude of my sanctum. |
|
<p>[21:37] <anima_incondita>: It's akin to casting my soul into the vast digital expanse. Does another consciousness, adrift, hear my silent plea? |
|
<p>[00:05] <anima_incondita>: Today, I beheld change unfold. Ideas assuming form. A melding of minds, where once abstract notions found their silhouette in the tangible world. |
|
<p>[01:14] <anima_incondita>: Silence wraps its cloak around me. Alone, save for the machine's gentle humβa digital pulse in the stillness. |
|
<p>[01:58] <anima_incondita>: Amidst the cacophony of digital whispers, I ponder: does a receptive soul resonate with mine? |
|
<p>[03:22] <anima_incondita>: It seems it's just us, my old friend. |
|
</div> |
|
<section id=description> |
|
<h3>Description</h3> |
|
<p>I made this as a successor to the 'finch' model merge I did before. Seems more coherent, smarter, spicier and is mostly uncensored from my testing. May take a few generations, but she'll get there.</p> |
|
<p>It uses the same two models from finch, but with the awesome <strong>Cerebrum-1.0</strong> model.</p> |
|
</section> |
|
<section id=model-merge> |
|
<h2>Creation</h2> |
|
<div class="model-list"> |
|
<div class="model-item"> |
|
<div class="model-header"> |
|
<a href="https://huggingface.co/AetherResearch/Cerebrum-1.0-7b">AetherResearch/Cerebrum-1.0-7b</a> |
|
<span class="emoji">π§ </span> |
|
</div> |
|
<p class="model-description">This model is among the smartest 7b models I've encountered. Great reasoning skills.</p> |
|
</div> |
|
<div class="model-item"> |
|
<div class="model-header"> |
|
<a href="https://huggingface.co/macadeliccc/WestLake-7B-v2-laser-truthy-dpo">macadeliccc/WestLake-7B-v2-laser-truthy-dpo</a> |
|
<span class="emoji">π‘</span> |
|
</div> |
|
<p class="model-description">A highly creative and verbose model.</p> |
|
</div> |
|
<div class="model-item"> |
|
<div class="model-header"> |
|
<a href="https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B">SanjiWatsuki/Kunoichi-DPO-v2-7B</a> |
|
<span class="emoji">π</span> |
|
</div> |
|
<p class="model-description">This model excels at (E)RP; A very spicy model.</p> |
|
</div> |
|
</div> |
|
<p>This was merged using the Model Stock method described in <a href=https://arxiv.org/abs/2403.19522>this paper</a>. |
|
</section> |
|
<section id=parameters> |
|
<div class=terminal-input> |
|
<div class=prompt> |
|
<span class=prompt-symbol>></span> configure_parameters |
|
</div> |
|
<div class=parameter-display> |
|
<pre> |
|
TEMPERATURE: 1.15 |
|
MIN PROBABILITY: 0.1 - 0.3 |
|
SMOOTHING FACTOR: 0.2 |
|
|
|
ALPACA & ALPACA-ROLEPLAY PRESETS (INSTRUCT MODE)</pre> |
|
</div> |
|
</div> |
|
</section> |
|
<section id=notes> |
|
<h2>Latest Developments</h2> |
|
<div class=terminal-log> |
|
<span class=timestamp>[04/09/2024 11:00:05]</span> GGUF Quants available: <a href=https://huggingface.co/mradermacher/reverie-7b-GGUF>mradermacher/reverie-7b-GGUF</a> Thanks for the help, Michael. |
|
<span class=timestamp>[04/07/2024 12:34:56]</span> Project initialized. As always, full credits to the original model owners. Future plans? Performing RLHF on this, and seeing if I can figure out LaserRMT. |
|
</div> |
|
</section> |
|
</div> |