MarinaraSpaghetti/NemoMix-Unleashed-12B
Text Generation
•
Updated
•
13.3k
•
148
Olaf Kowalsky
Olafangensan
AI & ML interests
None yet
Recent Activity
New activity
24 days ago
Etched/oasis-500m:Safetensors request
New activity
about 2 months ago
anthracite-org/magnum-v3-27b-kto:Genuinely impressive!
New activity
about 2 months ago
EVA-UNIT-01/EVA-Qwen2.5-7B-v0.0:Gibberish output from GGUF
Organizations
None yet
Olafangensan's activity
Safetensors request
2
#7 opened 24 days ago
by
Olafangensan
Olafangensan
Genuinely impressive!
1
#5 opened about 2 months ago
by
Olafangensan
Olafangensan
Gibberish output from GGUF
1
#1 opened about 2 months ago
by
Olafangensan
Olafangensan
liked
a
model
2 months ago
Better performance with ChatML for novel writing.
#6 opened 3 months ago
by
Olafangensan
Olafangensan
Feedback
44
#1 opened 3 months ago
by
MarinaraSpaghetti
MarinaraSpaghetti
GGUF quants version?
1
#1 opened 3 months ago
by
celsowm
celsowm
Amazing model, BUT...
3
#4 opened 3 months ago
by
Olafangensan
Olafangensan
Reacted to
Severian's
post with 👍
3 months ago
Post
1944
I'm excited to share a really cool milestone in my AI/LLM journey.
Brief backstory: Before diving into AI, I spent over a decade working in ecological fields such as the conservation corps, biodynamic farming, and natural habitat restoration. This background instilled in me a deep concern about the environmental impact of scaling AI without sustainable practices.
Driven by this concern, I've spent months planning and experimenting to make my AI work more eco-friendly. I'm thrilled to announce that I've successfully transitioned my entire operation to run on 100% sustainable solar power!
My current setup includes multiple linked Mac Pro tower desktops and custom code built from open-source libraries. While it's a bit experimental, this configuration is working great for my needs. All my LLM research, development, and client services now run exclusively on solar energy.
I'm curious if anyone else here has experimented with renewable energy for their LLM work?
For those interested in more details, I've written a brief blog post about this journey here https://medium.com/@betalabsllm/powering-the-future-be-ta-labs-revolutionary-100-solar-powered-ai-operation-444433e61d43
Brief backstory: Before diving into AI, I spent over a decade working in ecological fields such as the conservation corps, biodynamic farming, and natural habitat restoration. This background instilled in me a deep concern about the environmental impact of scaling AI without sustainable practices.
Driven by this concern, I've spent months planning and experimenting to make my AI work more eco-friendly. I'm thrilled to announce that I've successfully transitioned my entire operation to run on 100% sustainable solar power!
My current setup includes multiple linked Mac Pro tower desktops and custom code built from open-source libraries. While it's a bit experimental, this configuration is working great for my needs. All my LLM research, development, and client services now run exclusively on solar energy.
I'm curious if anyone else here has experimented with renewable energy for their LLM work?
For those interested in more details, I've written a brief blog post about this journey here https://medium.com/@betalabsllm/powering-the-future-be-ta-labs-revolutionary-100-solar-powered-ai-operation-444433e61d43
- 1 reply
upvoted
a
collection
4 months ago
liked
a
model
4 months ago
Feedback
14
#1 opened 4 months ago
by
MarinaraSpaghetti
MarinaraSpaghetti
eos_token_id error in oobabooga
6
#1 opened 4 months ago
by
Olafangensan
Olafangensan
Wrong position embedding size?
1
#1 opened 4 months ago
by
lanking
lanking
Unexpected Behaviors
7
#1 opened 4 months ago
by
Olafangensan
Olafangensan
Reacted to
Severian's
post with 🔥
5 months ago
Post
1169
Mixture of Agents now in MLC/LMStudio/Ollama
I've been a bit obsessed with the recent MoA paper and its implementation. I've noticed a HUGE upgrade in the final output and it seems to really be a great way to harness the power of a team of different LLMs. The downside is that it can be a bit slow to generate responses with the bigger models (but worth it if you want to wait). I wanted to get faster results so I made an MLC version and it actually works out great! Much quicker and the responses definitely are better than compared to just running one.
I'm going to keep working on seeing how it can be further integrated (API endpoints, RAG, synthetic data generation, etc) and will share the stuff that I can get to work decently enough :)
https://github.com/severian42/MoA-MLC-Chat
https://github.com/severian42/MoA-Ollama-Chat
https://github.com/severian42/MoA-LMStudio-Chat
I've been a bit obsessed with the recent MoA paper and its implementation. I've noticed a HUGE upgrade in the final output and it seems to really be a great way to harness the power of a team of different LLMs. The downside is that it can be a bit slow to generate responses with the bigger models (but worth it if you want to wait). I wanted to get faster results so I made an MLC version and it actually works out great! Much quicker and the responses definitely are better than compared to just running one.
I'm going to keep working on seeing how it can be further integrated (API endpoints, RAG, synthetic data generation, etc) and will share the stuff that I can get to work decently enough :)
https://github.com/severian42/MoA-MLC-Chat
https://github.com/severian42/MoA-Ollama-Chat
https://github.com/severian42/MoA-LMStudio-Chat
liked
a
model
6 months ago
KoboltCPP settings? Preset?
1
#2 opened 6 months ago
by
Olafangensan
Olafangensan
Finally, an instruct fine tune!
#9 opened 6 months ago
by
Olafangensan
Olafangensan
Hoping this work out well!
3
#2 opened 7 months ago
by
Olafangensan
Olafangensan