MiniMax-01: Scaling Foundation Models with Lightning Attention
Paper
•
2501.08313
•
Published
•
193
MiniMax
Enterprise
company
AI & ML interests
Intelligence with Everyone
Recent Activity
View all activity
MiniMaxAI's activity
MiniMax-AI
authored
a
paper
about 6 hours ago
kamuy-shennai
authored
a
paper
about 6 hours ago
Remove import that no longer exists in Transformers
#2 opened about 10 hours ago
by
Rocketknight1
Remove import that no longer exists in Transformers
#5 opened about 10 hours ago
by
Rocketknight1
Add library name for snippets
#1 opened about 14 hours ago
by
reach-vb
MiniMax-AI
updated
a
model
about 14 hours ago
Add Transformers as the library
#4 opened about 14 hours ago
by
reach-vb
Hannnnnxd
authored
a
paper
about 14 hours ago
MiniMax-AI
updated
a
model
about 20 hours ago
MiniMax-AI
updated
2
Spaces
1 day ago
Post
1810
With the open-weight release of CogVideoX-5B from THUDM, i.e. GLM team, the Video Generation Model (how about calling it VGM) field has officially became the next booming "LLM"
What does the landscape look like? What are other video generation models? This collection below is all your need.
xianbao/video-generation-models-66c350163c74f60f5c412af6
The above video is generated by @a-r-r-o-w with CogVideoX-5B, taken from a nice lookout for the field!
What does the landscape look like? What are other video generation models? This collection below is all your need.
xianbao/video-generation-models-66c350163c74f60f5c412af6
The above video is generated by @a-r-r-o-w with CogVideoX-5B, taken from a nice lookout for the field!
Ryan1122
authored
5
papers
7 months ago
Scaling TransNormer to 175 Billion Parameters
Paper
•
2307.14995
•
Published
•
21
Fine-grained Audible Video Description
Paper
•
2303.15616
•
Published
•
1
CO2: Efficient Distributed Training with Full Communication-Computation Overlap
Paper
•
2401.16265
•
Published
•
1
Linear Attention Sequence Parallelism
Paper
•
2404.02882
•
Published
•
3
Scaling Laws for Linear Complexity Language Models
Paper
•
2406.16690
•
Published
•
23
xianbao
authored
a
paper
7 months ago
Hannnnnxd
authored
a
paper
7 months ago
Post
1866
Why Apache 2.0 Matters for LLMs 🤔
@01AI_Yi recently switched from a permissive & commercially friendly license, to Apache 2.0. And the community loved it! 🚀
@JustinLin610 also had a poll on model license and the majority votes for Apache 2.0.
Why it is a Big Deal? ⬇️
📚 Legal Simplicity: Custom licenses need costly & time-consuming legal review. Apache 2.0 is well-known & easier for legal teams to handle.
👩💻 Developer-Friendly: Legal docs are a pain for devs! Apache 2.0 is well-known and tech-friendly, making it easier for non-native developers to understand the implications too.
🔗 Easier Integration: Apache 2.0 is compatible with many other licenses, simplifying tasks like model merging with models of different licensing requirements.
🚫 No Permission Needed: Custom licenses often require explicit permission and additional documentation work of filling forms, creating barriers. Apache 2.0 removes this hurdle, letting devs focus on innovation.
There are a lot interesting discussions from
@JustinLin610 's poll: https://x.com/JustinLin610/status/1793559737482764375 which inspired this thread.
Any other thoughts? Let me know ^^
@01AI_Yi recently switched from a permissive & commercially friendly license, to Apache 2.0. And the community loved it! 🚀
@JustinLin610 also had a poll on model license and the majority votes for Apache 2.0.
Why it is a Big Deal? ⬇️
📚 Legal Simplicity: Custom licenses need costly & time-consuming legal review. Apache 2.0 is well-known & easier for legal teams to handle.
👩💻 Developer-Friendly: Legal docs are a pain for devs! Apache 2.0 is well-known and tech-friendly, making it easier for non-native developers to understand the implications too.
🔗 Easier Integration: Apache 2.0 is compatible with many other licenses, simplifying tasks like model merging with models of different licensing requirements.
🚫 No Permission Needed: Custom licenses often require explicit permission and additional documentation work of filling forms, creating barriers. Apache 2.0 removes this hurdle, letting devs focus on innovation.
There are a lot interesting discussions from
@JustinLin610 's poll: https://x.com/JustinLin610/status/1793559737482764375 which inspired this thread.
Any other thoughts? Let me know ^^
- 1 reply