Edit Models filters

Inference status

Misc

arxiv: 1907.10641

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

339

Full-text search

Active filters: 1907.10641

theo77186/recurrentgemma-9b-it-bnb-4bit

Text Generation • Updated Aug 9 • 15

4bit/gemma-2b

Text Generation • Updated Jun 20 • 161

neuralmagic/SparseLlama-3-8B-pruned_50.2of4

Text Generation • Updated Oct 4 • 70

nm-testing/SparseLlama-3-8B-pruned_50.2of4-FP8

Text Generation • Updated Jun 25 • 17

google/gemma-2-9b-it-pytorch

Text Generation • Updated Jun 27 • 7

google/gemma-2-9b-keras

Text Generation • Updated about 1 month ago • 30 • 7

neuralmagic/Meta-Llama-3-70B-Instruct-FP8-KV

Text Generation • Updated Jun 26 • 535 • 2

SillyTilly/google-gemma-2-9b

Text Generation • Updated Aug 24 • 13 • 1

QuantFactory/gemma-2-9b-GGUF

Text Generation • Updated Jun 29 • 435 • 5

SillyTilly/google-gemma-2-9b-it

Text Generation • Updated Jun 27 • 12 • 2

SillyTilly/google-gemma-2-27b-it

Text Generation • Updated Jun 27 • 15

SillyTilly/google-gemma-2-27b

Text Generation • Updated Jun 28 • 10

rainjay/gemma-2-9b-it-4bit

Text Generation • Updated Jun 28 • 13

rainjay/gemma-2-27b-it-4bit

Text Generation • Updated Jun 28 • 23 • 3

QuantFactory/gemma-2-9b-it-GGUF

Text Generation • Updated Jun 29 • 128 • 2

RichardErkhov/mhenrichsen_-_gemma-2b-gguf

Updated Jun 29 • 106

RichardErkhov/4bit_-_gemma-2b-gguf

Updated Jun 30 • 108

RichardErkhov/MayaPH_-_GodziLLa2-70B-gguf

Updated Jul 3 • 274

axolotl-ai-co/gemma-2-9b

Text Generation • Updated Jul 2 • 21

axolotl-ai-co/gemma-2-27b

Text Generation • Updated Jul 2 • 7

ctx7/gemma-2b

Text Generation • Updated Jul 4 • 25

Sammy1611/gemma_2_9b_quanted-GGUF

Text Generation • Updated Jul 6 • 10

FlorianJc/google-gemma-2-9b-it-vllm-fp8

Text Generation • Updated Jul 17 • 15 • 1

professorf/gemma-2-9b-q8_0-gguf

Text Generation • Updated Aug 27 • 4

nihaomur/gemma-2-9b-it-AWQ

Text Generation • Updated Jul 19 • 127

RichardErkhov/RESMPDEV_-_Gemma-Wukong-2b-gguf

Updated Jul 15 • 173

RichardErkhov/neuralmagic_-_Llama-2-7b-dolphin-open_platypus-pruned_70-gguf

Updated Jul 16 • 237

CallComply/gemma-2-27b-it

Text Generation • Updated Jul 16 • 6

bigstorm/gemma-2-27b-it-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 5

nihaomur/gemma-2-9b-it-Q5_K_M.gguf

Text Generation • Updated Jul 20 • 5