Spaces:
Running
Running
| model,throughput,response_length,latency,energy | |
| openaccess-ai-collective/manticore-13b-chat-pyg,17.4993855646115,229.5795836131632,13.132503049058466,3501.182491605137 | |
| lmsys/vicuna-7B,29.046593546528904,212.760241773002,7.3296203452423265,1706.1712568838818 | |
| BlinkDL/RWKV-4-Raven-7B-v12-Eng98%-Other2%-20230521-ctx8192.pth,33.07481929862108,242.74177300201478,6.943508281124177,1787.5870651446628 | |
| tatsu-lab/alpaca-7B,29.475397017987323,117.95399597044997,3.9749026008906023,927.7634805239352 | |
| metaai/llama-13B,15.786345111463364,102.35762256548018,6.009854743435423,1590.8409496307413 | |
| OpenAssistant/oasst-sft-1-pythia-12b,16.03459728484094,241.31732706514438,14.686811677200872,3673.6327222969167 | |
| BAIR/koala-7b,29.75360600658546,200.51544660846204,6.658448294727219,1426.3522693082625 | |
| databricks/dolly-v2-12b,15.330621441395213,149.7411014103425,9.354867176525545,2240.8669214236447 | |
| togethercomputer/RedPajama-INCITE-7B-Chat,20.849945627496787,275.1017461383479,12.625316554842463,2521.5761004031265 | |
| BAIR/koala-13b,17.3129078938621,185.43653458697113,10.592529783475095,3058.9324654130387 | |
| metaai/llama-7B,26.263780879593444,96.94089993284084,3.35252434620665,871.9958969106643 | |
| lmsys/vicuna-13B,17.391771626218006,199.80960376091338,11.55835909586615,3031.3180846202845 | |
| camel-ai/CAMEL-13B-Combined-Data,17.27426964902266,194.22028206850234,11.174119858559074,2956.610076225849 | |
| FreedomIntelligence/phoenix-inst-chat-7b,32.63089093979437,197.44492948287441,5.895621189552368,1736.5409079919812 | |
| StabilityAI/stablelm-tuned-alpha-7b,26.523547972773766,244.16588314304903,8.984752658064695,2305.969679315211 | |
| h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,29.926231643904146,223.85426460711886,7.510739674653152,1676.2203126259078 | |
| Neutralzz/BiLLa-7B-SFT,29.118626503392385,104.97817327065144,3.5443721553023035,818.274197783844 | |
| nomic-ai/gpt4all-13b-snoozy,17.423064750595767,135.3938885157824,7.734149922101941,1871.6546057756862 | |
| project-baize/baize-v2-7B,28.13796712305154,262.9902619207522,9.250474432119292,2105.324460711873 | |
| lmsys/fastchat-t5-3b-v1.0,40.20822673632634,281.74110141034254,10.492163513616964,1110.3276249158694 | |
| metaai/Llama-2-13b-chat-hf,16.753336372767794,223.39019476158495,12.93183804940574,2423.302869711249 | |
| metaai/Llama-2-7b-chat-hf,30.95799874634315,220.83680322364003,6.815573463441101,1288.2125369376631 | |