Illumotion's picture
Upload folder using huggingface_hub
46c2bfc
# llama.cpp/example/parallel
Simplified simluation for serving incoming requests in parallel