Can vllm support be provided
#13
by
alfgo
- opened
Can vllm support be provided
(edit) Hi
@alfgo
, you should be able to use vllm with our model out of the box as it is a GPTBigCodeForCausalLM model, which VLLM supports out of the box: https://vllm.readthedocs.io/en/latest/models/supported_models.html
jp-defog
changed discussion status to
closed