Microsoft's Phi-2 for RK3588

This is a conversion from https://huggingface.co/microsoft/phi-2 to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.

Current update as of commit 834565c due to incompatibilities from RKLLM library.

Latest update: April 2024. Converted with RKLLM runtime 1.0.0.

Main repo

See this for my full collection of converted LLMs for the RK3588's NPU:

https://huggingface.co/Pelochus/ezrkllm-collection

License

Same as the original LLM, in this case MIT:

https://huggingface.co/microsoft/phi-2

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .