Configuration error
🚀
Tushar Tiwari
tushifire
·
AI & ML interests
None yet
Recent Activity
liked
a dataset
6 days ago
reshabhs/SPML_Chatbot_Prompt_Injection
Reacted to
csabakecskemeti's
post
with 👍
9 days ago
Some time ago, I built a predictive LLM router that routes chat requests between small and large LLM models based on prompt classification. It dynamically selects the most suitable model depending on the complexity of the user input, ensuring optimal performance while maintaining conversation context. I also fine-tuned a RoBERTa model to use with the package, but you can plug and play any classifier of your choice.
Project's homepage:
https://devquasar.com/llm-predictive-router/
Pypi:
https://pypi.org/project/llm-predictive-router/
Model:
https://huggingface.co/DevQuasar/roberta-prompt_classifier-v0.1
Training data:
https://huggingface.co/datasets/DevQuasar/llm_router_dataset-synth
Git:
https://github.com/csabakecskemeti/llm_predictive_router_package
Feel free to check it out, and/or contribute.
liked
a model
17 days ago
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Organizations
