ITADN

How to train a router?

#65Openawsankur 创建于 2024-10-29
A
awsankurcommented
My understanding is that the current implementation of llm-router supports only these models? strong_model="gpt-4-1106-preview", weak_model="anyscale/mistralai/Mixtral-8x7B-Instruct-v0.1", Is that correct? The `routellm/calibrate_threshold.py` is just reading this dataset: https://huggingface.co/datasets/routellm/lmsys-arena-human-preference-55k-thresholds How do I train a router to pick between these two models in Bedrock: strong_model="meta.llama3-1-8b-instruct-v1:0", weak_model="meta.llama3-1-405b-instruct-v1:0",
0 条评论