Adding LLMs

Arfniia Router can support any number of LLMs for each router. However, when adding new LLMs to an existing router, it’s recommended to create a new router instead.

From a technical perspective, each router functions as an online deep reinforcement learning system. It relies on a neural network to map the user’s prompt to the index of the available LLMs. When a new LLM is added to an existing router, it alters the shape of the neural network’s output (e.g., increasing the output from 3 to 4 indices). This change would trigger a re-learning process, essentially resetting the model, which may require the system to learn from scratch.

Creating a new router helps avoid this disruption and preserves the learned knowledge of existing configurations.