Routers and Ensembles

When routing, escalation, majority voting, or multiple-model approaches are worth the complexity.

Routers and ensembles

Some teams will take a routing-based approach, starting with a small model, and escalating to larger and more powerful models if needed.

Others will use ensembles - a variety of different models all performing the same task, and then using some kind of majority voting logic to decide on a final answer.

While these approaches can be viable, we recommend choosing one strong model for the task at hand. In some cases the right answer here may be a mixture-of-experts (MoE) type model, which already uses router/ensemble logic as part of its architecture.