Thanks for the numbers. It's interesting to see how big the difference between the top end and the smallest ones are. I think the ideal approach is likely using the bottom end with different harnesses for different kind of tasks eventually, where the system prompt and toolset is predefined, maybe wrapped by something like a harness of harnesses which decides the correct one to choose. Matters a lot for local hosting of the models as well since speeds are usually a bit slower than what big providers offer.
Thanks for the numbers. It's interesting to see how big the difference between the top end and the smallest ones are. I think the ideal approach is likely using the bottom end with different harnesses for different kind of tasks eventually, where the system prompt and toolset is predefined, maybe wrapped by something like a harness of harnesses which decides the correct one to choose. Matters a lot for local hosting of the models as well since speeds are usually a bit slower than what big providers offer.