6 points | by villaspedro 5 hours ago
3 comments
When you say it costs 57% less to use Halv do you mean this is due to routing to a cheaper model or thanks to compression?
the benchmark ran with the whole suite enabled, so routing, compression, better code indexing, and command filtering.
When you say it costs 57% less to use Halv do you mean this is due to routing to a cheaper model or thanks to compression?
the benchmark ran with the whole suite enabled, so routing, compression, better code indexing, and command filtering.