6 points | by drgore 12 hours ago
3 comments
Just what I need for my Orange Pi 5. I think a 8-bit quant would fit wonderfully.
impressive for a small model, but probably only useful if you cannot fit a bigger model (25-35B)
Just what I need for my Orange Pi 5. I think a 8-bit quant would fit wonderfully.
impressive for a small model, but probably only useful if you cannot fit a bigger model (25-35B)