aitna
cargoA local LLM inference platform with model pulling, quantization optimization, and high-performance serving
Audits
No audits for this package yet.
A local LLM inference platform with model pulling, quantization optimization, and high-performance serving