blazar
cargoMulti-engine local inference platform: one `blazar` binary serving llama.cpp, mistral.rs, SGLang, and MLX through OpenAI- and ollama-compatible APIs
Audits
No audits for this package yet.
Multi-engine local inference platform: one `blazar` binary serving llama.cpp, mistral.rs, SGLang, and MLX through OpenAI- and ollama-compatible APIs