am-compact
cargoQwen3 inference engine with Attention Management KV-cache compaction (CUDA + Apple Silicon via MLX)
Audits
No audits for this package yet.
Qwen3 inference engine with Attention Management KV-cache compaction (CUDA + Apple Silicon via MLX)