atomr-infer-runtime-mistralrs
cargoMistral.rs runner for atomr-infer. Wraps mistralrs::TextModelBuilder + Model behind the ModelRunner trait with token-streaming.
Audits
No audits for this package yet.
Mistral.rs runner for atomr-infer. Wraps mistralrs::TextModelBuilder + Model behind the ModelRunner trait with token-streaming.