cargo / atomr-infer-pipeline

atomr-infer-pipeline

cargo

atomr-streams integration for atomr-infer; re-exports the atomr-accel-patterns blueprints (DynamicBatchingServer, InferenceCascade, ModelReplicaPool, FairShareScheduler, ModelHotSwapServer, SpeculativeDecoder, MoeRouter).

0 audits github.com/rustakka/atomr-infer

Audits

No audits for this package yet.